Jul 15 20:57:19.880554 ip-10-0-135-15 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 20:57:19.880565 ip-10-0-135-15 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 20:57:19.880572 ip-10-0-135-15 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 20:57:19.880797 ip-10-0-135-15 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 20:57:31.060885 ip-10-0-135-15 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 20:57:31.060902 ip-10-0-135-15 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 72d33e561a844442b76d1292c6f0be6d --
Jul 15 20:59:08.719852 ip-10-0-135-15 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.159851    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166584    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166596    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166599    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166602    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166605    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166609    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166612    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:09.214233 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166615    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166618    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166621    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166623    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166626    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166628    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166633    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166637    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166640    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166642    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166645    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166649    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166651    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166654    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166657    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166659    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166662    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166664    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166667    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:09.216891 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166670    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166672    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166675    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166678    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166682    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166684    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166687    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166689    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166692    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166694    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166697    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166699    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166702    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166704    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166707    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166709    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166712    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166715    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166717    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166720    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:09.226508 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166722    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166725    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166728    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166730    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166734    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166738    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166740    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166743    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166746    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166749    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166751    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166754    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166757    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166761    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166763    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166766    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166770    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166773    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166775    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:09.228969 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166779    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166781    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166784    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166787    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166789    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166792    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166794    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166797    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166801    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166804    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166807    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166810    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166813    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166817    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166820    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166823    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166826    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166829    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166831    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166834    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:09.234858 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166836    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166838    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166841    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166843    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166846    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166848    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166851    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166854    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166856    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166859    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166862    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166865    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166867    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.166870    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167602    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167610    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167613    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167616    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167620    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167622    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:09.238350 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167625    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167628    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167631    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167633    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167636    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167639    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167643    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167647    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167650    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167653    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167656    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167659    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167661    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167664    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167667    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167669    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167672    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167674    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167677    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167680    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:09.242625 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167683    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167686    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167688    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167691    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167693    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167696    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167698    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167701    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167704    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167707    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167709    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167712    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167714    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167717    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167719    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167722    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167725    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167727    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167730    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167732    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:09.250149 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167735    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:09.250249 ip-10-0-135-15 systemd[1]: Started Kubernetes Kubelet.
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167737    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167740    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167743    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167745    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167748    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167752    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167756    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167758    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167761    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167764    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167767    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167770    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167778    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167780    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167783    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167786    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167789    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:09.250982 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167792    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167794    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167797    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167799    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167802    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167804    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167807    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167811    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167813    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167816    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167818    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167821    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167823    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167826    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167829    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167833    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167836    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167839    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167842    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:09.251709 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167845    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167847    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167850    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167852    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167855    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167858    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167861    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167863    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167867    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167870    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167872    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167875    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167877    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167880    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167882    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.167885    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168235    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168239    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168242    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168245    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168248    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:09.252489 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168250    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168253    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168255    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168258    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168261    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168264    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168266    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168269    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168271    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168274    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168277    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168279    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168282    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168284    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168287    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168290    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168292    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168295    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168297    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168301    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:09.253408 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168304    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168306    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168309    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168311    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168314    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168316    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168319    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168322    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168324    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168327    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168329    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168332    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168335    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168338    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168341    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168344    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168347    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168351    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168353    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:09.254327 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168357    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168360    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168362    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168365    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168368    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168370    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168372    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168375    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168377    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168380    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168382    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168385    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168389    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168394    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168397    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168400    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168403    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168406    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168409    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:09.254806 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168411    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168414    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168417    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168419    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168422    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168424    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168426    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168431    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168434    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168437    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168439    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168442    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168445    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168449    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168452    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168454    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168457    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168460    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168463    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168465    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:09.255337 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168467    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168470    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168472    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168475    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168477    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168481    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168484    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168486    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168489    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168491    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168494    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168496    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168499    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168501    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168504    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.168506    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168600    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168617    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168623    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168627    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168632    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 20:59:09.255825 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168635    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168639    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168643    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168646    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168650    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168654    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168670    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168675    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168678    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168682    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168685    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168688    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168691    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168696    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168699    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168702    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168706    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168710    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168713    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168716    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168719    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168723    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168726    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168728    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 20:59:09.256357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168731    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168735    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168738    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168742    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168745    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168747    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168750    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168754    2573 flags.go:64] FLAG: --enable-server="true"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168757    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168761    2573 flags.go:64] FLAG: --event-burst="100"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168764    2573 flags.go:64] FLAG: --event-qps="50"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168766    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168771    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168774    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168777    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168780    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168783    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168786    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168789    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168792    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168795    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168798    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168801    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168804    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168809    2573 flags.go:64] FLAG: --feature-gates=""
Jul 15 20:59:09.256979 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168812    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168815    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168818    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168821    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168825    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168828    2573 flags.go:64] FLAG: --help="false"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168831    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168834    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168837    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168839    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168843    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168846    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168849    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168852    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168855    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168858    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168861    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168864    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168866    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168870    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168873    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168876    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168879    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168881    2573 flags.go:64] FLAG: --lock-file=""
Jul 15 20:59:09.257640 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168884    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168887    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168891    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168896    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168899    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168902    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168904    2573 flags.go:64] FLAG: --logging-format="text"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168909    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168912    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168914    2573 flags.go:64] FLAG: --manifest-url=""
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168917    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168921    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168924    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168928    2573 flags.go:64] FLAG: --max-pods="110"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168931    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168934    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168937    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168939    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168942    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168945    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168948    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168955    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168958    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168961    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 20:59:09.258213 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168964    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168967    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168972    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168977    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168980    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168982    2573 flags.go:64] FLAG: --port="10250"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168985    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168988    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a34a113075bbf47e"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168991    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168994    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.168997    2573 flags.go:64] FLAG: --register-node="true"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169001    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169005    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169008    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169010    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169013    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169018    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169021    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169024    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169027    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169029    2573 flags.go:64] FLAG: --runonce="false"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169032    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169035    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169038    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169041    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 20:59:09.258823 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169044    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169047    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169050    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169053    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169056    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169059    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169061    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169064    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169067    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169070    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169073    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169078    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169082    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169085    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169092    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169094    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169097    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169100    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169103    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169106    2573 flags.go:64] FLAG: --v="2"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169110    2573 flags.go:64] FLAG: --version="false"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169114    2573 flags.go:64] FLAG: --vmodule=""
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169117    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.169121    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169231    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:09.259662 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169235    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169238    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169241    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169244    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169247    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169249    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169252    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169254    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169257    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169260    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169262    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169265    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169268    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169270    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169273    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169275    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169278    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169282    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169285    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169287    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:09.260315 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169290    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169292    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169295    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169297    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169300    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169303    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169306    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169309    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169313    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169316    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169320    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169323    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169325    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169328    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169331    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169333    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169336    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169338    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169341    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:09.260837 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169343    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169346    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169348    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169351    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169353    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169356    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169358    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169361    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169371    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169374    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169378    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169381    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169383    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169386    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169388    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169391    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169393    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169396    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169399    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169401    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:09.261300 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169404    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169407    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169410    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169414    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169416    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169419    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169422    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169424    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169427    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169429    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169432    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169434    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169437    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169439    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169442    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169444    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169448    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169451    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169454    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169457    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:09.261819 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169460    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169462    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169468    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169470    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169473    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169475    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169478    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169480    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169483    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169485    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169487    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169490    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169494    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169497    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169500    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169504    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169507    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169510    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:09.262302 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.169513    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.170374    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.189353    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.189382    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.190300    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.190312    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190371    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190378    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190383    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190387    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190390    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190393    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190396    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190399    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:09.262756 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190402    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190405    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190407    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190410    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190413    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190415    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190418    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190420    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190423    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190427    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190429    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190432    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190435    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190437    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190440    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190443    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190446    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190449    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190452    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190455    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:09.263105 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190458    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190460    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190463    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190465    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190468    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190470    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190473    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190477    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190481    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190484    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190487    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190490    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190493    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190495    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190498    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190501    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190504    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190507    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190510    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:09.263590 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190513    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190515    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190518    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190521    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190524    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190526    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190529    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190531    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190534    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190537    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190540    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190560    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190565    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190567    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190570    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190573    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190576    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190579    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190582    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:09.264044 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190584    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190587    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190589    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190592    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190594    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190597    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190599    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190602    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190605    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190607    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190610    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190612    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190615    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190618    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190621    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190624    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190630    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190632    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190635    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190638    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:09.264496 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190640    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190643    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190646    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190648    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190651    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190654    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190657    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190659    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190662    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190664    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190667    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190670    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190672    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.190677    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:59:09.265005 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190800    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190805    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190808    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190812    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190815    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190818    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190821    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190824    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190827    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190830    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190833    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190835    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190839    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190841    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190844    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190849    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190851    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190854    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190858    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:09.265358 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190862    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190865    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190868    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190871    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190874    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190876    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190879    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190882    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190885    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190887    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190890    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190892    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190895    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190898    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190900    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190903    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190906    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190909    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190911    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190914    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:09.265844 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190916    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190919    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190921    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190924    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190926    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190929    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190932    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190935    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190939    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190942    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190945    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190947    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190950    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190952    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190955    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190957    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190960    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190962    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190965    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190967    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:09.266312 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190970    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190972    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190975    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190977    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190980    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190982    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190987    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190989    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190994    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190997    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.190999    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191002    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191004    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191007    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191010    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191012    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191015    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191017    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191020    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:09.266812 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191023    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191027    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191030    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191032    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191035    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191037    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191040    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191042    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191045    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191047    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191051    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191054    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191058    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191060    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191064    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191067    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191069    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191072    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191075    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:09.267277 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191077    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:09.191080    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.191086    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.191199    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.193605    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.195269    2573 server.go:1019] "Starting client certificate rotation"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.195369    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.195396    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.199019    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.200305    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.215937    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.218682    2573 log.go:25] "Validated CRI v1 image API"
Jul 15 20:59:09.267747 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.219463    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 20:59:09.268047 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.222936    2573 fs.go:135] Filesystem UUIDs: map[43d51d61-b958-4856-9a63-40a73282346f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d3837e03-51a4-48a0-94f2-b8700610b229:/dev/nvme0n1p3]
Jul 15 20:59:09.268047 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.222958    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.228488    2573 manager.go:216] Machine: {Timestamp:2026-07-15 20:59:09.228010586 +0000 UTC m=+0.381695099 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099402 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2339958f750ab72c763c3d7475fdd6 SystemUUID:ec233995-8f75-0ab7-2c76-3c3d7475fdd6 BootID:72d33e56-1a84-4442-b76d-1292c6f0be6d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:ec:68:ca:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:ec:68:ca:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:f0:f0:ab:91:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.228595    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.228677    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.230144    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.231374    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.231398    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-15.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.232248    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.232258    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.232267    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.232281    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.234033    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.237762    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.237876    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.237905    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.237915    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.237928    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 20:59:09.268107 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.237936    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.237945    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.238278    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.238299    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.240855    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243159    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243187    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243355    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243368    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243374    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243379    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243389    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.243397    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.244038    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.244045    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.244052    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.244057    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.244065    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.244072    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.245936    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.245943    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.249354    2573 server.go:1268] "Started kubelet"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.249564    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.249600    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.250381    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.251190    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.251819    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.251904    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-15.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.252006    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.252766    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.258772    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.258778    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.258915    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.259558    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.259574    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.259560    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.259741    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 20:59:09.268555 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.259752    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 20:59:09.270130 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270109    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-btr9k"
Jul 15 20:59:09.270226 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270134    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-btr9k"
Jul 15 20:59:09.270315 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270300    2573 factory.go:55] Registering systemd factory
Jul 15 20:59:09.270362 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270319    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 15 20:59:09.270631 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270614    2573 factory.go:153] Registering CRI-O factory
Jul 15 20:59:09.270719 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270636    2573 factory.go:223] Registration of the crio container factory successfully
Jul 15 20:59:09.270719 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270710    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 20:59:09.270816 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270737    2573 factory.go:103] Registering Raw factory
Jul 15 20:59:09.270816 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.270753    2573 manager.go:1196] Started watching for new ooms in manager
Jul 15 20:59:09.272343 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.272311    2573 manager.go:349] Starting recovery of all containers
Jul 15 20:59:09.274815 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.272399    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 20:59:09.275085 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.275061    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 20:59:09.275488 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.275447    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 20:59:09.280055 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.275605    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-15.ec2.internal.18c29232cb5244d1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-15.ec2.internal,UID:ip-10-0-135-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-15.ec2.internal,},FirstTimestamp:2026-07-15 20:59:09.249324241 +0000 UTC m=+0.403008754,LastTimestamp:2026-07-15 20:59:09.249324241 +0000 UTC m=+0.403008754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-15.ec2.internal,}"
Jul 15 20:59:09.285273 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.285255    2573 manager.go:354] Recovery completed
Jul 15 20:59:09.289431 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.289346    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:09.291328 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.291310    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:09.291385 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.291342    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:09.291385 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.291357    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:09.291867 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.291852    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 20:59:09.291867 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.291865    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 20:59:09.291998 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.291871    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:09.291998 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.291879    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 20:59:09.292808 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.292788    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:09.292892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.292824    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:09.292892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.292839    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:09.293493 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.293480    2573 policy_none.go:49] "None policy: Start"
Jul 15 20:59:09.293541 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.293496    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 20:59:09.293541 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.293506    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 20:59:09.294652 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.294640    2573 policy_none.go:47] "Start"
Jul 15 20:59:09.327824 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.327703    2573 manager.go:337] "Starting Device Plugin manager"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.327860    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.327875    2573 server.go:87] "Starting device plugin registration server"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.328110    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.328120    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.328246    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.328319    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.328328    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.328793    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.328839    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.348182    2573 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2608 into the system container \"/system.slice\": <nil>"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.428620    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.429431    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.429458    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.429469    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.429493    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.438608    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.446847 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.438625    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-15.ec2.internal\": node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.460916 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.460868    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.561431 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.561400    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.566801 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.566776    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 20:59:09.568022 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.567999    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 20:59:09.568116 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.568035    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 20:59:09.568116 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.568056    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 20:59:09.568116 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.568088    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 20:59:09.570597 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.570580    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:09.661841 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.661809    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.668972 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.668952    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal"]
Jul 15 20:59:09.669023 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.669014    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:09.672542 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.672526    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:09.672646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.672574    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:09.672646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.672589    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:09.673949 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.673934    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:09.674050 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674037    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.674097 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674065    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:09.674619 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674604    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:09.674688 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674617    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:09.674688 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674635    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:09.674688 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674645    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:09.674785 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674635    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:09.674785 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.674711    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:09.675861 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.675845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.676245 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.675881    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:09.676865 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.676838    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:09.676952 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.676869    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:09.676952 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.676881    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:09.701107 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.701087    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-15.ec2.internal\" not found" node="ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.704386 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.704368    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-15.ec2.internal\" not found" node="ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.762038 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.761978    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.762118 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.762056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d32d2a62d93ad28d5bbab2b530e2df6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal\" (UID: \"6d32d2a62d93ad28d5bbab2b530e2df6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.762118 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.762077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00eb5a080a0134a434dc03cd5b8be74b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-15.ec2.internal\" (UID: \"00eb5a080a0134a434dc03cd5b8be74b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.762118 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.762102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d32d2a62d93ad28d5bbab2b530e2df6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal\" (UID: \"6d32d2a62d93ad28d5bbab2b530e2df6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.862572 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.862537    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:09.862645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.862594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00eb5a080a0134a434dc03cd5b8be74b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-15.ec2.internal\" (UID: \"00eb5a080a0134a434dc03cd5b8be74b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.862645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.862623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d32d2a62d93ad28d5bbab2b530e2df6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal\" (UID: \"6d32d2a62d93ad28d5bbab2b530e2df6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.862645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.862639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d32d2a62d93ad28d5bbab2b530e2df6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal\" (UID: \"6d32d2a62d93ad28d5bbab2b530e2df6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.862748 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.862689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00eb5a080a0134a434dc03cd5b8be74b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-15.ec2.internal\" (UID: \"00eb5a080a0134a434dc03cd5b8be74b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.862748 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.862673    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d32d2a62d93ad28d5bbab2b530e2df6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal\" (UID: \"6d32d2a62d93ad28d5bbab2b530e2df6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.862748 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:09.862705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d32d2a62d93ad28d5bbab2b530e2df6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal\" (UID: \"6d32d2a62d93ad28d5bbab2b530e2df6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:09.966849 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:09.966804    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:10.004904 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.004857    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:10.007198 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.007179    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:10.067601 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:10.067524    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:10.167665 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:10.167637    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:10.195764 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.195725    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 20:59:10.195900 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.195881    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 20:59:10.267826 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:10.267792    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:10.276748 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.276717    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 20:54:09 +0000 UTC" deadline="2028-04-05 00:47:47.883942918 +0000 UTC"
Jul 15 20:59:10.276748 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.276744    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15099h48m37.607202112s"
Jul 15 20:59:10.368351 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:10.368313    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:10.468494 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:10.468456    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-15.ec2.internal\" not found"
Jul 15 20:59:10.534729 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.534694    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:10.539549 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.539531    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:10.559046 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.559020    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:10.566001 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:10.565971    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00eb5a080a0134a434dc03cd5b8be74b.slice/crio-1fe72a2ea9c2cadb82067cc59856bacbc963f3d39d1b0d913b24ae1aa30b6a2c WatchSource:0}: Error finding container 1fe72a2ea9c2cadb82067cc59856bacbc963f3d39d1b0d913b24ae1aa30b6a2c: Status 404 returned error can't find the container with id 1fe72a2ea9c2cadb82067cc59856bacbc963f3d39d1b0d913b24ae1aa30b6a2c
Jul 15 20:59:10.566698 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:10.566675    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d32d2a62d93ad28d5bbab2b530e2df6.slice/crio-f73b06ff083c18d212519fa4e358f0aa90e0c9529afb9fc8bfaa8846531ae0b4 WatchSource:0}: Error finding container f73b06ff083c18d212519fa4e358f0aa90e0c9529afb9fc8bfaa8846531ae0b4: Status 404 returned error can't find the container with id f73b06ff083c18d212519fa4e358f0aa90e0c9529afb9fc8bfaa8846531ae0b4
Jul 15 20:59:10.570346 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.570325    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 20:59:10.571252 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.571232    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal"
Jul 15 20:59:10.574207 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.574188    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:59:10.583660 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.583644    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 20:59:10.585267 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:10.585250    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:11.241521 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.241487    2573 apiserver.go:52] "Watching apiserver"
Jul 15 20:59:11.250209 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.250185    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 20:59:11.251074 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.251046    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qdg94","openshift-multus/network-metrics-daemon-sr5wf","openshift-network-diagnostics/network-check-target-hzpw7","openshift-network-operator/iptables-alerter-5nrcm","openshift-ovn-kubernetes/ovnkube-node-rrgq2","kube-system/global-pull-secret-syncer-sthd8","kube-system/konnectivity-agent-6kj6p","kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr","openshift-dns/node-resolver-kb88p","openshift-image-registry/node-ca-m7pjv","openshift-cluster-node-tuning-operator/tuned-wl5pg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal","openshift-multus/multus-additional-cni-plugins-pxfgz"]
Jul 15 20:59:11.252875 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.252852    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.254540 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.254267    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.255916 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.255673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:11.255916 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.255741    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:11.256501 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.256296    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x66tw\""
Jul 15 20:59:11.256501 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.256387    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 20:59:11.256501 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.256430    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 20:59:11.257064 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.256904    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 20:59:11.257064 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.256914    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 20:59:11.257233 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.257182    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 20:59:11.258035 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.258013    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.259258 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.259027    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f8hdd\""
Jul 15 20:59:11.259258 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.259245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.260724 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.260009    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 20:59:11.260724 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.260638    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:59:11.260724 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.260647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rz4vf\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.262981    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.263128    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.263081    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.263640    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.263695    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.263919    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.263937    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.264227    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.264282    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dzc94\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.264669    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 20:59:11.265114 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.264888    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 20:59:11.265683 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.265260    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 20:59:11.266050 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.266031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.266944 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.266922    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 20:59:11.267152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.267099    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nbswk\""
Jul 15 20:59:11.268227 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.268207    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 20:59:11.268900 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.268880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:11.268998 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.268965    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:11.269492 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.269197    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 20:59:11.269492 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.269255    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 20:59:11.269492 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.269298    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 20:59:11.269492 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.269353    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kkqcg\""
Jul 15 20:59:11.269963 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.269645    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 20:59:11.269963 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.269666    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 20:59:11.269963 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.269850    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 20:59:11.270941 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.270913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.272667 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.272633    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.273078 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.272742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbtwf\" (UniqueName: \"kubernetes.io/projected/fb68a911-5d71-416a-a67d-416edcf36221-kube-api-access-dbtwf\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.273175 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-cni-netd\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.273246 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e5320c-a7cb-4073-bd12-6e92795c2ad4-serviceca\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.273246 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58w64\" (UniqueName: \"kubernetes.io/projected/70e5320c-a7cb-4073-bd12-6e92795c2ad4-kube-api-access-58w64\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.273357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-etc-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.273357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.273357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.273357 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-slash\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovnkube-script-lib\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-var-lib-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-log-socket\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b78d033-4ff4-4d8f-ab01-142182b25978-agent-certs\") pod \"konnectivity-agent-6kj6p\" (UID: \"7b78d033-4ff4-4d8f-ab01-142182b25978\") " pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb68a911-5d71-416a-a67d-416edcf36221-iptables-alerter-script\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb68a911-5d71-416a-a67d-416edcf36221-host-slash\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.273645 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-cni-bin\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovn-node-metrics-cert\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273751    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebcc66aa-2faa-47f4-b31c-d270d90abacc-dbus\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b78d033-4ff4-4d8f-ab01-142182b25978-konnectivity-ca\") pod \"konnectivity-agent-6kj6p\" (UID: \"7b78d033-4ff4-4d8f-ab01-142182b25978\") " pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-kubelet\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-run-netns\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-systemd\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273895    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovnkube-config\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e5320c-a7cb-4073-bd12-6e92795c2ad4-host\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-systemd-units\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-ovn\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273991    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.274120    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.273992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-node-log\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.274194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-env-overrides\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.274224    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 20:59:11.274794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.274222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blk67\" (UniqueName: \"kubernetes.io/projected/8624d9fd-e95e-42ae-aa7d-722f62e77848-kube-api-access-blk67\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.275687 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.274284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebcc66aa-2faa-47f4-b31c-d270d90abacc-kubelet-config\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.275687 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.274350    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 20:59:11.275687 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.274482    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lw46w\""
Jul 15 20:59:11.276194 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.276172    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 20:59:11.276362 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.276330    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clflm\""
Jul 15 20:59:11.276916 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.276866    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 20:59:11.277001 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.276944    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tcpzq\""
Jul 15 20:59:11.277066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.277014    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:59:11.311858 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.311824    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kmlc6"
Jul 15 20:59:11.321194 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.321080    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kmlc6"
Jul 15 20:59:11.361221 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.361198    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 20:59:11.374631 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-run-netns\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.374753 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.374753 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e5320c-a7cb-4073-bd12-6e92795c2ad4-host\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.374753 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-run-netns\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.374753 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6aef2b0f-7b22-40a1-894a-74f378656ccc-tmp-dir\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.374753 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-modprobe-d\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.374753 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374750    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e5320c-a7cb-4073-bd12-6e92795c2ad4-host\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-system-cni-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-socket-dir-parent\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-systemd-units\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-env-overrides\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebcc66aa-2faa-47f4-b31c-d270d90abacc-kubelet-config\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-systemd-units\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-system-cni-dir\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.374965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-cni-netd\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375062 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebcc66aa-2faa-47f4-b31c-d270d90abacc-kubelet-config\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375068    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-cni-netd\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6aef2b0f-7b22-40a1-894a-74f378656ccc-hosts-file\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-hostroot\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-etc-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-etc-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-etc-kubernetes\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lz2g\" (UniqueName: \"kubernetes.io/projected/226b472b-157a-4255-a78f-fb54a744210b-kube-api-access-8lz2g\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375383    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.375715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375528    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-env-overrides\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysctl-conf\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-device-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nml2\" (UniqueName: \"kubernetes.io/projected/b5b26cf8-2145-4615-891c-9cbb229a8c5e-kube-api-access-8nml2\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.375977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/506d4161-8e19-493a-838a-6b24e784d698-tmp\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-log-socket\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-cnibin\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-os-release\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376091    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-log-socket\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/226b472b-157a-4255-a78f-fb54a744210b-multus-daemon-config\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376165    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-sys\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb68a911-5d71-416a-a67d-416edcf36221-iptables-alerter-script\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.376253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb68a911-5d71-416a-a67d-416edcf36221-host-slash\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-cni-bin\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb68a911-5d71-416a-a67d-416edcf36221-host-slash\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovn-node-metrics-cert\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-cni-bin\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebcc66aa-2faa-47f4-b31c-d270d90abacc-dbus\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b78d033-4ff4-4d8f-ab01-142182b25978-konnectivity-ca\") pod \"konnectivity-agent-6kj6p\" (UID: \"7b78d033-4ff4-4d8f-ab01-142182b25978\") " pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-run\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-lib-modules\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-cnibin\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-netns\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-kubelet\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebcc66aa-2faa-47f4-b31c-d270d90abacc-dbus\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-systemd\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovnkube-config\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376674    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq9r6\" (UniqueName: \"kubernetes.io/projected/6aef2b0f-7b22-40a1-894a-74f378656ccc-kube-api-access-sq9r6\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-socket-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.376892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376751    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-kubelet\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb68a911-5d71-416a-a67d-416edcf36221-iptables-alerter-script\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-systemd\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-ovn\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-node-log\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blk67\" (UniqueName: \"kubernetes.io/projected/8624d9fd-e95e-42ae-aa7d-722f62e77848-kube-api-access-blk67\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.376952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-run-ovn\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-cni-bin\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-multus-certs\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-host\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-k8s-cni-cncf-io\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbtwf\" (UniqueName: \"kubernetes.io/projected/fb68a911-5d71-416a-a67d-416edcf36221-kube-api-access-dbtwf\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e5320c-a7cb-4073-bd12-6e92795c2ad4-serviceca\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58w64\" (UniqueName: \"kubernetes.io/projected/70e5320c-a7cb-4073-bd12-6e92795c2ad4-kube-api-access-58w64\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/506d4161-8e19-493a-838a-6b24e784d698-etc-tuned\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.377477 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377346    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b78d033-4ff4-4d8f-ab01-142182b25978-konnectivity-ca\") pod \"konnectivity-agent-6kj6p\" (UID: \"7b78d033-4ff4-4d8f-ab01-142182b25978\") " pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-sys-fs\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovnkube-config\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-slash\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovnkube-script-lib\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.377509    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fxjq\" (UniqueName: \"kubernetes.io/projected/0835eda6-8a53-429b-b2b5-d7f214f709d0-kube-api-access-5fxjq\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-conf-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.377579    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret podName:ebcc66aa-2faa-47f4-b31c-d270d90abacc nodeName:}" failed. No retries permitted until 2026-07-15 20:59:11.877557603 +0000 UTC m=+3.031242125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret") pod "global-pull-secret-syncer-sthd8" (UID: "ebcc66aa-2faa-47f4-b31c-d270d90abacc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377591    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqvv\" (UniqueName: \"kubernetes.io/projected/506d4161-8e19-493a-838a-6b24e784d698-kube-api-access-5qqvv\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6xd5\" (UniqueName: \"kubernetes.io/projected/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-kube-api-access-s6xd5\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-var-lib-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378121 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysconfig\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-kubernetes\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-node-log\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-systemd\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b78d033-4ff4-4d8f-ab01-142182b25978-agent-certs\") pod \"konnectivity-agent-6kj6p\" (UID: \"7b78d033-4ff4-4d8f-ab01-142182b25978\") " pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-cni-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-kubelet\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysctl-d\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.377955    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-registration-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-os-release\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/226b472b-157a-4255-a78f-fb54a744210b-cni-binary-copy\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378112    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378142    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-var-lib-openvswitch\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-cni-multus\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e5320c-a7cb-4073-bd12-6e92795c2ad4-serviceca\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-var-lib-kubelet\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.378948 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378278    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.379706 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8624d9fd-e95e-42ae-aa7d-722f62e77848-host-slash\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.379706 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.378338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovnkube-script-lib\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.381227 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.381200    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8624d9fd-e95e-42ae-aa7d-722f62e77848-ovn-node-metrics-cert\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.383474 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.381343    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b78d033-4ff4-4d8f-ab01-142182b25978-agent-certs\") pod \"konnectivity-agent-6kj6p\" (UID: \"7b78d033-4ff4-4d8f-ab01-142182b25978\") " pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.387237 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.387215    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:11.387348 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.387244    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:11.387348 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.387259    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qptrx for pod openshift-network-diagnostics/network-check-target-hzpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:11.387348 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.387319    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx podName:59378e17-885b-4541-8673-09f33a53fe92 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:11.887300501 +0000 UTC m=+3.040985025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qptrx" (UniqueName: "kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx") pod "network-check-target-hzpw7" (UID: "59378e17-885b-4541-8673-09f33a53fe92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:11.390607 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.390577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blk67\" (UniqueName: \"kubernetes.io/projected/8624d9fd-e95e-42ae-aa7d-722f62e77848-kube-api-access-blk67\") pod \"ovnkube-node-rrgq2\" (UID: \"8624d9fd-e95e-42ae-aa7d-722f62e77848\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.390833 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.390811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbtwf\" (UniqueName: \"kubernetes.io/projected/fb68a911-5d71-416a-a67d-416edcf36221-kube-api-access-dbtwf\") pod \"iptables-alerter-5nrcm\" (UID: \"fb68a911-5d71-416a-a67d-416edcf36221\") " pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.391127 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.391102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58w64\" (UniqueName: \"kubernetes.io/projected/70e5320c-a7cb-4073-bd12-6e92795c2ad4-kube-api-access-58w64\") pod \"node-ca-m7pjv\" (UID: \"70e5320c-a7cb-4073-bd12-6e92795c2ad4\") " pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.479360 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq9r6\" (UniqueName: \"kubernetes.io/projected/6aef2b0f-7b22-40a1-894a-74f378656ccc-kube-api-access-sq9r6\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.479360 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-socket-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-cni-bin\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-multus-certs\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-host\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-k8s-cni-cncf-io\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/506d4161-8e19-493a-838a-6b24e784d698-etc-tuned\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-sys-fs\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.479646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fxjq\" (UniqueName: \"kubernetes.io/projected/0835eda6-8a53-429b-b2b5-d7f214f709d0-kube-api-access-5fxjq\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-conf-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqvv\" (UniqueName: \"kubernetes.io/projected/506d4161-8e19-493a-838a-6b24e784d698-kube-api-access-5qqvv\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-socket-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6xd5\" (UniqueName: \"kubernetes.io/projected/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-kube-api-access-s6xd5\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysconfig\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-multus-certs\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-kubernetes\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-host\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479841    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-cni-bin\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479867    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-k8s-cni-cncf-io\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-systemd\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-cni-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-sys-fs\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-kubelet\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.479984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysctl-d\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480000    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-kubernetes\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.480152 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-registration-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-os-release\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/226b472b-157a-4255-a78f-fb54a744210b-cni-binary-copy\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-conf-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-cni-multus\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-var-lib-kubelet\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6aef2b0f-7b22-40a1-894a-74f378656ccc-tmp-dir\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-modprobe-d\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-system-cni-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-socket-dir-parent\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-os-release\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480322    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-cni-multus\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-system-cni-dir\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-cni-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-modprobe-d\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-registration-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-multus-socket-dir-parent\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480429    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-systemd\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480467    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6aef2b0f-7b22-40a1-894a-74f378656ccc-hosts-file\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480474    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-system-cni-dir\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-hostroot\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysconfig\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-var-lib-kubelet\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480541    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-system-cni-dir\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-var-lib-kubelet\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-etc-kubernetes\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lz2g\" (UniqueName: \"kubernetes.io/projected/226b472b-157a-4255-a78f-fb54a744210b-kube-api-access-8lz2g\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysctl-d\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.481920 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.480599    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysctl-conf\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6aef2b0f-7b22-40a1-894a-74f378656ccc-hosts-file\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-device-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480767    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-etc-kubernetes\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nml2\" (UniqueName: \"kubernetes.io/projected/b5b26cf8-2145-4615-891c-9cbb229a8c5e-kube-api-access-8nml2\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480802    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-hostroot\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480815    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/506d4161-8e19-493a-838a-6b24e784d698-tmp\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-etc-sysctl-conf\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.480984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-cnibin\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481002    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/226b472b-157a-4255-a78f-fb54a744210b-cni-binary-copy\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-os-release\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481043    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/226b472b-157a-4255-a78f-fb54a744210b-multus-daemon-config\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-sys\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-sys\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-run\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-lib-modules\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.482883 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-cnibin\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-netns\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-run\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481288    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6aef2b0f-7b22-40a1-894a-74f378656ccc-tmp-dir\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481337    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/506d4161-8e19-493a-838a-6b24e784d698-lib-modules\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-host-run-netns\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0835eda6-8a53-429b-b2b5-d7f214f709d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481407    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/226b472b-157a-4255-a78f-fb54a744210b-cnibin\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481409    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-device-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481459    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-cnibin\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.481514    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs podName:b5b26cf8-2145-4615-891c-9cbb229a8c5e nodeName:}" failed. No retries permitted until 2026-07-15 20:59:11.981495556 +0000 UTC m=+3.135180069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs") pod "network-metrics-daemon-sr5wf" (UID: "b5b26cf8-2145-4615-891c-9cbb229a8c5e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/226b472b-157a-4255-a78f-fb54a744210b-multus-daemon-config\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.481527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0835eda6-8a53-429b-b2b5-d7f214f709d0-os-release\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.482957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/506d4161-8e19-493a-838a-6b24e784d698-etc-tuned\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.483829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.483272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/506d4161-8e19-493a-838a-6b24e784d698-tmp\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.490592 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.490499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqvv\" (UniqueName: \"kubernetes.io/projected/506d4161-8e19-493a-838a-6b24e784d698-kube-api-access-5qqvv\") pod \"tuned-wl5pg\" (UID: \"506d4161-8e19-493a-838a-6b24e784d698\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.490843 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.490817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq9r6\" (UniqueName: \"kubernetes.io/projected/6aef2b0f-7b22-40a1-894a-74f378656ccc-kube-api-access-sq9r6\") pod \"node-resolver-kb88p\" (UID: \"6aef2b0f-7b22-40a1-894a-74f378656ccc\") " pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.491567 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.491484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lz2g\" (UniqueName: \"kubernetes.io/projected/226b472b-157a-4255-a78f-fb54a744210b-kube-api-access-8lz2g\") pod \"multus-qdg94\" (UID: \"226b472b-157a-4255-a78f-fb54a744210b\") " pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.492204 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.492181    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6xd5\" (UniqueName: \"kubernetes.io/projected/f6d449de-d15a-4eee-a455-ffc5bfbfd5a5-kube-api-access-s6xd5\") pod \"aws-ebs-csi-driver-node-zqvvr\" (UID: \"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.493081 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.492990    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fxjq\" (UniqueName: \"kubernetes.io/projected/0835eda6-8a53-429b-b2b5-d7f214f709d0-kube-api-access-5fxjq\") pod \"multus-additional-cni-plugins-pxfgz\" (UID: \"0835eda6-8a53-429b-b2b5-d7f214f709d0\") " pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.495115 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.495090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nml2\" (UniqueName: \"kubernetes.io/projected/b5b26cf8-2145-4615-891c-9cbb229a8c5e-kube-api-access-8nml2\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:11.511518 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.511495    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:11.567744 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.567710    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:11.572310 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.572263    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal" event={"ID":"00eb5a080a0134a434dc03cd5b8be74b","Type":"ContainerStarted","Data":"1fe72a2ea9c2cadb82067cc59856bacbc963f3d39d1b0d913b24ae1aa30b6a2c"}
Jul 15 20:59:11.573465 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.573439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal" event={"ID":"6d32d2a62d93ad28d5bbab2b530e2df6","Type":"ContainerStarted","Data":"f73b06ff083c18d212519fa4e358f0aa90e0c9529afb9fc8bfaa8846531ae0b4"}
Jul 15 20:59:11.576743 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.576725    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7pjv"
Jul 15 20:59:11.586789 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.586762    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5nrcm"
Jul 15 20:59:11.595475 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.595458    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:11.603201 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.603180    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr"
Jul 15 20:59:11.610905 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.610883    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxfgz"
Jul 15 20:59:11.619538 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.619521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kb88p"
Jul 15 20:59:11.627231 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.627210    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qdg94"
Jul 15 20:59:11.634035 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.634015    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl5pg"
Jul 15 20:59:11.884744 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.884702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:11.884915 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.884880    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:11.884981 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.884952    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret podName:ebcc66aa-2faa-47f4-b31c-d270d90abacc nodeName:}" failed. No retries permitted until 2026-07-15 20:59:12.884934155 +0000 UTC m=+4.038618657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret") pod "global-pull-secret-syncer-sthd8" (UID: "ebcc66aa-2faa-47f4-b31c-d270d90abacc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:11.985997 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.985956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:11.986192 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:11.986022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:11.986192 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.986147    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:11.986192 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.986150    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:11.986192 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.986180    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:11.986192 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.986196    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qptrx for pod openshift-network-diagnostics/network-check-target-hzpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:11.986450 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.986217    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs podName:b5b26cf8-2145-4615-891c-9cbb229a8c5e nodeName:}" failed. No retries permitted until 2026-07-15 20:59:12.986197141 +0000 UTC m=+4.139881643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs") pod "network-metrics-daemon-sr5wf" (UID: "b5b26cf8-2145-4615-891c-9cbb229a8c5e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:11.986450 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:11.986249    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx podName:59378e17-885b-4541-8673-09f33a53fe92 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:12.986235201 +0000 UTC m=+4.139919726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qptrx" (UniqueName: "kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx") pod "network-check-target-hzpw7" (UID: "59378e17-885b-4541-8673-09f33a53fe92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:12.323397 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.323276    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:54:11 +0000 UTC" deadline="2028-04-05 22:21:45.479250468 +0000 UTC"
Jul 15 20:59:12.323397 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.323344    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15121h22m33.155910018s"
Jul 15 20:59:12.506509 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.506479    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e5320c_a7cb_4073_bd12_6e92795c2ad4.slice/crio-713155da7cef8fde74158d15063687f41b6303b978f7ea0da6a1756a44cd6054 WatchSource:0}: Error finding container 713155da7cef8fde74158d15063687f41b6303b978f7ea0da6a1756a44cd6054: Status 404 returned error can't find the container with id 713155da7cef8fde74158d15063687f41b6303b978f7ea0da6a1756a44cd6054
Jul 15 20:59:12.508102 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.508075    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226b472b_157a_4255_a78f_fb54a744210b.slice/crio-56cee4227919ab2f9ed35c344a1add3bc20c4bd1062f115104eb3c38096b42cd WatchSource:0}: Error finding container 56cee4227919ab2f9ed35c344a1add3bc20c4bd1062f115104eb3c38096b42cd: Status 404 returned error can't find the container with id 56cee4227919ab2f9ed35c344a1add3bc20c4bd1062f115104eb3c38096b42cd
Jul 15 20:59:12.508816 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.508789    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d449de_d15a_4eee_a455_ffc5bfbfd5a5.slice/crio-07c1f95fece41196659c3ee3f4cb92e3839f56a541c8b7558a38cc1cc9d29ff9 WatchSource:0}: Error finding container 07c1f95fece41196659c3ee3f4cb92e3839f56a541c8b7558a38cc1cc9d29ff9: Status 404 returned error can't find the container with id 07c1f95fece41196659c3ee3f4cb92e3839f56a541c8b7558a38cc1cc9d29ff9
Jul 15 20:59:12.514036 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.513484    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0835eda6_8a53_429b_b2b5_d7f214f709d0.slice/crio-54fb94f9704723645828c4a0c2bac4eacba2bb6b67043250baa812ee6001b6fc WatchSource:0}: Error finding container 54fb94f9704723645828c4a0c2bac4eacba2bb6b67043250baa812ee6001b6fc: Status 404 returned error can't find the container with id 54fb94f9704723645828c4a0c2bac4eacba2bb6b67043250baa812ee6001b6fc
Jul 15 20:59:12.514138 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.514077    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aef2b0f_7b22_40a1_894a_74f378656ccc.slice/crio-6ad0a02bebe7f6159e56a07dcee2605dbaed0e552755980c159dd4c1ef031014 WatchSource:0}: Error finding container 6ad0a02bebe7f6159e56a07dcee2605dbaed0e552755980c159dd4c1ef031014: Status 404 returned error can't find the container with id 6ad0a02bebe7f6159e56a07dcee2605dbaed0e552755980c159dd4c1ef031014
Jul 15 20:59:12.516055 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.516015    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506d4161_8e19_493a_838a_6b24e784d698.slice/crio-b26b21a49b2f4231add026c6eb32c9a0e2251b424417078aaf558ec8bf839530 WatchSource:0}: Error finding container b26b21a49b2f4231add026c6eb32c9a0e2251b424417078aaf558ec8bf839530: Status 404 returned error can't find the container with id b26b21a49b2f4231add026c6eb32c9a0e2251b424417078aaf558ec8bf839530
Jul 15 20:59:12.518294 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.518120    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b78d033_4ff4_4d8f_ab01_142182b25978.slice/crio-4d3ec53cc86549da461d1d232269689a5685c1817bc2160b88e60924b1db9a40 WatchSource:0}: Error finding container 4d3ec53cc86549da461d1d232269689a5685c1817bc2160b88e60924b1db9a40: Status 404 returned error can't find the container with id 4d3ec53cc86549da461d1d232269689a5685c1817bc2160b88e60924b1db9a40
Jul 15 20:59:12.519111 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.518756    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8624d9fd_e95e_42ae_aa7d_722f62e77848.slice/crio-4bd639a1d4bc1cad80743a56c57fe8e78d2c491688be25c449091f90d1ab2545 WatchSource:0}: Error finding container 4bd639a1d4bc1cad80743a56c57fe8e78d2c491688be25c449091f90d1ab2545: Status 404 returned error can't find the container with id 4bd639a1d4bc1cad80743a56c57fe8e78d2c491688be25c449091f90d1ab2545
Jul 15 20:59:12.519940 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:12.519919    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb68a911_5d71_416a_a67d_416edcf36221.slice/crio-ba0ebb2a9ad1582f3ffba5b53f73eefc44855d9206b70fbd99bc4f2a55d24ba8 WatchSource:0}: Error finding container ba0ebb2a9ad1582f3ffba5b53f73eefc44855d9206b70fbd99bc4f2a55d24ba8: Status 404 returned error can't find the container with id ba0ebb2a9ad1582f3ffba5b53f73eefc44855d9206b70fbd99bc4f2a55d24ba8
Jul 15 20:59:12.569208 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.569034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:12.569313 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.569033    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:12.569313 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.569302    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:12.569431 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.569057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:12.569481 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.569439    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:12.569561 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.569536    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:12.576784 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.576758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"4bd639a1d4bc1cad80743a56c57fe8e78d2c491688be25c449091f90d1ab2545"}
Jul 15 20:59:12.579029 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.579000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl5pg" event={"ID":"506d4161-8e19-493a-838a-6b24e784d698","Type":"ContainerStarted","Data":"b26b21a49b2f4231add026c6eb32c9a0e2251b424417078aaf558ec8bf839530"}
Jul 15 20:59:12.581413 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.581391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerStarted","Data":"54fb94f9704723645828c4a0c2bac4eacba2bb6b67043250baa812ee6001b6fc"}
Jul 15 20:59:12.582963 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.582937    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr" event={"ID":"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5","Type":"ContainerStarted","Data":"07c1f95fece41196659c3ee3f4cb92e3839f56a541c8b7558a38cc1cc9d29ff9"}
Jul 15 20:59:12.584361 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.584337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7pjv" event={"ID":"70e5320c-a7cb-4073-bd12-6e92795c2ad4","Type":"ContainerStarted","Data":"713155da7cef8fde74158d15063687f41b6303b978f7ea0da6a1756a44cd6054"}
Jul 15 20:59:12.585671 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.585630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5nrcm" event={"ID":"fb68a911-5d71-416a-a67d-416edcf36221","Type":"ContainerStarted","Data":"ba0ebb2a9ad1582f3ffba5b53f73eefc44855d9206b70fbd99bc4f2a55d24ba8"}
Jul 15 20:59:12.586831 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.586804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kj6p" event={"ID":"7b78d033-4ff4-4d8f-ab01-142182b25978","Type":"ContainerStarted","Data":"4d3ec53cc86549da461d1d232269689a5685c1817bc2160b88e60924b1db9a40"}
Jul 15 20:59:12.588268 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.588241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kb88p" event={"ID":"6aef2b0f-7b22-40a1-894a-74f378656ccc","Type":"ContainerStarted","Data":"6ad0a02bebe7f6159e56a07dcee2605dbaed0e552755980c159dd4c1ef031014"}
Jul 15 20:59:12.589537 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.589517    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qdg94" event={"ID":"226b472b-157a-4255-a78f-fb54a744210b","Type":"ContainerStarted","Data":"56cee4227919ab2f9ed35c344a1add3bc20c4bd1062f115104eb3c38096b42cd"}
Jul 15 20:59:12.893837 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.893801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:12.894026 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.893992    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:12.894092 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.894077    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret podName:ebcc66aa-2faa-47f4-b31c-d270d90abacc nodeName:}" failed. No retries permitted until 2026-07-15 20:59:14.894055745 +0000 UTC m=+6.047740254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret") pod "global-pull-secret-syncer-sthd8" (UID: "ebcc66aa-2faa-47f4-b31c-d270d90abacc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:12.995031 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.994999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:12.995194 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:12.995057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:12.995194 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.995182    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:12.995319 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.995200    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:12.995319 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.995211    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qptrx for pod openshift-network-diagnostics/network-check-target-hzpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:12.995319 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.995254    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx podName:59378e17-885b-4541-8673-09f33a53fe92 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:14.995241183 +0000 UTC m=+6.148925683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qptrx" (UniqueName: "kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx") pod "network-check-target-hzpw7" (UID: "59378e17-885b-4541-8673-09f33a53fe92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:12.995319 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.995305    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:12.995518 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:12.995326    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs podName:b5b26cf8-2145-4615-891c-9cbb229a8c5e nodeName:}" failed. No retries permitted until 2026-07-15 20:59:14.995319595 +0000 UTC m=+6.149004095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs") pod "network-metrics-daemon-sr5wf" (UID: "b5b26cf8-2145-4615-891c-9cbb229a8c5e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:13.324459 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:13.324361    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:54:11 +0000 UTC" deadline="2028-04-11 01:30:52.60298452 +0000 UTC"
Jul 15 20:59:13.324459 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:13.324405    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15244h31m39.278584259s"
Jul 15 20:59:13.619648 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:13.619611    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d32d2a62d93ad28d5bbab2b530e2df6" containerID="3c9bbef78dd554e29a4b71e612c7d5ba8614589f62227282616fa385d41703fe" exitCode=0
Jul 15 20:59:13.619832 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:13.619686    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal" event={"ID":"6d32d2a62d93ad28d5bbab2b530e2df6","Type":"ContainerDied","Data":"3c9bbef78dd554e29a4b71e612c7d5ba8614589f62227282616fa385d41703fe"}
Jul 15 20:59:13.644096 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:13.644064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal" event={"ID":"00eb5a080a0134a434dc03cd5b8be74b","Type":"ContainerStarted","Data":"268183cf1950e7d884ef29ee23f1d9166a53f29449164e7f105ea830ba560917"}
Jul 15 20:59:14.568965 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:14.568935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:14.569422 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:14.569073    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:14.569422 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:14.569156    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:14.569422 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:14.569228    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:14.569422 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:14.569287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:14.569422 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:14.569347    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:14.675994 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:14.675948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal" event={"ID":"6d32d2a62d93ad28d5bbab2b530e2df6","Type":"ContainerStarted","Data":"70bb03025ea22e0bbdfd4fd32003a3dc0bf860a2a8f3f5ca04a75b546d9acf0c"}
Jul 15 20:59:14.718452 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:14.718393    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-15.ec2.internal" podStartSLOduration=4.718375019 podStartE2EDuration="4.718375019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:14.718055135 +0000 UTC m=+5.871739658" watchObservedRunningTime="2026-07-15 20:59:14.718375019 +0000 UTC m=+5.872059543"
Jul 15 20:59:14.719146 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:14.719108    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-15.ec2.internal" podStartSLOduration=4.719092773 podStartE2EDuration="4.719092773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:13.669823851 +0000 UTC m=+4.823508374" watchObservedRunningTime="2026-07-15 20:59:14.719092773 +0000 UTC m=+5.872777297"
Jul 15 20:59:14.921318 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:14.921271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:14.921638 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:14.921465    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:14.921638 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:14.921533    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret podName:ebcc66aa-2faa-47f4-b31c-d270d90abacc nodeName:}" failed. No retries permitted until 2026-07-15 20:59:18.921510824 +0000 UTC m=+10.075195334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret") pod "global-pull-secret-syncer-sthd8" (UID: "ebcc66aa-2faa-47f4-b31c-d270d90abacc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:15.022659 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:15.022616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:15.022846 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:15.022700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:15.022922 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:15.022862    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:15.022973 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:15.022928    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs podName:b5b26cf8-2145-4615-891c-9cbb229a8c5e nodeName:}" failed. No retries permitted until 2026-07-15 20:59:19.022908136 +0000 UTC m=+10.176592639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs") pod "network-metrics-daemon-sr5wf" (UID: "b5b26cf8-2145-4615-891c-9cbb229a8c5e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:15.023365 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:15.023340    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:15.023453 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:15.023373    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:15.023453 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:15.023386    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qptrx for pod openshift-network-diagnostics/network-check-target-hzpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:15.023453 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:15.023437    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx podName:59378e17-885b-4541-8673-09f33a53fe92 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:19.023420518 +0000 UTC m=+10.177105035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qptrx" (UniqueName: "kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx") pod "network-check-target-hzpw7" (UID: "59378e17-885b-4541-8673-09f33a53fe92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:16.568353 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:16.568317    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:16.568920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:16.568330    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:16.568920 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:16.568458    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:16.568920 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:16.568520    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:16.568920 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:16.568330    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:16.568920 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:16.568641    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:18.568337 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:18.568301    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:18.568337 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:18.568323    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:18.568860 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:18.568445    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:18.568860 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:18.568497    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:18.568860 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:18.568625    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:18.568860 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:18.568725    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:18.958147 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:18.958109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:18.958332 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:18.958286    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:18.958393 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:18.958350    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret podName:ebcc66aa-2faa-47f4-b31c-d270d90abacc nodeName:}" failed. No retries permitted until 2026-07-15 20:59:26.958330897 +0000 UTC m=+18.112015414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret") pod "global-pull-secret-syncer-sthd8" (UID: "ebcc66aa-2faa-47f4-b31c-d270d90abacc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:19.058761 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:19.058720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:19.058934 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:19.058810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:19.059026 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:19.058952    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:19.059026 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:19.058970    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:19.059026 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:19.058984    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qptrx for pod openshift-network-diagnostics/network-check-target-hzpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:19.059026 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:19.059000    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:19.059221 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:19.059083    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx podName:59378e17-885b-4541-8673-09f33a53fe92 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:27.059029993 +0000 UTC m=+18.212714505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qptrx" (UniqueName: "kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx") pod "network-check-target-hzpw7" (UID: "59378e17-885b-4541-8673-09f33a53fe92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:19.059221 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:19.059105    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs podName:b5b26cf8-2145-4615-891c-9cbb229a8c5e nodeName:}" failed. No retries permitted until 2026-07-15 20:59:27.059094472 +0000 UTC m=+18.212778977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs") pod "network-metrics-daemon-sr5wf" (UID: "b5b26cf8-2145-4615-891c-9cbb229a8c5e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:20.568669 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:20.568584    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:20.568669 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:20.568624    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:20.569207 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:20.568712    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:20.569207 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:20.568584    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:20.569316 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:20.569211    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:20.569316 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:20.569299    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:22.568932 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:22.568895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:22.569337 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:22.568895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:22.569337 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:22.569021    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:22.569337 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:22.569074    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:22.569337 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:22.568904    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:22.569337 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:22.569159    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:24.569025 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:24.568983    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:24.569459 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:24.569000    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:24.569459 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:24.569151    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:24.569459 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:24.569193    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:24.569459 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:24.569328    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:24.569459 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:24.569426    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:26.569001 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:26.568968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:26.569001 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:26.569000    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:26.569465 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:26.569080    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:26.569465 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:26.569137    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:26.569465 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:26.569234    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:26.569465 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:26.569322    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:27.024099 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:27.024058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:27.024295 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.024207    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:27.024295 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.024277    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret podName:ebcc66aa-2faa-47f4-b31c-d270d90abacc nodeName:}" failed. No retries permitted until 2026-07-15 20:59:43.024258918 +0000 UTC m=+34.177943420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret") pod "global-pull-secret-syncer-sthd8" (UID: "ebcc66aa-2faa-47f4-b31c-d270d90abacc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:27.125051 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:27.125016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:27.125221 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:27.125077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:27.125221 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.125189    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:27.125221 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.125204    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:27.125353 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.125233    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:27.125353 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.125248    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qptrx for pod openshift-network-diagnostics/network-check-target-hzpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:27.125353 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.125256    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs podName:b5b26cf8-2145-4615-891c-9cbb229a8c5e nodeName:}" failed. No retries permitted until 2026-07-15 20:59:43.125237642 +0000 UTC m=+34.278922142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs") pod "network-metrics-daemon-sr5wf" (UID: "b5b26cf8-2145-4615-891c-9cbb229a8c5e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:27.125353 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:27.125297    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx podName:59378e17-885b-4541-8673-09f33a53fe92 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:43.125283677 +0000 UTC m=+34.278968177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qptrx" (UniqueName: "kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx") pod "network-check-target-hzpw7" (UID: "59378e17-885b-4541-8673-09f33a53fe92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:28.569276 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:28.569235    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:28.569276 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:28.569249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:28.569822 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:28.569230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:28.569822 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:28.569359    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:28.569822 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:28.569447    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:28.569822 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:28.569520    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:30.568947 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:30.568903    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:30.568947 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:30.568932    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:30.568947 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:30.568949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:30.569529 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:30.569047    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:30.569529 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:30.569125    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:30.569529 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:30.569195    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:31.712714 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.712391    2573 generic.go:356] "Generic (PLEG): container finished" podID="0835eda6-8a53-429b-b2b5-d7f214f709d0" containerID="ee8da558890c4095792a8f9ed4750f9e4e06f972f804be270f3d20622fb345a6" exitCode=0
Jul 15 20:59:31.712714 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.712475    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerDied","Data":"ee8da558890c4095792a8f9ed4750f9e4e06f972f804be270f3d20622fb345a6"}
Jul 15 20:59:31.714286 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.714262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr" event={"ID":"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5","Type":"ContainerStarted","Data":"e4d06041ffa60f2e5842cbc550d78a532c407155c1333214e72f666d63aada7a"}
Jul 15 20:59:31.715794 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.715767    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7pjv" event={"ID":"70e5320c-a7cb-4073-bd12-6e92795c2ad4","Type":"ContainerStarted","Data":"d0560d28b8cd9d8b735fe1e075ef38e8d7295b8eb643a8fe4f015b95494830ea"}
Jul 15 20:59:31.717337 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.717308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kj6p" event={"ID":"7b78d033-4ff4-4d8f-ab01-142182b25978","Type":"ContainerStarted","Data":"40a9967326215600d3866b28a0bbf9824dfa457fce2f2bad4c305c04763c654a"}
Jul 15 20:59:31.718938 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.718917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kb88p" event={"ID":"6aef2b0f-7b22-40a1-894a-74f378656ccc","Type":"ContainerStarted","Data":"c7a3d346ec98dbc43da335d7bca967302a39723aea4a5224d6a8b2c477eb6cfb"}
Jul 15 20:59:31.720592 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.720531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qdg94" event={"ID":"226b472b-157a-4255-a78f-fb54a744210b","Type":"ContainerStarted","Data":"b535199e4e04006e5539cb5fcb8e8fcde7a7e1df1d91145a8c72f24f186666fc"}
Jul 15 20:59:31.722003 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.721985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl5pg" event={"ID":"506d4161-8e19-493a-838a-6b24e784d698","Type":"ContainerStarted","Data":"ccc836470434eac266525dc6502a53e6459bc1421408590d534a27ac6df62b58"}
Jul 15 20:59:31.758718 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.758663    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6kj6p" podStartSLOduration=8.535336873 podStartE2EDuration="22.758648609s" totalImagesPullingTime="14.223311736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:31.758065428 +0000 UTC m=+22.911749950" watchObservedRunningTime="2026-07-15 20:59:31.758648609 +0000 UTC m=+22.912333132"
Jul 15 20:59:31.793400 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.793254    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m7pjv" podStartSLOduration=4.005044678 podStartE2EDuration="22.793234099s" totalImagesPullingTime="18.788189421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:31.774705451 +0000 UTC m=+22.928389974" watchObservedRunningTime="2026-07-15 20:59:31.793234099 +0000 UTC m=+22.946918624"
Jul 15 20:59:31.793501 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.793480    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qdg94" podStartSLOduration=3.987683535 podStartE2EDuration="22.793473944s" totalImagesPullingTime="18.805790409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:31.793139455 +0000 UTC m=+22.946823977" watchObservedRunningTime="2026-07-15 20:59:31.793473944 +0000 UTC m=+22.947158467"
Jul 15 20:59:31.809256 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.809210    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wl5pg" podStartSLOduration=4.029267197 podStartE2EDuration="22.80919411s" totalImagesPullingTime="18.779926913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:31.809125908 +0000 UTC m=+22.962810430" watchObservedRunningTime="2026-07-15 20:59:31.80919411 +0000 UTC m=+22.962878632"
Jul 15 20:59:31.824859 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:31.824812    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kb88p" podStartSLOduration=4.04248853 podStartE2EDuration="22.824795237s" totalImagesPullingTime="18.782306707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:31.824154471 +0000 UTC m=+22.977839007" watchObservedRunningTime="2026-07-15 20:59:31.824795237 +0000 UTC m=+22.978479759"
Jul 15 20:59:32.568513 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.568284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:32.568678 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:32.568635    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:32.568678 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.568330    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:32.568797 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:32.568731    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:32.568797 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.568289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:32.568897 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:32.568820    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:32.727426 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.727397    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 20:59:32.728079 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.727813    2573 generic.go:356] "Generic (PLEG): container finished" podID="8624d9fd-e95e-42ae-aa7d-722f62e77848" containerID="8364e39cf9ed8818767010151eb67de1532a2a240bc16857be3a422f6471e135" exitCode=1
Jul 15 20:59:32.728079 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.727944    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"82a1cc2bea1499f33b707e4eba3648f8aebfe620b5c496f8f0963153c5df98b7"}
Jul 15 20:59:32.728079 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.728050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"6a6459eaee55923809f24a6ad5c965b01ff3032d9a037d98f356940fdab43597"}
Jul 15 20:59:32.728208 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.728137    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerDied","Data":"8364e39cf9ed8818767010151eb67de1532a2a240bc16857be3a422f6471e135"}
Jul 15 20:59:32.728208 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:32.728189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"7a5db947fedabe59191eac59141c4e72a0fbd1e0258d4ebf640ed5bc04117cad"}
Jul 15 20:59:33.025166 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.025094    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 20:59:33.341929 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.341817    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T20:59:33.025120093Z","UUID":"787f71e4-9b4c-4915-b4a1-b3bd58c1459d","Handler":null,"Name":"","Endpoint":""}
Jul 15 20:59:33.343686 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.343659    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 20:59:33.343813 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.343704    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 20:59:33.732617 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.732302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5nrcm" event={"ID":"fb68a911-5d71-416a-a67d-416edcf36221","Type":"ContainerStarted","Data":"20b7b278466ec044b83af4fc0542112068e4a0f078675642bcbb4418a8cf63d7"}
Jul 15 20:59:33.736017 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.735987    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 20:59:33.736475 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.736444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"96db85806f836b9b17ebb67ec28af9adb2e4ac2496c49ed39d708461ea5eea8c"}
Jul 15 20:59:33.736631 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.736562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"0776398bd781369d63eb018d9e718cebf9980c5a9f40b7089a72baf93b9d07f6"}
Jul 15 20:59:33.738482 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.738459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr" event={"ID":"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5","Type":"ContainerStarted","Data":"744dd85d3cf1d720c06cb13cc0419438541f05eabfc65852e1c3cd002edf627b"}
Jul 15 20:59:33.763998 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:33.763942    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5nrcm" podStartSLOduration=10.543078593 podStartE2EDuration="24.763914622s" totalImagesPullingTime="14.220836029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:33.76332768 +0000 UTC m=+24.917012246" watchObservedRunningTime="2026-07-15 20:59:33.763914622 +0000 UTC m=+24.917599151"
Jul 15 20:59:34.568876 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:34.568832    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:34.568876 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:34.568888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:34.569110 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:34.568888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:34.569110 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:34.568961    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:34.569110 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:34.569072    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:34.569231 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:34.569128    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:34.743605 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:34.743567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr" event={"ID":"f6d449de-d15a-4eee-a455-ffc5bfbfd5a5","Type":"ContainerStarted","Data":"58ea9e3d478708d5e4b05aada7eebe01765b7dadfe6d946d371848750cf0a7ea"}
Jul 15 20:59:34.745232 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:34.745207    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:34.745790 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:34.745772    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:34.793527 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:34.793466    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqvvr" podStartSLOduration=4.666581499 podStartE2EDuration="25.793448188s" totalImagesPullingTime="21.126866689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:34.767924906 +0000 UTC m=+25.921609432" watchObservedRunningTime="2026-07-15 20:59:34.793448188 +0000 UTC m=+25.947132710"
Jul 15 20:59:35.746880 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:35.746850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:35.747568 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:35.747337    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6kj6p"
Jul 15 20:59:36.568829 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:36.568793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:36.569049 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:36.568906    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:36.569049 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:36.568919    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:36.569049 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:36.568994    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:36.569049 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:36.569034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:36.569179 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:36.569112    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:36.751043 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:36.751007    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 20:59:36.751761 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:36.751421    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"34bedd6d94a333de59a380a0f82930168e9704b463b85305e8020e6d2f87aaa1"}
Jul 15 20:59:36.753134 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:36.753110    2573 generic.go:356] "Generic (PLEG): container finished" podID="0835eda6-8a53-429b-b2b5-d7f214f709d0" containerID="db73bc3a3179af523b5417104983a7ad3c11e5584522bfc3e49ac36afc286ef9" exitCode=0
Jul 15 20:59:36.753231 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:36.753192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerDied","Data":"db73bc3a3179af523b5417104983a7ad3c11e5584522bfc3e49ac36afc286ef9"}
Jul 15 20:59:37.756874 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:37.756793    2573 generic.go:356] "Generic (PLEG): container finished" podID="0835eda6-8a53-429b-b2b5-d7f214f709d0" containerID="1b7f0e8dfa3f5944e5ad87b49ed2a4b5e6b60cff309c3cd8cd81ed3201e5fe90" exitCode=0
Jul 15 20:59:37.757253 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:37.756881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerDied","Data":"1b7f0e8dfa3f5944e5ad87b49ed2a4b5e6b60cff309c3cd8cd81ed3201e5fe90"}
Jul 15 20:59:38.569189 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.569002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:38.569386 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.569043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:38.569386 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:38.569360    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:38.569386 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:38.569260    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:38.569658 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.569051    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:38.569658 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:38.569478    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:38.762843 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.762817    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 20:59:38.763275 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.763148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"63d180997033a560ee16f23ee861e3b3ce9e46d5225bdb0339b177765ac70496"}
Jul 15 20:59:38.763384 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.763369    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:38.763441 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.763430    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:38.763658 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.763639    2573 scope.go:117] "RemoveContainer" containerID="8364e39cf9ed8818767010151eb67de1532a2a240bc16857be3a422f6471e135"
Jul 15 20:59:38.779216 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.779196    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:38.779310 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:38.779299    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:39.769381 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:39.769354    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 20:59:39.769831 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:39.769734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" event={"ID":"8624d9fd-e95e-42ae-aa7d-722f62e77848","Type":"ContainerStarted","Data":"bc9fd326ae381e135acf4813d84d5d75c146a6ae33902d015984b5270cff769d"}
Jul 15 20:59:39.769831 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:39.769777    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 20:59:39.771933 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:39.771907    2573 generic.go:356] "Generic (PLEG): container finished" podID="0835eda6-8a53-429b-b2b5-d7f214f709d0" containerID="4bf46caee47bfdf1d37f1e56e86e9a9ac68c883dec58399bb3e58cb48b7a10a4" exitCode=0
Jul 15 20:59:39.772034 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:39.771957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerDied","Data":"4bf46caee47bfdf1d37f1e56e86e9a9ac68c883dec58399bb3e58cb48b7a10a4"}
Jul 15 20:59:39.802095 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:39.802046    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2" podStartSLOduration=11.406216743 podStartE2EDuration="30.802026953s" totalImagesPullingTime="19.39581021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:39.800849284 +0000 UTC m=+30.954533806" watchObservedRunningTime="2026-07-15 20:59:39.802026953 +0000 UTC m=+30.955711479"
Jul 15 20:59:40.569271 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.569069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:40.569430 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.569104    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:40.569430 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:40.569369    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:40.569570 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:40.569448    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:40.569570 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.569104    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:40.569570 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:40.569539    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:40.775094 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.775063    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 20:59:40.858474 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.858440    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sthd8"]
Jul 15 20:59:40.858715 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.858586    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:40.858781 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:40.858707    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:40.862192 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.862169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzpw7"]
Jul 15 20:59:40.862359 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.862259    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:40.862359 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:40.862348    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:40.863038 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.862995    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sr5wf"]
Jul 15 20:59:40.863153 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:40.863090    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:40.863211 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:40.863168    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:41.015469 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:41.015427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 20:59:42.568537 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:42.568447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:42.568537 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:42.568489    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:42.568537 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:42.568500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:42.569136 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:42.568590    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:42.569136 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:42.568653    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:42.569136 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:42.568746    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:43.047476 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:43.047435    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:43.047698 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.047584    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:43.047698 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.047647    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret podName:ebcc66aa-2faa-47f4-b31c-d270d90abacc nodeName:}" failed. No retries permitted until 2026-07-15 21:00:15.047627917 +0000 UTC m=+66.201312421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret") pod "global-pull-secret-syncer-sthd8" (UID: "ebcc66aa-2faa-47f4-b31c-d270d90abacc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:43.148285 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:43.148194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:43.148285 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:43.148265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:43.148521 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.148375    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:43.148521 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.148404    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:43.148521 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.148384    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:43.148521 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.148414    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qptrx for pod openshift-network-diagnostics/network-check-target-hzpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:43.148521 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.148470    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs podName:b5b26cf8-2145-4615-891c-9cbb229a8c5e nodeName:}" failed. No retries permitted until 2026-07-15 21:00:15.148450091 +0000 UTC m=+66.302134610 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs") pod "network-metrics-daemon-sr5wf" (UID: "b5b26cf8-2145-4615-891c-9cbb229a8c5e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:43.148521 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:43.148490    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx podName:59378e17-885b-4541-8673-09f33a53fe92 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:15.148480782 +0000 UTC m=+66.302165299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qptrx" (UniqueName: "kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx") pod "network-check-target-hzpw7" (UID: "59378e17-885b-4541-8673-09f33a53fe92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:43.261371 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:43.261288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:43.358394 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:43.358359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:44.568949 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:44.568917    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:44.569328 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:44.569010    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:44.569328 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:44.569015    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:44.569328 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:44.569093    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpw7" podUID="59378e17-885b-4541-8673-09f33a53fe92"
Jul 15 20:59:44.569328 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:44.569155    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sr5wf" podUID="b5b26cf8-2145-4615-891c-9cbb229a8c5e"
Jul 15 20:59:44.569328 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:44.569014    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sthd8" podUID="ebcc66aa-2faa-47f4-b31c-d270d90abacc"
Jul 15 20:59:44.787899 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:44.787863    2573 generic.go:356] "Generic (PLEG): container finished" podID="0835eda6-8a53-429b-b2b5-d7f214f709d0" containerID="9fad9521a8b5f9918858f219e2c0a20d22c928c03003705a63ae3dfacbed4562" exitCode=0
Jul 15 20:59:44.788064 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:44.787928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerDied","Data":"9fad9521a8b5f9918858f219e2c0a20d22c928c03003705a63ae3dfacbed4562"}
Jul 15 20:59:45.164710 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.164512    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-15.ec2.internal" event="NodeReady"
Jul 15 20:59:45.164870 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.164791    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 20:59:45.200348 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.200316    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58454bc589-hmg2p"]
Jul 15 20:59:45.202933 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.202768    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.205638 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.205620    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 20:59:45.205714 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.205645    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pndn8\""
Jul 15 20:59:45.205804 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.205786    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 20:59:45.206141 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.206128    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 20:59:45.212274 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.212256    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 20:59:45.216958 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.216157    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qpkb2"]
Jul 15 20:59:45.220080 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.220061    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gxdff"]
Jul 15 20:59:45.220191 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.220173    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.222503 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.222482    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 20:59:45.222825 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.222805    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 20:59:45.222909 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.222837    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cjhbj\""
Jul 15 20:59:45.222909 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.222893    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 20:59:45.223512 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.223494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58454bc589-hmg2p"]
Jul 15 20:59:45.223608 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.223596    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.225820 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.225804    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 20:59:45.225915 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.225831    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 20:59:45.226420 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.226405    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9rgfh\""
Jul 15 20:59:45.227010 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.226993    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpkb2"]
Jul 15 20:59:45.227646 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.227624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gxdff"]
Jul 15 20:59:45.265385 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97987fc5-dddf-4c40-ad72-043b5e16f9ea-cert\") pod \"ingress-canary-qpkb2\" (UID: \"97987fc5-dddf-4c40-ad72-043b5e16f9ea\") " pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99ddf\" (UniqueName: \"kubernetes.io/projected/97987fc5-dddf-4c40-ad72-043b5e16f9ea-kube-api-access-99ddf\") pod \"ingress-canary-qpkb2\" (UID: \"97987fc5-dddf-4c40-ad72-043b5e16f9ea\") " pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-registry-certificates\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvdg7\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-kube-api-access-lvdg7\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-trusted-ca\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-installation-pull-secrets\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.265609 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-image-registry-private-configuration\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.265894 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9ac16ef-2a91-4991-a0dc-4fc923db5097-config-volume\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.265894 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ac16ef-2a91-4991-a0dc-4fc923db5097-tmp-dir\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.265894 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn4zj\" (UniqueName: \"kubernetes.io/projected/d9ac16ef-2a91-4991-a0dc-4fc923db5097-kube-api-access-cn4zj\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.265894 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68a1fe3a-b076-473c-9548-bb217da72284-ca-trust-extracted\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.265894 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.265700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-bound-sa-token\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.366803 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-bound-sa-token\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.366803 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97987fc5-dddf-4c40-ad72-043b5e16f9ea-cert\") pod \"ingress-canary-qpkb2\" (UID: \"97987fc5-dddf-4c40-ad72-043b5e16f9ea\") " pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.367059 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99ddf\" (UniqueName: \"kubernetes.io/projected/97987fc5-dddf-4c40-ad72-043b5e16f9ea-kube-api-access-99ddf\") pod \"ingress-canary-qpkb2\" (UID: \"97987fc5-dddf-4c40-ad72-043b5e16f9ea\") " pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.367059 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-registry-certificates\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367059 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvdg7\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-kube-api-access-lvdg7\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367059 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.367059 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367059 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.366987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-trusted-ca\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.367066    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.367078    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.367084    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58454bc589-hmg2p: secret "image-registry-tls" not found
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.367144    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls podName:d9ac16ef-2a91-4991-a0dc-4fc923db5097 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:45.867123532 +0000 UTC m=+37.020808032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls") pod "dns-default-gxdff" (UID: "d9ac16ef-2a91-4991-a0dc-4fc923db5097") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-installation-pull-secrets\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-image-registry-private-configuration\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9ac16ef-2a91-4991-a0dc-4fc923db5097-config-volume\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367305    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ac16ef-2a91-4991-a0dc-4fc923db5097-tmp-dir\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4zj\" (UniqueName: \"kubernetes.io/projected/d9ac16ef-2a91-4991-a0dc-4fc923db5097-kube-api-access-cn4zj\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.367367 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68a1fe3a-b076-473c-9548-bb217da72284-ca-trust-extracted\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367895 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.367444    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls podName:68a1fe3a-b076-473c-9548-bb217da72284 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:45.867422008 +0000 UTC m=+37.021106517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls") pod "image-registry-58454bc589-hmg2p" (UID: "68a1fe3a-b076-473c-9548-bb217da72284") : secret "image-registry-tls" not found
Jul 15 20:59:45.367895 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-registry-certificates\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367895 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367741    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68a1fe3a-b076-473c-9548-bb217da72284-ca-trust-extracted\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.367895 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.367859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9ac16ef-2a91-4991-a0dc-4fc923db5097-config-volume\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.368088 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.368007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-trusted-ca\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.368088 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.368076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ac16ef-2a91-4991-a0dc-4fc923db5097-tmp-dir\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.371289 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.371269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-installation-pull-secrets\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.371416 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.371396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-image-registry-private-configuration\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.371485 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.371471    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97987fc5-dddf-4c40-ad72-043b5e16f9ea-cert\") pod \"ingress-canary-qpkb2\" (UID: \"97987fc5-dddf-4c40-ad72-043b5e16f9ea\") " pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.376382 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.376355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99ddf\" (UniqueName: \"kubernetes.io/projected/97987fc5-dddf-4c40-ad72-043b5e16f9ea-kube-api-access-99ddf\") pod \"ingress-canary-qpkb2\" (UID: \"97987fc5-dddf-4c40-ad72-043b5e16f9ea\") " pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.376688 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.376661    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn4zj\" (UniqueName: \"kubernetes.io/projected/d9ac16ef-2a91-4991-a0dc-4fc923db5097-kube-api-access-cn4zj\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.377042 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.377021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-bound-sa-token\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.377145 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.377128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvdg7\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-kube-api-access-lvdg7\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.531885 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.531772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpkb2"
Jul 15 20:59:45.665350 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.665323    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpkb2"]
Jul 15 20:59:45.669032 ip-10-0-135-15 kubenswrapper[2573]: W0715 20:59:45.669009    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97987fc5_dddf_4c40_ad72_043b5e16f9ea.slice/crio-cf6c2938084e5d1ea3412632f2a97e238baeabac80a79a2d734c0f64b9c1c7ba WatchSource:0}: Error finding container cf6c2938084e5d1ea3412632f2a97e238baeabac80a79a2d734c0f64b9c1c7ba: Status 404 returned error can't find the container with id cf6c2938084e5d1ea3412632f2a97e238baeabac80a79a2d734c0f64b9c1c7ba
Jul 15 20:59:45.793415 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.793331    2573 generic.go:356] "Generic (PLEG): container finished" podID="0835eda6-8a53-429b-b2b5-d7f214f709d0" containerID="bdf8ee53ba65ca24b94c26ea35df50422b813dcf2269a2573001a2029b95205e" exitCode=0
Jul 15 20:59:45.793415 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.793404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerDied","Data":"bdf8ee53ba65ca24b94c26ea35df50422b813dcf2269a2573001a2029b95205e"}
Jul 15 20:59:45.794529 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.794507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpkb2" event={"ID":"97987fc5-dddf-4c40-ad72-043b5e16f9ea","Type":"ContainerStarted","Data":"cf6c2938084e5d1ea3412632f2a97e238baeabac80a79a2d734c0f64b9c1c7ba"}
Jul 15 20:59:45.871447 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.871419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:45.871597 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:45.871451    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:45.871678 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.871605    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:59:45.871678 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.871628    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58454bc589-hmg2p: secret "image-registry-tls" not found
Jul 15 20:59:45.871678 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.871632    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:45.871826 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.871692    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls podName:68a1fe3a-b076-473c-9548-bb217da72284 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:46.871672516 +0000 UTC m=+38.025357018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls") pod "image-registry-58454bc589-hmg2p" (UID: "68a1fe3a-b076-473c-9548-bb217da72284") : secret "image-registry-tls" not found
Jul 15 20:59:45.871826 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:45.871705    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls podName:d9ac16ef-2a91-4991-a0dc-4fc923db5097 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:46.871699791 +0000 UTC m=+38.025384290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls") pod "dns-default-gxdff" (UID: "d9ac16ef-2a91-4991-a0dc-4fc923db5097") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:46.569128 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.569091    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 20:59:46.569314 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.569091    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 20:59:46.569314 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.569094    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 20:59:46.571758 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.571618    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 20:59:46.571758 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.571756    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 20:59:46.571956 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.571793    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 20:59:46.573190 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.573157    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 20:59:46.573190 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.573187    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jnsrt\""
Jul 15 20:59:46.573342 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.573229    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ffp72\""
Jul 15 20:59:46.801654 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.801609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" event={"ID":"0835eda6-8a53-429b-b2b5-d7f214f709d0","Type":"ContainerStarted","Data":"9f46fb718bf50a873abd5d91d7c9842d7b1041b273d62cfa0b850615e4e22a76"}
Jul 15 20:59:46.828487 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.828364    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pxfgz" podStartSLOduration=8.933322442 podStartE2EDuration="37.82834256s" totalImagesPullingTime="28.895020118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:46.82803926 +0000 UTC m=+37.981723781" watchObservedRunningTime="2026-07-15 20:59:46.82834256 +0000 UTC m=+37.982027082"
Jul 15 20:59:46.880405 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.880363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:46.880629 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.880419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:46.880629 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:46.880534    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:46.880629 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:46.880585    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:59:46.880629 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:46.880605    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58454bc589-hmg2p: secret "image-registry-tls" not found
Jul 15 20:59:46.880629 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:46.880618    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls podName:d9ac16ef-2a91-4991-a0dc-4fc923db5097 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:48.880596024 +0000 UTC m=+40.034280544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls") pod "dns-default-gxdff" (UID: "d9ac16ef-2a91-4991-a0dc-4fc923db5097") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:46.880902 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:46.880661    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls podName:68a1fe3a-b076-473c-9548-bb217da72284 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:48.880644098 +0000 UTC m=+40.034328660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls") pod "image-registry-58454bc589-hmg2p" (UID: "68a1fe3a-b076-473c-9548-bb217da72284") : secret "image-registry-tls" not found
Jul 15 20:59:46.930590 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.930542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:46.987605 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:46.987574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:47.077236 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:47.077194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:47.177088 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:47.177050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:48.353686 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:48.353647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:48.807496 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:48.807408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpkb2" event={"ID":"97987fc5-dddf-4c40-ad72-043b5e16f9ea","Type":"ContainerStarted","Data":"751b89feef0df19f718b654dccaaf7c325be1083760f6c701ae5a2cf452c276b"}
Jul 15 20:59:48.827838 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:48.827790    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qpkb2" podStartSLOduration=1.7024446210000002 podStartE2EDuration="3.827774118s" totalImagesPullingTime="2.125329497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:48.826752068 +0000 UTC m=+39.980436592" watchObservedRunningTime="2026-07-15 20:59:48.827774118 +0000 UTC m=+39.981458617"
Jul 15 20:59:48.897226 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:48.897181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:48.897226 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:48.897225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:48.897451 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:48.897298    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:48.897451 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:48.897314    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:59:48.897451 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:48.897328    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58454bc589-hmg2p: secret "image-registry-tls" not found
Jul 15 20:59:48.897451 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:48.897370    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls podName:d9ac16ef-2a91-4991-a0dc-4fc923db5097 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:52.897354182 +0000 UTC m=+44.051038687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls") pod "dns-default-gxdff" (UID: "d9ac16ef-2a91-4991-a0dc-4fc923db5097") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:48.897451 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:48.897386    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls podName:68a1fe3a-b076-473c-9548-bb217da72284 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:52.897379571 +0000 UTC m=+44.051064074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls") pod "image-registry-58454bc589-hmg2p" (UID: "68a1fe3a-b076-473c-9548-bb217da72284") : secret "image-registry-tls" not found
Jul 15 20:59:50.118066 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:50.118035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:50.187002 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:50.186960    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:50.908637 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:50.908602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:51.009479 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.009416    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:51.088382 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.088340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:51.479680 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.479646    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qrgh2"]
Jul 15 20:59:51.511559 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.511519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrgh2"]
Jul 15 20:59:51.511710 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.511660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.516023 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.515997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:51.516635 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.516615    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m65gh\""
Jul 15 20:59:51.516762 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.516674    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 20:59:51.518008 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.517988    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 20:59:51.518008 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.518004    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 20:59:51.518173 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.518008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 20:59:51.617108 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.617079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44a1919-0277-4703-ae27-e5c2e027a5c5-data-volume\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.617108 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.617114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d44a1919-0277-4703-ae27-e5c2e027a5c5-crio-socket\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.617333 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.617134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.617333 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.617217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gp8b\" (UniqueName: \"kubernetes.io/projected/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-api-access-7gp8b\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.617333 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.617290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.717981 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.717947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gp8b\" (UniqueName: \"kubernetes.io/projected/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-api-access-7gp8b\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.718112 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.717990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.718112 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.718037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44a1919-0277-4703-ae27-e5c2e027a5c5-data-volume\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.718112 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.718058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d44a1919-0277-4703-ae27-e5c2e027a5c5-crio-socket\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.718112 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.718074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.718332 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:51.718153    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:51.718332 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:51.718185    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:51.718332 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:51.718239    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:52.218219416 +0000 UTC m=+43.371903920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:51.718332 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:51.718253    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:52.218246361 +0000 UTC m=+43.371930861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:51.718332 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.718270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d44a1919-0277-4703-ae27-e5c2e027a5c5-crio-socket\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.718543 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.718423    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44a1919-0277-4703-ae27-e5c2e027a5c5-data-volume\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.729460 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.729428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gp8b\" (UniqueName: \"kubernetes.io/projected/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-api-access-7gp8b\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:51.732134 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.732063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:51.826755 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:51.826715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:52.112399 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.112363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:52.175950 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.175908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:52.222191 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.222163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:52.222351 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.222254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:52.222351 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.222329    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:52.222426 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.222382    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:52.222466 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.222384    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:53.22237064 +0000 UTC m=+44.376055143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:52.222466 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.222457    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:53.222442134 +0000 UTC m=+44.376126648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:52.302228 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.302188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:52.428320 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.428237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:52.573134 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.573100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:52.633181 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.633149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:52.928542 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.928505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 20:59:52.928542 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:52.928543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 20:59:52.928797 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.928675    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:52.928797 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.928713    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:59:52.928797 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.928727    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58454bc589-hmg2p: secret "image-registry-tls" not found
Jul 15 20:59:52.928797 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.928760    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls podName:d9ac16ef-2a91-4991-a0dc-4fc923db5097 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:00.92874029 +0000 UTC m=+52.082424797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls") pod "dns-default-gxdff" (UID: "d9ac16ef-2a91-4991-a0dc-4fc923db5097") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:52.928797 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:52.928776    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls podName:68a1fe3a-b076-473c-9548-bb217da72284 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:00.928769295 +0000 UTC m=+52.082453795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls") pod "image-registry-58454bc589-hmg2p" (UID: "68a1fe3a-b076-473c-9548-bb217da72284") : secret "image-registry-tls" not found
Jul 15 20:59:53.228894 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:53.228820    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kb88p_6aef2b0f-7b22-40a1-894a-74f378656ccc/dns-node-resolver/0.log"
Jul 15 20:59:53.231110 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:53.231091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:53.231188 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:53.231148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:53.231227 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:53.231205    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:53.231267 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:53.231225    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:53.231267 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:53.231261    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:55.231246195 +0000 UTC m=+46.384930699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:53.231347 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:53.231276    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:55.231267712 +0000 UTC m=+46.384952211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:54.016506 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:54.016469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:54.077393 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:54.077355    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:54.428320 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:54.428292    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7pjv_70e5320c-a7cb-4073-bd12-6e92795c2ad4/node-ca/0.log"
Jul 15 20:59:54.482892 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:54.482859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:54.556416 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:54.556374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:55.036105 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:55.036072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:55.247903 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:55.247862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:55.248098 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:55.247965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:55.248098 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:55.247991    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:55.248098 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:55.248066    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:59.248050092 +0000 UTC m=+50.401734592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:55.248217 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:55.248101    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:55.248217 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:55.248149    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:59.248137273 +0000 UTC m=+50.401821772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:55.428610 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:55.428578    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpkb2_97987fc5-dddf-4c40-ad72-043b5e16f9ea/serve-healthcheck-canary/0.log"
Jul 15 20:59:58.327612 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:58.327573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:58.746460 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:58.746424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:58.854978 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:58.854943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:58.949418 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:58.949385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:59.046813 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:59.046722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:59.150597 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:59.150529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:59.249998 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:59.249963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 20:59:59.281982 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:59.281945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:59.282097 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:59.282048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:59.282134 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:59.282107    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:59.282198 ip-10-0-135-15 kubenswrapper[2573]: E0715 20:59:59.282187    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls podName:d44a1919-0277-4703-ae27-e5c2e027a5c5 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:07.282172765 +0000 UTC m=+58.435857268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrgh2" (UID: "d44a1919-0277-4703-ae27-e5c2e027a5c5") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:59.282650 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:59.282631    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d44a1919-0277-4703-ae27-e5c2e027a5c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 20:59:59.469897 ip-10-0-135-15 kubenswrapper[2573]: I0715 20:59:59.469862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:00.424537 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:00.424503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:00.817197 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:00.817092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:00.997934 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:00.997894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 21:00:00.997934 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:00.997931    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 21:00:00.998215 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:00.998050    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:00:00.998215 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:00.998060    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:00:00.998215 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:00.998140    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls podName:d9ac16ef-2a91-4991-a0dc-4fc923db5097 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:16.998118788 +0000 UTC m=+68.151803294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls") pod "dns-default-gxdff" (UID: "d9ac16ef-2a91-4991-a0dc-4fc923db5097") : secret "dns-default-metrics-tls" not found
Jul 15 21:00:00.998215 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:00.998067    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58454bc589-hmg2p: secret "image-registry-tls" not found
Jul 15 21:00:00.998215 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:00.998210    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls podName:68a1fe3a-b076-473c-9548-bb217da72284 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:16.998194036 +0000 UTC m=+68.151878556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls") pod "image-registry-58454bc589-hmg2p" (UID: "68a1fe3a-b076-473c-9548-bb217da72284") : secret "image-registry-tls" not found
Jul 15 21:00:01.055054 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:01.055023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:01.227790 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:01.227754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:01.455641 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:01.455611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:01.629681 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:01.629645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:02.073479 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:02.073391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:02.627421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:02.627389    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:02.721691 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:02.721661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:03.226204 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:03.226163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:03.444097 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:03.444058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:03.643138 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:03.643103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:03.842795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:03.842763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:04.815180 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:04.815144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:04.998750 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:04.998716    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:05.079082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:05.078989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:05.424776 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:05.424742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:05.617500 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:05.617470    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:05.708044 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:05.707962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:06.260308 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:06.260274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:06.499182 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:06.499143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:07.028204 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.028168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:07.354079 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.354045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 21:00:07.356309 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.356281    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d44a1919-0277-4703-ae27-e5c2e027a5c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrgh2\" (UID: \"d44a1919-0277-4703-ae27-e5c2e027a5c5\") " pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 21:00:07.421241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.421206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrgh2"
Jul 15 21:00:07.438883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.438852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:07.566850 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.566825    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrgh2"]
Jul 15 21:00:07.568155 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:07.568132    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44a1919_0277_4703_ae27_e5c2e027a5c5.slice/crio-162d2441895fdfd7df97e84cda883e8430ad242c0e02336179580a1acc4f4105 WatchSource:0}: Error finding container 162d2441895fdfd7df97e84cda883e8430ad242c0e02336179580a1acc4f4105: Status 404 returned error can't find the container with id 162d2441895fdfd7df97e84cda883e8430ad242c0e02336179580a1acc4f4105
Jul 15 21:00:07.833085 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.832997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:07.853582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:07.853541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrgh2" event={"ID":"d44a1919-0277-4703-ae27-e5c2e027a5c5","Type":"ContainerStarted","Data":"162d2441895fdfd7df97e84cda883e8430ad242c0e02336179580a1acc4f4105"}
Jul 15 21:00:08.291358 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:08.291255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:08.437112 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:08.437074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:09.036276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:09.036224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:09.224725 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:09.224690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:09.418726 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:09.418680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:09.526621 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:09.526580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:09.683309 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:09.683229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:10.229187 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:10.229144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:10.303912 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:10.303867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:10.399401 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:10.399360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:10.776979 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:10.776937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:10.883221 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:10.883186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:10.985507 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:10.985466    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:11.191286 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:11.191252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:11.277933 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:11.277864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:11.602077 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:11.602040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:11.789074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:11.789047    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrgq2"
Jul 15 21:00:11.858748 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:11.858597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:12.265203 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:12.265112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:12.609918 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:12.609890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:12.715086 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:12.715052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:12.868397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:12.868306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrgh2" event={"ID":"d44a1919-0277-4703-ae27-e5c2e027a5c5","Type":"ContainerStarted","Data":"7b228d8ce6e1edee059ea7e6f3b8cee1411a09875e23add752f50a383fc07d42"}
Jul 15 21:00:14.999743 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:14.999709    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"]
Jul 15 21:00:15.016594 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.016562    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"]
Jul 15 21:00:15.016754 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.016659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"
Jul 15 21:00:15.019896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.019309    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"]
Jul 15 21:00:15.019896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.019435    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.021367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.021348    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.021477 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.021346    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-99jcs\""
Jul 15 21:00:15.022312 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.022287    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 21:00:15.022421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.022409    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-46g9m\""
Jul 15 21:00:15.023618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.023601    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 21:00:15.029521 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.029271    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 21:00:15.030678 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.029898    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 21:00:15.030678 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.030154    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 21:00:15.030813 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.030682    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"]
Jul 15 21:00:15.036964 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.036759    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 21:00:15.062901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.062877    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"]
Jul 15 21:00:15.071936 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.071912    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"]
Jul 15 21:00:15.120022 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.119992    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58454bc589-hmg2p"]
Jul 15 21:00:15.120235 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.120212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7546113b-ab00-458e-bfb5-06020f13246f-tmp\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.120362 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:15.120240    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-58454bc589-hmg2p" podUID="68a1fe3a-b076-473c-9548-bb217da72284"
Jul 15 21:00:15.120362 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.120252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7546113b-ab00-458e-bfb5-06020f13246f-klusterlet-config\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.120362 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.120345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfszl\" (UniqueName: \"kubernetes.io/projected/7546113b-ab00-458e-bfb5-06020f13246f-kube-api-access-gfszl\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.120504 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.120372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a44f82f6-c9f3-45e6-91b0-50b0267db25c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fjrn7\" (UID: \"a44f82f6-c9f3-45e6-91b0-50b0267db25c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.120504 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.120396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a44f82f6-c9f3-45e6-91b0-50b0267db25c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fjrn7\" (UID: \"a44f82f6-c9f3-45e6-91b0-50b0267db25c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.120504 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.120462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnlw\" (UniqueName: \"kubernetes.io/projected/4ed6d091-8643-487b-b6f6-5c2aaf453174-kube-api-access-qqnlw\") pod \"network-check-source-869dcfcdcd-76jl8\" (UID: \"4ed6d091-8643-487b-b6f6-5c2aaf453174\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"
Jul 15 21:00:15.120657 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.120509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 21:00:15.124112 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.124096    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:00:15.134256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.134188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcc66aa-2faa-47f4-b31c-d270d90abacc-original-pull-secret\") pod \"global-pull-secret-syncer-sthd8\" (UID: \"ebcc66aa-2faa-47f4-b31c-d270d90abacc\") " pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 21:00:15.134739 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.134717    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-9gtmz"]
Jul 15 21:00:15.138623 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.138607    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-9gtmz"
Jul 15 21:00:15.141034 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.140984    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bd8s2\""
Jul 15 21:00:15.141459 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.141440    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 21:00:15.141749 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.141731    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 21:00:15.177362 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.177332    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-9gtmz"]
Jul 15 21:00:15.192147 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.192113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:15.221890 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.221862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7546113b-ab00-458e-bfb5-06020f13246f-tmp\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.221890 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.221896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqlk\" (UniqueName: \"kubernetes.io/projected/7e7cf03e-de3d-40c2-a2ea-78354bb982cc-kube-api-access-grqlk\") pod \"downloads-68c9cbb497-9gtmz\" (UID: \"7e7cf03e-de3d-40c2-a2ea-78354bb982cc\") " pod="openshift-console/downloads-68c9cbb497-9gtmz"
Jul 15 21:00:15.222089 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.221921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7546113b-ab00-458e-bfb5-06020f13246f-klusterlet-config\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.222089 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.222061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 21:00:15.222189 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.222112    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfszl\" (UniqueName: \"kubernetes.io/projected/7546113b-ab00-458e-bfb5-06020f13246f-kube-api-access-gfszl\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.222189 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.222144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a44f82f6-c9f3-45e6-91b0-50b0267db25c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fjrn7\" (UID: \"a44f82f6-c9f3-45e6-91b0-50b0267db25c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.222189 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.222176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a44f82f6-c9f3-45e6-91b0-50b0267db25c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fjrn7\" (UID: \"a44f82f6-c9f3-45e6-91b0-50b0267db25c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.222326 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.222210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnlw\" (UniqueName: \"kubernetes.io/projected/4ed6d091-8643-487b-b6f6-5c2aaf453174-kube-api-access-qqnlw\") pod \"network-check-source-869dcfcdcd-76jl8\" (UID: \"4ed6d091-8643-487b-b6f6-5c2aaf453174\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"
Jul 15 21:00:15.222326 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.222269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 21:00:15.222326 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.222292    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7546113b-ab00-458e-bfb5-06020f13246f-tmp\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.223215 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.223166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a44f82f6-c9f3-45e6-91b0-50b0267db25c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fjrn7\" (UID: \"a44f82f6-c9f3-45e6-91b0-50b0267db25c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.225308 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.224960    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 21:00:15.228085 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.225941    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-669fcdf68-5jbmf"]
Jul 15 21:00:15.228712 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.228434    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:00:15.230160 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.230132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.230285 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.230198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a44f82f6-c9f3-45e6-91b0-50b0267db25c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fjrn7\" (UID: \"a44f82f6-c9f3-45e6-91b0-50b0267db25c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.230523 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.230498    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7546113b-ab00-458e-bfb5-06020f13246f-klusterlet-config\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.234235 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.234218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b26cf8-2145-4615-891c-9cbb229a8c5e-metrics-certs\") pod \"network-metrics-daemon-sr5wf\" (UID: \"b5b26cf8-2145-4615-891c-9cbb229a8c5e\") " pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 21:00:15.234358 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.234255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfszl\" (UniqueName: \"kubernetes.io/projected/7546113b-ab00-458e-bfb5-06020f13246f-kube-api-access-gfszl\") pod \"klusterlet-addon-workmgr-784df6c659-f7wk9\" (UID: \"7546113b-ab00-458e-bfb5-06020f13246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.235641 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.235625    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 21:00:15.245421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.245397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qptrx\" (UniqueName: \"kubernetes.io/projected/59378e17-885b-4541-8673-09f33a53fe92-kube-api-access-qptrx\") pod \"network-check-target-hzpw7\" (UID: \"59378e17-885b-4541-8673-09f33a53fe92\") " pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 21:00:15.245508 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.245409    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnlw\" (UniqueName: \"kubernetes.io/projected/4ed6d091-8643-487b-b6f6-5c2aaf453174-kube-api-access-qqnlw\") pod \"network-check-source-869dcfcdcd-76jl8\" (UID: \"4ed6d091-8643-487b-b6f6-5c2aaf453174\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"
Jul 15 21:00:15.260695 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.260643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-669fcdf68-5jbmf"]
Jul 15 21:00:15.314827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.314796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:15.322849 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.322817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-registry-tls\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.322975 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.322957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-installation-pull-secrets\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.323048 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.322990    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-ca-trust-extracted\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.323103 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.323031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-image-registry-private-configuration\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.323103 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.323084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-registry-certificates\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.323200 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.323120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqlk\" (UniqueName: \"kubernetes.io/projected/7e7cf03e-de3d-40c2-a2ea-78354bb982cc-kube-api-access-grqlk\") pod \"downloads-68c9cbb497-9gtmz\" (UID: \"7e7cf03e-de3d-40c2-a2ea-78354bb982cc\") " pod="openshift-console/downloads-68c9cbb497-9gtmz"
Jul 15 21:00:15.323200 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.323167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-bound-sa-token\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.323276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.323197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-trusted-ca\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.323276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.323230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5m89\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-kube-api-access-l5m89\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.329974 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.329949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"
Jul 15 21:00:15.341249 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.341230    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqlk\" (UniqueName: \"kubernetes.io/projected/7e7cf03e-de3d-40c2-a2ea-78354bb982cc-kube-api-access-grqlk\") pod \"downloads-68c9cbb497-9gtmz\" (UID: \"7e7cf03e-de3d-40c2-a2ea-78354bb982cc\") " pod="openshift-console/downloads-68c9cbb497-9gtmz"
Jul 15 21:00:15.355684 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.355664    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"
Jul 15 21:00:15.361919 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.361883    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:15.381242 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.381213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sthd8"
Jul 15 21:00:15.391505 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.391489    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ffp72\""
Jul 15 21:00:15.398678 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.398660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 21:00:15.404526 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.404510    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jnsrt\""
Jul 15 21:00:15.413896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.413871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sr5wf"
Jul 15 21:00:15.424202 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424153    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-image-registry-private-configuration\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.424202 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-registry-certificates\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.424626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-bound-sa-token\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.424626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-trusted-ca\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.424626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5m89\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-kube-api-access-l5m89\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.424626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-registry-tls\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.424626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-installation-pull-secrets\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.424626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-ca-trust-extracted\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.425026 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.424999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-registry-certificates\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.425134 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.425006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-ca-trust-extracted\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.425534 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.425383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:15.426154 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.426124    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-trusted-ca\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.427002 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.426978    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-image-registry-private-configuration\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.427696 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.427674    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-registry-tls\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.427847 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.427828    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-installation-pull-secrets\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.439954 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.439905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-bound-sa-token\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.443377 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.443345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5m89\" (UniqueName: \"kubernetes.io/projected/cf25fddf-b359-4a02-a3bc-bb1382f2e6de-kube-api-access-l5m89\") pod \"image-registry-669fcdf68-5jbmf\" (UID: \"cf25fddf-b359-4a02-a3bc-bb1382f2e6de\") " pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.450020 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.450001    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-9gtmz"
Jul 15 21:00:15.545966 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.545870    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:15.550602 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.550579    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pndn8\""
Jul 15 21:00:15.556758 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.556743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:15.875161 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.875128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 21:00:15.886509 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:15.886483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 21:00:16.031397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.030708    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-installation-pull-secrets\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:16.031397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.030792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-image-registry-private-configuration\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:16.031397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.030866    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-bound-sa-token\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:16.031397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.030899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-registry-certificates\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:16.031397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.030934    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-trusted-ca\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:16.031397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.030968    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68a1fe3a-b076-473c-9548-bb217da72284-ca-trust-extracted\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:16.031397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.030999    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvdg7\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-kube-api-access-lvdg7\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:16.032198 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.032167    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:00:16.033520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.032998    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:00:16.033520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.033282    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a1fe3a-b076-473c-9548-bb217da72284-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:00:16.035533 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.035488    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:00:16.047571 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.045233    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:00:16.059988 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.059486    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:00:16.069827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.065450    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-kube-api-access-lvdg7" (OuterVolumeSpecName: "kube-api-access-lvdg7") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "kube-api-access-lvdg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:00:16.130806 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.130577    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzpw7"]
Jul 15 21:00:16.132670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.132290    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-bound-sa-token\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:16.132670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.132317    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-registry-certificates\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:16.132670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.132355    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68a1fe3a-b076-473c-9548-bb217da72284-trusted-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:16.132670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.132370    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68a1fe3a-b076-473c-9548-bb217da72284-ca-trust-extracted\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:16.132670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.132383    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvdg7\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-kube-api-access-lvdg7\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:16.132670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.132418    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-installation-pull-secrets\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:16.132670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.132435    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68a1fe3a-b076-473c-9548-bb217da72284-image-registry-private-configuration\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:16.133195 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:16.133165    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59378e17_885b_4541_8673_09f33a53fe92.slice/crio-f00142942042b61735f737aab727f8eb110be2d67ebea52e7263649b4a1fa2ee WatchSource:0}: Error finding container f00142942042b61735f737aab727f8eb110be2d67ebea52e7263649b4a1fa2ee: Status 404 returned error can't find the container with id f00142942042b61735f737aab727f8eb110be2d67ebea52e7263649b4a1fa2ee
Jul 15 21:00:16.143463 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.143346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8"]
Jul 15 21:00:16.195495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.195468    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-669fcdf68-5jbmf"]
Jul 15 21:00:16.198285 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:16.198265    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf25fddf_b359_4a02_a3bc_bb1382f2e6de.slice/crio-d31029115da36bf4cc3562f4bff7cb6631ab311c749eba6c51db4fda71187b27 WatchSource:0}: Error finding container d31029115da36bf4cc3562f4bff7cb6631ab311c749eba6c51db4fda71187b27: Status 404 returned error can't find the container with id d31029115da36bf4cc3562f4bff7cb6631ab311c749eba6c51db4fda71187b27
Jul 15 21:00:16.339355 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.338928    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sthd8"]
Jul 15 21:00:16.341688 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:16.341651    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcc66aa_2faa_47f4_b31c_d270d90abacc.slice/crio-9b9d65c7a95067b723a79d40b1ef6c135726a6fdd66f3ecc21d41525ccc7b873 WatchSource:0}: Error finding container 9b9d65c7a95067b723a79d40b1ef6c135726a6fdd66f3ecc21d41525ccc7b873: Status 404 returned error can't find the container with id 9b9d65c7a95067b723a79d40b1ef6c135726a6fdd66f3ecc21d41525ccc7b873
Jul 15 21:00:16.351944 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:16.351906    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b26cf8_2145_4615_891c_9cbb229a8c5e.slice/crio-e650828c8b0b96205be805d7a5c88e8c1bf944aef1b8e6fb72636289fc685be5 WatchSource:0}: Error finding container e650828c8b0b96205be805d7a5c88e8c1bf944aef1b8e6fb72636289fc685be5: Status 404 returned error can't find the container with id e650828c8b0b96205be805d7a5c88e8c1bf944aef1b8e6fb72636289fc685be5
Jul 15 21:00:16.353186 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.353116    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sr5wf"]
Jul 15 21:00:16.355328 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.355306    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fjrn7"]
Jul 15 21:00:16.356654 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:16.356631    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44f82f6_c9f3_45e6_91b0_50b0267db25c.slice/crio-76d9f64160a0f8b3e0622d7b877249dd779dba53d73a21cb15abc0107b147b97 WatchSource:0}: Error finding container 76d9f64160a0f8b3e0622d7b877249dd779dba53d73a21cb15abc0107b147b97: Status 404 returned error can't find the container with id 76d9f64160a0f8b3e0622d7b877249dd779dba53d73a21cb15abc0107b147b97
Jul 15 21:00:16.406299 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.406224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"]
Jul 15 21:00:16.414461 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.414439    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-9gtmz"]
Jul 15 21:00:16.415766 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:16.415743    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7546113b_ab00_458e_bfb5_06020f13246f.slice/crio-23642bf5cf0732ea8557e1e4d485f10dce667f24f0e390d1c2d5a1e2aa568c7a WatchSource:0}: Error finding container 23642bf5cf0732ea8557e1e4d485f10dce667f24f0e390d1c2d5a1e2aa568c7a: Status 404 returned error can't find the container with id 23642bf5cf0732ea8557e1e4d485f10dce667f24f0e390d1c2d5a1e2aa568c7a
Jul 15 21:00:16.416340 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:16.416319    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7cf03e_de3d_40c2_a2ea_78354bb982cc.slice/crio-a41a6ff07981151928057bbdc515efd2064d1ec18ea165317ecda66406e5da41 WatchSource:0}: Error finding container a41a6ff07981151928057bbdc515efd2064d1ec18ea165317ecda66406e5da41: Status 404 returned error can't find the container with id a41a6ff07981151928057bbdc515efd2064d1ec18ea165317ecda66406e5da41
Jul 15 21:00:16.880480 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.880421    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-669fcdf68-5jbmf" event={"ID":"cf25fddf-b359-4a02-a3bc-bb1382f2e6de","Type":"ContainerStarted","Data":"3f099a272b57ee300c505b0e80be7c8e9dbbbedd0130a0bf6d2903e5bbdc2af4"}
Jul 15 21:00:16.880734 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.880491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-669fcdf68-5jbmf" event={"ID":"cf25fddf-b359-4a02-a3bc-bb1382f2e6de","Type":"ContainerStarted","Data":"d31029115da36bf4cc3562f4bff7cb6631ab311c749eba6c51db4fda71187b27"}
Jul 15 21:00:16.880830 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.880771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:16.883632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.883532    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrgh2" event={"ID":"d44a1919-0277-4703-ae27-e5c2e027a5c5","Type":"ContainerStarted","Data":"b4f9520bbb749c22ee794a171a4a0a4b8c8530b3e2c8428628bcf5fb747d11c3"}
Jul 15 21:00:16.885405 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.885347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9" event={"ID":"7546113b-ab00-458e-bfb5-06020f13246f","Type":"ContainerStarted","Data":"23642bf5cf0732ea8557e1e4d485f10dce667f24f0e390d1c2d5a1e2aa568c7a"}
Jul 15 21:00:16.887448 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.887390    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7" event={"ID":"a44f82f6-c9f3-45e6-91b0-50b0267db25c","Type":"ContainerStarted","Data":"76d9f64160a0f8b3e0622d7b877249dd779dba53d73a21cb15abc0107b147b97"}
Jul 15 21:00:16.889373 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.889348    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzpw7" event={"ID":"59378e17-885b-4541-8673-09f33a53fe92","Type":"ContainerStarted","Data":"f00142942042b61735f737aab727f8eb110be2d67ebea52e7263649b4a1fa2ee"}
Jul 15 21:00:16.891467 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.891443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sthd8" event={"ID":"ebcc66aa-2faa-47f4-b31c-d270d90abacc","Type":"ContainerStarted","Data":"9b9d65c7a95067b723a79d40b1ef6c135726a6fdd66f3ecc21d41525ccc7b873"}
Jul 15 21:00:16.894102 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.894077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-9gtmz" event={"ID":"7e7cf03e-de3d-40c2-a2ea-78354bb982cc","Type":"ContainerStarted","Data":"a41a6ff07981151928057bbdc515efd2064d1ec18ea165317ecda66406e5da41"}
Jul 15 21:00:16.896047 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.896017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8" event={"ID":"4ed6d091-8643-487b-b6f6-5c2aaf453174","Type":"ContainerStarted","Data":"a7f4e84d9d9bd27be8a3f029a9581801e555e549696f74ed73d2a08df8e02b92"}
Jul 15 21:00:16.900878 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.898859    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 21:00:16.900878 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.900857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sr5wf" event={"ID":"b5b26cf8-2145-4615-891c-9cbb229a8c5e","Type":"ContainerStarted","Data":"e650828c8b0b96205be805d7a5c88e8c1bf944aef1b8e6fb72636289fc685be5"}
Jul 15 21:00:16.950155 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:16.950017    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-669fcdf68-5jbmf" podStartSLOduration=1.947420316 podStartE2EDuration="1.947420316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:16.945403509 +0000 UTC m=+68.099088023" watchObservedRunningTime="2026-07-15 21:00:16.947420316 +0000 UTC m=+68.101104844"
Jul 15 21:00:17.002850 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.002785    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58454bc589-hmg2p"]
Jul 15 21:00:17.008633 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.008601    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58454bc589-hmg2p"]
Jul 15 21:00:17.042887 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.041424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 21:00:17.042887 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.041478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 21:00:17.046505 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.046458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"image-registry-58454bc589-hmg2p\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") " pod="openshift-image-registry/image-registry-58454bc589-hmg2p"
Jul 15 21:00:17.048237 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.048196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9ac16ef-2a91-4991-a0dc-4fc923db5097-metrics-tls\") pod \"dns-default-gxdff\" (UID: \"d9ac16ef-2a91-4991-a0dc-4fc923db5097\") " pod="openshift-dns/dns-default-gxdff"
Jul 15 21:00:17.147851 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.146650    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") pod \"68a1fe3a-b076-473c-9548-bb217da72284\" (UID: \"68a1fe3a-b076-473c-9548-bb217da72284\") "
Jul 15 21:00:17.156976 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.156930    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "68a1fe3a-b076-473c-9548-bb217da72284" (UID: "68a1fe3a-b076-473c-9548-bb217da72284"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:00:17.247975 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.247906    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68a1fe3a-b076-473c-9548-bb217da72284-registry-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:00:17.355103 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.354835    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9rgfh\""
Jul 15 21:00:17.357800 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.357496    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gxdff"
Jul 15 21:00:17.574709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.574449    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a1fe3a-b076-473c-9548-bb217da72284" path="/var/lib/kubelet/pods/68a1fe3a-b076-473c-9548-bb217da72284/volumes"
Jul 15 21:00:17.608243 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:17.608152    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gxdff"]
Jul 15 21:00:18.242226 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:18.242116    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ac16ef_2a91_4991_a0dc_4fc923db5097.slice/crio-0bd42b357c9f47d1868157971eb7b139b868847bf9a150f1a8552c5d116bb219 WatchSource:0}: Error finding container 0bd42b357c9f47d1868157971eb7b139b868847bf9a150f1a8552c5d116bb219: Status 404 returned error can't find the container with id 0bd42b357c9f47d1868157971eb7b139b868847bf9a150f1a8552c5d116bb219
Jul 15 21:00:18.914602 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:18.914446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxdff" event={"ID":"d9ac16ef-2a91-4991-a0dc-4fc923db5097","Type":"ContainerStarted","Data":"0bd42b357c9f47d1868157971eb7b139b868847bf9a150f1a8552c5d116bb219"}
Jul 15 21:00:19.936858 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:19.936812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7" event={"ID":"a44f82f6-c9f3-45e6-91b0-50b0267db25c","Type":"ContainerStarted","Data":"b8f574180f1755aba0149c8edfccc1d677b1fa4054bcbc3b0ade539b5e381fe6"}
Jul 15 21:00:19.942728 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:19.942692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sr5wf" event={"ID":"b5b26cf8-2145-4615-891c-9cbb229a8c5e","Type":"ContainerStarted","Data":"9d6173e51a51addc22f411f1bb08d89d766cea6ae88225b45c1be97ffa904212"}
Jul 15 21:00:20.113524 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:20.113491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:20.201271 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:20.201154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:21.024921 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:21.024833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:21.111690 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:21.111461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:21.213101 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:21.213061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:22.028206 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.028047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:22.636251 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.636185    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-fjrn7" podStartSLOduration=5.797744221 podStartE2EDuration="8.636158927s" totalImagesPullingTime="2.838414706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:19.961814545 +0000 UTC m=+71.115499069" watchObservedRunningTime="2026-07-15 21:00:22.636158927 +0000 UTC m=+73.789843428"
Jul 15 21:00:22.637041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.637013    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb6985c9c-476cp"]
Jul 15 21:00:22.651609 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.651581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.652098 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.652071    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb6985c9c-476cp"]
Jul 15 21:00:22.655949 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.655765    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 21:00:22.656067 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.656021    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vxbf7\""
Jul 15 21:00:22.656507 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.656348    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 21:00:22.657228 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.656616    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 21:00:22.657228 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.656835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 21:00:22.657228 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.657056    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 21:00:22.792836 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.792794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-service-ca\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.793012 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.792845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6fv7\" (UniqueName: \"kubernetes.io/projected/b6f7395f-e98d-42fa-99eb-551989c8dcc8-kube-api-access-m6fv7\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.793012 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.792912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-config\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.793012 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.792954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-serving-cert\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.793012 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.792980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-oauth-config\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.793227 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.793041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-oauth-serving-cert\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.894144 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.894059    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-serving-cert\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.894144 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.894108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-oauth-config\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.894144 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.894142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-oauth-serving-cert\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.894425 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.894186    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-service-ca\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.894425 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.894209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6fv7\" (UniqueName: \"kubernetes.io/projected/b6f7395f-e98d-42fa-99eb-551989c8dcc8-kube-api-access-m6fv7\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.894425 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.894256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-config\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.895028 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.895000    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-config\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.895175 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.895152    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-service-ca\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.895310 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.895269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-oauth-serving-cert\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.898152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.898107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-serving-cert\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.898711 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.898673    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-oauth-config\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.904943 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.904895    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6fv7\" (UniqueName: \"kubernetes.io/projected/b6f7395f-e98d-42fa-99eb-551989c8dcc8-kube-api-access-m6fv7\") pod \"console-7bb6985c9c-476cp\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") " pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:22.964492 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:22.964459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:24.488924 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:24.488885    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:24.589223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:24.589188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:25.819842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:25.819804    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"]
Jul 15 21:00:25.826282 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:25.826256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"
Jul 15 21:00:25.829528 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:25.829491    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 21:00:25.829528 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:25.829518    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ndtzd\""
Jul 15 21:00:25.836247 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:25.836165    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"]
Jul 15 21:00:25.917918 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:25.917879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a818e2c6-32cd-467b-acd1-5f6e2f924c7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-p87gx\" (UID: \"a818e2c6-32cd-467b-acd1-5f6e2f924c7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"
Jul 15 21:00:26.019400 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.019362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a818e2c6-32cd-467b-acd1-5f6e2f924c7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-p87gx\" (UID: \"a818e2c6-32cd-467b-acd1-5f6e2f924c7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"
Jul 15 21:00:26.022687 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.022655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a818e2c6-32cd-467b-acd1-5f6e2f924c7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-p87gx\" (UID: \"a818e2c6-32cd-467b-acd1-5f6e2f924c7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"
Jul 15 21:00:26.036726 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.036626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:26.137701 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.137662    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"
Jul 15 21:00:26.169091 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.169048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:26.262164 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.262127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:26.367329 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.367238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:26.429815 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:26.429727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:27.024023 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.023984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:27.092343 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.092285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:27.229038 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.228998    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f78bf7489-756p5"]
Jul 15 21:00:27.232607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.232586    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.248115 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.248090    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f78bf7489-756p5"]
Jul 15 21:00:27.248973 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.248951    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 21:00:27.329288 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.329190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-oauth-serving-cert\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.329288 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.329254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmwk2\" (UniqueName: \"kubernetes.io/projected/14753fb3-f04b-4b61-870f-ef72db382d47-kube-api-access-bmwk2\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.329582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.329323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-serving-cert\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.329582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.329344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-console-config\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.329582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.329370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-service-ca\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.329582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.329399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-oauth-config\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.329582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.329446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-trusted-ca-bundle\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.430248 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.430212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmwk2\" (UniqueName: \"kubernetes.io/projected/14753fb3-f04b-4b61-870f-ef72db382d47-kube-api-access-bmwk2\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.430416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.430277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-serving-cert\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.430416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.430304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-console-config\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.430416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.430327    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-service-ca\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.430416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.430355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-oauth-config\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.430416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.430396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-trusted-ca-bundle\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.430729 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.430424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-oauth-serving-cert\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.432055 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.431190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-oauth-serving-cert\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.432405 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.432379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-console-config\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.432519 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.432393    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-service-ca\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.432939 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.432886    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-trusted-ca-bundle\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.434788 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.434765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-oauth-config\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.435334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.435289    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-serving-cert\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.441500 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.441471    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmwk2\" (UniqueName: \"kubernetes.io/projected/14753fb3-f04b-4b61-870f-ef72db382d47-kube-api-access-bmwk2\") pod \"console-7f78bf7489-756p5\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") " pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:27.544479 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:27.544442    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:28.029952 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.028691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:28.104311 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.101771    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb6985c9c-476cp"]
Jul 15 21:00:28.121863 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.121360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:28.131892 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.131029    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"]
Jul 15 21:00:28.137693 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:28.137630    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda818e2c6_32cd_467b_acd1_5f6e2f924c7c.slice/crio-2a1daaeaa9a0486a4fffdc8a8f983594f6f8a5f64329add70a90abf273740df4 WatchSource:0}: Error finding container 2a1daaeaa9a0486a4fffdc8a8f983594f6f8a5f64329add70a90abf273740df4: Status 404 returned error can't find the container with id 2a1daaeaa9a0486a4fffdc8a8f983594f6f8a5f64329add70a90abf273740df4
Jul 15 21:00:28.153051 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.153026    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f78bf7489-756p5"]
Jul 15 21:00:28.648887 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.648850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:28.738119 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.738082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:28.991182 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.990358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8" event={"ID":"4ed6d091-8643-487b-b6f6-5c2aaf453174","Type":"ContainerStarted","Data":"f20e035b241f2f3114885650a81b3aa22fde6291917d64691b1a34c044d64e70"}
Jul 15 21:00:29.000431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.999711    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxdff" event={"ID":"d9ac16ef-2a91-4991-a0dc-4fc923db5097","Type":"ContainerStarted","Data":"ded4d038aab803ff23da54542436e11c471c21079960a7b3d90334d990956436"}
Jul 15 21:00:29.000431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:28.999774    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxdff" event={"ID":"d9ac16ef-2a91-4991-a0dc-4fc923db5097","Type":"ContainerStarted","Data":"7b98564eabef703b47cda960976d2649803418021eea48c28512f7fdc8b2dc2c"}
Jul 15 21:00:29.000431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.000351    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gxdff"
Jul 15 21:00:29.004361 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.004206    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6985c9c-476cp" event={"ID":"b6f7395f-e98d-42fa-99eb-551989c8dcc8","Type":"ContainerStarted","Data":"63927643c5e4a361ac55ef58e9a8d6c9247c471112b4dac54c8aedb3684ae71c"}
Jul 15 21:00:29.006938 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.006912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sr5wf" event={"ID":"b5b26cf8-2145-4615-891c-9cbb229a8c5e","Type":"ContainerStarted","Data":"dcc12401d94f46da091ff32a1746c68ca8e78dc198bd83209d1ccef9a475a45e"}
Jul 15 21:00:29.010506 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.010483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrgh2" event={"ID":"d44a1919-0277-4703-ae27-e5c2e027a5c5","Type":"ContainerStarted","Data":"aab1d590cd5275520f02c4abc81016f510263cd1c4be7c41c1657e0b9582ee78"}
Jul 15 21:00:29.017811 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.015856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9" event={"ID":"7546113b-ab00-458e-bfb5-06020f13246f","Type":"ContainerStarted","Data":"103b90e3cf14ffd4d4fb03786182dc39ba29b0d39d2c57976cd9e7a13d984b30"}
Jul 15 21:00:29.017811 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.016593    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:29.018534 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.018486    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9"
Jul 15 21:00:29.020867 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.020393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzpw7" event={"ID":"59378e17-885b-4541-8673-09f33a53fe92","Type":"ContainerStarted","Data":"2989d4664c3e7a88bbaa627834d484c89c8be75a9e28dfe16cb537582dfcb655"}
Jul 15 21:00:29.020867 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.020830    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 21:00:29.027950 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.027927    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f78bf7489-756p5" event={"ID":"14753fb3-f04b-4b61-870f-ef72db382d47","Type":"ContainerStarted","Data":"ed561ac1ad743a8319a6e6bcb11a1b472106daecaa8257e19fb721774bc1c430"}
Jul 15 21:00:29.032272 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.031853    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sthd8" event={"ID":"ebcc66aa-2faa-47f4-b31c-d270d90abacc","Type":"ContainerStarted","Data":"035fca0cf7bbdaec19b28a10d6fe6636065becb861228732bbbdc109b53950a1"}
Jul 15 21:00:29.033842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.033778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx" event={"ID":"a818e2c6-32cd-467b-acd1-5f6e2f924c7c","Type":"ContainerStarted","Data":"2a1daaeaa9a0486a4fffdc8a8f983594f6f8a5f64329add70a90abf273740df4"}
Jul 15 21:00:29.043031 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.041637    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qrgh2" podStartSLOduration=17.878405393 podStartE2EDuration="38.041617838s" totalImagesPullingTime="20.163212445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.040285305 +0000 UTC m=+80.193969831" watchObservedRunningTime="2026-07-15 21:00:29.041617838 +0000 UTC m=+80.195302362"
Jul 15 21:00:29.043031 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.042661    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-76jl8" podStartSLOduration=3.304752586 podStartE2EDuration="15.042652045s" totalImagesPullingTime="11.737899459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.012642719 +0000 UTC m=+80.166327243" watchObservedRunningTime="2026-07-15 21:00:29.042652045 +0000 UTC m=+80.196336564"
Jul 15 21:00:29.059708 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.059643    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gxdff" podStartSLOduration=34.418569745 podStartE2EDuration="44.059620787s" totalImagesPullingTime="9.641051042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.058487162 +0000 UTC m=+80.212171686" watchObservedRunningTime="2026-07-15 21:00:29.059620787 +0000 UTC m=+80.213305290"
Jul 15 21:00:29.105896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.105832    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hzpw7" podStartSLOduration=68.355077351 podStartE2EDuration="1m20.105795718s" totalImagesPullingTime="11.750718367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.104846225 +0000 UTC m=+80.258530749" watchObservedRunningTime="2026-07-15 21:00:29.105795718 +0000 UTC m=+80.259480241"
Jul 15 21:00:29.106877 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.106397    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sr5wf" podStartSLOduration=77.269109037 podStartE2EDuration="1m20.10638265s" totalImagesPullingTime="2.837273613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.083490975 +0000 UTC m=+80.237175502" watchObservedRunningTime="2026-07-15 21:00:29.10638265 +0000 UTC m=+80.260067175"
Jul 15 21:00:29.126140 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.125411    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sthd8" podStartSLOduration=68.519356197 podStartE2EDuration="1m20.125390833s" totalImagesPullingTime="11.606034636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.124205296 +0000 UTC m=+80.277889820" watchObservedRunningTime="2026-07-15 21:00:29.125390833 +0000 UTC m=+80.279075335"
Jul 15 21:00:29.145043 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.144984    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df6c659-f7wk9" podStartSLOduration=3.590840198 podStartE2EDuration="15.14496287s" totalImagesPullingTime="11.554122672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.14403628 +0000 UTC m=+80.297720822" watchObservedRunningTime="2026-07-15 21:00:29.14496287 +0000 UTC m=+80.298647398"
Jul 15 21:00:29.200350 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.200313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:29.263365 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:29.263256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:30.052736 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.051478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx" event={"ID":"a818e2c6-32cd-467b-acd1-5f6e2f924c7c","Type":"ContainerStarted","Data":"17bb744099aacb3e740bd7b277000551465149f5f4f74c9810d3f1ab87345b07"}
Jul 15 21:00:30.053796 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.053770    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"
Jul 15 21:00:30.061166 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.061141    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx"
Jul 15 21:00:30.086740 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.086615    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-p87gx" podStartSLOduration=3.606148604 podStartE2EDuration="5.086593735s" totalImagesPullingTime="1.480445131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:30.084712396 +0000 UTC m=+81.238396919" watchObservedRunningTime="2026-07-15 21:00:30.086593735 +0000 UTC m=+81.240278257"
Jul 15 21:00:30.827222 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.827103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:30.914006 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.913975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:30.914660 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.914624    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-69q9r"]
Jul 15 21:00:30.918054 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.918034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:30.920818 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.920794    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 21:00:30.920818 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.920811    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 21:00:30.921091 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.921072    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 21:00:30.921296 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.921276    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 21:00:30.922021 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.922000    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 21:00:30.922106 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.922005    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g58jf\""
Jul 15 21:00:30.931882 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:30.931862    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-69q9r"]
Jul 15 21:00:31.065429 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.065394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.065872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.065455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-metrics-client-ca\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.065872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.065488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.065872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.065625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-kube-api-access-lfr5m\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.166156 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.166117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-kube-api-access-lfr5m\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.166342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.166179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.166342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.166241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-metrics-client-ca\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.166342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.166272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.166638 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:31.166604    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 21:00:31.166767 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:31.166671    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-tls podName:79c08b8c-00d5-4187-83eb-2b4d308b5ddf nodeName:}" failed. No retries permitted until 2026-07-15 21:00:31.666650987 +0000 UTC m=+82.820335487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-tls") pod "prometheus-operator-64785b6675-69q9r" (UID: "79c08b8c-00d5-4187-83eb-2b4d308b5ddf") : secret "prometheus-operator-tls" not found
Jul 15 21:00:31.167294 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.167270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-metrics-client-ca\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.169031 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.169006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.176754 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.176732    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-kube-api-access-lfr5m\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.566220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.566046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:31.669367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.669330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.671953 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.671926    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79c08b8c-00d5-4187-83eb-2b4d308b5ddf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-69q9r\" (UID: \"79c08b8c-00d5-4187-83eb-2b4d308b5ddf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:31.828533 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:31.828454    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r"
Jul 15 21:00:36.525318 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:36.525267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:36.602173 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:36.602134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:37.757814 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:37.757762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:37.864457 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:37.864391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:37.911830 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:37.911792    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-669fcdf68-5jbmf"
Jul 15 21:00:38.093711 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:38.093672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:38.164303 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:38.164214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:38.236680 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:38.236594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:38.922051 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:38.922028    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-69q9r"]
Jul 15 21:00:38.924223 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:38.924198    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c08b8c_00d5_4187_83eb_2b4d308b5ddf.slice/crio-0f5fd40724497a6a5bcba8d96e9b5c8f3c5627bfa50f03ea3c9a60520678baad WatchSource:0}: Error finding container 0f5fd40724497a6a5bcba8d96e9b5c8f3c5627bfa50f03ea3c9a60520678baad: Status 404 returned error can't find the container with id 0f5fd40724497a6a5bcba8d96e9b5c8f3c5627bfa50f03ea3c9a60520678baad
Jul 15 21:00:39.092470 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.092443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-9gtmz" event={"ID":"7e7cf03e-de3d-40c2-a2ea-78354bb982cc","Type":"ContainerStarted","Data":"9745e20bd5989587e0279013205253bc307749b1fbee4450674376404ba77c82"}
Jul 15 21:00:39.092695 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.092529    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-9gtmz"
Jul 15 21:00:39.093965 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.093941    2573 patch_prober.go:28] interesting pod/downloads-68c9cbb497-9gtmz container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" start-of-body=
Jul 15 21:00:39.094102 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.093991    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-9gtmz" podUID="7e7cf03e-de3d-40c2-a2ea-78354bb982cc" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused"
Jul 15 21:00:39.094166 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.094107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6985c9c-476cp" event={"ID":"b6f7395f-e98d-42fa-99eb-551989c8dcc8","Type":"ContainerStarted","Data":"cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c"}
Jul 15 21:00:39.095659 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.095638    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f78bf7489-756p5" event={"ID":"14753fb3-f04b-4b61-870f-ef72db382d47","Type":"ContainerStarted","Data":"b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4"}
Jul 15 21:00:39.096875 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.096857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r" event={"ID":"79c08b8c-00d5-4187-83eb-2b4d308b5ddf","Type":"ContainerStarted","Data":"0f5fd40724497a6a5bcba8d96e9b5c8f3c5627bfa50f03ea3c9a60520678baad"}
Jul 15 21:00:39.112496 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.112454    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-9gtmz" podStartSLOduration=1.726614042 podStartE2EDuration="24.11244159s" totalImagesPullingTime="22.385827548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:39.111413146 +0000 UTC m=+90.265097669" watchObservedRunningTime="2026-07-15 21:00:39.11244159 +0000 UTC m=+90.266126112"
Jul 15 21:00:39.132022 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.131978    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb6985c9c-476cp" podStartSLOduration=6.449178463 podStartE2EDuration="17.13196429s" totalImagesPullingTime="10.682785827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:39.130810421 +0000 UTC m=+90.284494940" watchObservedRunningTime="2026-07-15 21:00:39.13196429 +0000 UTC m=+90.285648811"
Jul 15 21:00:39.151725 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.151685    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f78bf7489-756p5" podStartSLOduration=1.5114256149999998 podStartE2EDuration="12.151672711s" totalImagesPullingTime="10.640247096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:39.150718654 +0000 UTC m=+90.304403177" watchObservedRunningTime="2026-07-15 21:00:39.151672711 +0000 UTC m=+90.305357232"
Jul 15 21:00:39.489500 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.489410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:39.592076 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:39.592039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:40.059876 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:40.059776    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gxdff"
Jul 15 21:00:40.120775 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:40.120729    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-9gtmz"
Jul 15 21:00:41.575999 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:41.570890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:42.119692 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:42.119640    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r" event={"ID":"79c08b8c-00d5-4187-83eb-2b4d308b5ddf","Type":"ContainerStarted","Data":"ea4950e9cee56fb8fb4096cb43c4761c79d91518981334ab5496cd5b9a3c5a4b"}
Jul 15 21:00:42.119986 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:42.119727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r" event={"ID":"79c08b8c-00d5-4187-83eb-2b4d308b5ddf","Type":"ContainerStarted","Data":"88e8243929e19f7bd964123990930ecd54775153b852c5099a471d93a150b571"}
Jul 15 21:00:42.142346 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:42.142293    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-69q9r" podStartSLOduration=9.867966393 podStartE2EDuration="12.142276581s" totalImagesPullingTime="2.274310188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:42.141249055 +0000 UTC m=+93.294933577" watchObservedRunningTime="2026-07-15 21:00:42.142276581 +0000 UTC m=+93.295961102"
Jul 15 21:00:42.964930 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:42.964888    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:42.965382 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:42.964956    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:42.970324 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:42.970300    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:43.130065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:43.130032    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:00:43.321565 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:43.321454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:43.389462 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:43.389423    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:44.043908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.043871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:44.301190 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.301091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:44.371975 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.371933    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ctnkg"]
Jul 15 21:00:44.417128 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.417100    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.419686 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.419619    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 21:00:44.419898 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.419873    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 21:00:44.420207 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.420187    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 21:00:44.420317 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.420226    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dwmzk\""
Jul 15 21:00:44.432851 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.432815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:44.460888 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.460854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461059 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.460904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-sys\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461059 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.460952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4wtp\" (UniqueName: \"kubernetes.io/projected/1859de22-2453-415e-96f7-c98435679c58-kube-api-access-t4wtp\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461153 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.461067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1859de22-2453-415e-96f7-c98435679c58-node-exporter-textfile\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461153 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.461117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461153 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.461143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1859de22-2453-415e-96f7-c98435679c58-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461296 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.461197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-node-exporter-wtmp\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461296 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.461219    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-root\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.461296 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.461258    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1859de22-2453-415e-96f7-c98435679c58-metrics-client-ca\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.557338 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.557246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:44.562297 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-node-exporter-wtmp\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-root\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1859de22-2453-415e-96f7-c98435679c58-metrics-client-ca\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-root\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-sys\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4wtp\" (UniqueName: \"kubernetes.io/projected/1859de22-2453-415e-96f7-c98435679c58-kube-api-access-t4wtp\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1859de22-2453-415e-96f7-c98435679c58-node-exporter-textfile\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562531    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-node-exporter-wtmp\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1859de22-2453-415e-96f7-c98435679c58-sys\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.562715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.562601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1859de22-2453-415e-96f7-c98435679c58-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.563020 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:44.562926    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 21:00:44.563020 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:44.562996    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls podName:1859de22-2453-415e-96f7-c98435679c58 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:45.06297871 +0000 UTC m=+96.216663211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls") pod "node-exporter-ctnkg" (UID: "1859de22-2453-415e-96f7-c98435679c58") : secret "node-exporter-tls" not found
Jul 15 21:00:44.563200 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.563177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1859de22-2453-415e-96f7-c98435679c58-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.563363 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.563216    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1859de22-2453-415e-96f7-c98435679c58-node-exporter-textfile\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.563576 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.563539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1859de22-2453-415e-96f7-c98435679c58-metrics-client-ca\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.565201 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.565176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.582263 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.582242    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4wtp\" (UniqueName: \"kubernetes.io/projected/1859de22-2453-415e-96f7-c98435679c58-kube-api-access-t4wtp\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:44.654144 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:44.654103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:45.067715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:45.067676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:45.068173 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:45.067851    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 21:00:45.068173 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:00:45.067937    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls podName:1859de22-2453-415e-96f7-c98435679c58 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:46.067917422 +0000 UTC m=+97.221601923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls") pod "node-exporter-ctnkg" (UID: "1859de22-2453-415e-96f7-c98435679c58") : secret "node-exporter-tls" not found
Jul 15 21:00:45.158398 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:45.158347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:45.264136 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:45.264094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:45.364885 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:45.364842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:45.485978 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:45.485944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:45.563146 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:45.563109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:46.079297 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:46.079257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:46.081817 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:46.081786    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1859de22-2453-415e-96f7-c98435679c58-node-exporter-tls\") pod \"node-exporter-ctnkg\" (UID: \"1859de22-2453-415e-96f7-c98435679c58\") " pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:46.114409 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:46.114369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:46.220214 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:46.220175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:46.227859 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:46.227836    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctnkg"
Jul 15 21:00:46.266106 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:46.266076    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1859de22_2453_415e_96f7_c98435679c58.slice/crio-6c901fabf869f4f3ad7e7d11e4e10ad9f812752dedd7e32c3fc3f114e9734a58 WatchSource:0}: Error finding container 6c901fabf869f4f3ad7e7d11e4e10ad9f812752dedd7e32c3fc3f114e9734a58: Status 404 returned error can't find the container with id 6c901fabf869f4f3ad7e7d11e4e10ad9f812752dedd7e32c3fc3f114e9734a58
Jul 15 21:00:47.143495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.143453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctnkg" event={"ID":"1859de22-2453-415e-96f7-c98435679c58","Type":"ContainerStarted","Data":"6c901fabf869f4f3ad7e7d11e4e10ad9f812752dedd7e32c3fc3f114e9734a58"}
Jul 15 21:00:47.527942 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.527859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:47.532932 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.532882    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"]
Jul 15 21:00:47.562373 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.562344    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:47.562515 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.562389    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"]
Jul 15 21:00:47.562515 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.562437    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:47.562515 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.562502    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:47.562742 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.562661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.566211 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.566155    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 21:00:47.566417 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.566384    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 21:00:47.567177 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.566657    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-72bcc\""
Jul 15 21:00:47.567177 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.566851    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 21:00:47.567562 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.567357    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 21:00:47.567562 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.567416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 21:00:47.567562 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.567416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2up5km02n20s9\""
Jul 15 21:00:47.567562 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.567496    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:00:47.592687 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.592662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.592810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.592691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-tls\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.592810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.592713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d2e1241-c97c-4df1-aa83-789a4e2512f3-metrics-client-ca\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.592810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.592746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-grpc-tls\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.592948 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.592823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.593002 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.592958    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.593058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.593028    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.593114 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.593061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs75h\" (UniqueName: \"kubernetes.io/projected/5d2e1241-c97c-4df1-aa83-789a4e2512f3-kube-api-access-vs75h\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.640680 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.640645    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb6985c9c-476cp"]
Jul 15 21:00:47.694399 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.694367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-grpc-tls\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.694593 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.694420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.694593 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.694472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.694593 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.694511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.695842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.694914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs75h\" (UniqueName: \"kubernetes.io/projected/5d2e1241-c97c-4df1-aa83-789a4e2512f3-kube-api-access-vs75h\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.695842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.694974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.695842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.695004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-tls\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.695842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.695035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d2e1241-c97c-4df1-aa83-789a4e2512f3-metrics-client-ca\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.695842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.695782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d2e1241-c97c-4df1-aa83-789a4e2512f3-metrics-client-ca\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.698091 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.698047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.698278 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.698250    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-tls\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.699154 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.699127    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.699404 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.699382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-grpc-tls\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.699564 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.699532    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.700773 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.700738    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d2e1241-c97c-4df1-aa83-789a4e2512f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.703996 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.703958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs75h\" (UniqueName: \"kubernetes.io/projected/5d2e1241-c97c-4df1-aa83-789a4e2512f3-kube-api-access-vs75h\") pod \"thanos-querier-dbc98fdbf-mg7zq\" (UID: \"5d2e1241-c97c-4df1-aa83-789a4e2512f3\") " pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:47.875584 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:47.875523    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:48.132279 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:48.132259    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"]
Jul 15 21:00:48.133871 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:48.133842    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d2e1241_c97c_4df1_aa83_789a4e2512f3.slice/crio-bfb721fee5ea3a6b264003ff5ca9ba96ddf4d83a5eb54fc3cd9ebea7d9a109fa WatchSource:0}: Error finding container bfb721fee5ea3a6b264003ff5ca9ba96ddf4d83a5eb54fc3cd9ebea7d9a109fa: Status 404 returned error can't find the container with id bfb721fee5ea3a6b264003ff5ca9ba96ddf4d83a5eb54fc3cd9ebea7d9a109fa
Jul 15 21:00:48.147909 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:48.147877    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctnkg" event={"ID":"1859de22-2453-415e-96f7-c98435679c58","Type":"ContainerStarted","Data":"653098e4747208897d95236be7320867123b146791c3a09c42cc51a3726abefc"}
Jul 15 21:00:48.149241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:48.149213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" event={"ID":"5d2e1241-c97c-4df1-aa83-789a4e2512f3","Type":"ContainerStarted","Data":"bfb721fee5ea3a6b264003ff5ca9ba96ddf4d83a5eb54fc3cd9ebea7d9a109fa"}
Jul 15 21:00:48.153502 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:48.153460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:48.258293 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:48.258258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:49.146911 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.146864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:49.154735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.154701    2573 generic.go:356] "Generic (PLEG): container finished" podID="1859de22-2453-415e-96f7-c98435679c58" containerID="653098e4747208897d95236be7320867123b146791c3a09c42cc51a3726abefc" exitCode=0
Jul 15 21:00:49.155157 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.154757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctnkg" event={"ID":"1859de22-2453-415e-96f7-c98435679c58","Type":"ContainerDied","Data":"653098e4747208897d95236be7320867123b146791c3a09c42cc51a3726abefc"}
Jul 15 21:00:49.224472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.224434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:49.493753 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.493711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:49.534973 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.534935    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bf59f7fdf-qpzlf"]
Jul 15 21:00:49.553711 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.553681    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf59f7fdf-qpzlf"]
Jul 15 21:00:49.553878 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.553804    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.585376 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.585340    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"]
Jul 15 21:00:49.600444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.600423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.603491 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.603469    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 21:00:49.603625 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.603493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 21:00:49.603846 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.603817    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 21:00:49.604081 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.604067    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nxf5h\""
Jul 15 21:00:49.604842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.604644    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 21:00:49.606010 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.605984    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 21:00:49.607692 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.607669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"]
Jul 15 21:00:49.609223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.609202    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 21:00:49.610773 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.610752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-service-ca\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.610868 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.610779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-config\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.610868 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.610802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cxjx\" (UniqueName: \"kubernetes.io/projected/5c272268-45a3-4bf2-bdd8-cffe0520113a-kube-api-access-6cxjx\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.610868 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.610824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-trusted-ca-bundle\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.611029 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.610932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-oauth-serving-cert\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.611029 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.610960    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-oauth-config\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.611029 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.610978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-serving-cert\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.711810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.711738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-config\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.711810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.711786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxjx\" (UniqueName: \"kubernetes.io/projected/5c272268-45a3-4bf2-bdd8-cffe0520113a-kube-api-access-6cxjx\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.712049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.711827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-telemeter-client-tls\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.711854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-trusted-ca-bundle\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.712049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.711877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-serving-certs-ca-bundle\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-federate-client-tls\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-secret-telemeter-client\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stq6z\" (UniqueName: \"kubernetes.io/projected/2a697f4c-8e49-487c-b6ad-686913e10c5a-kube-api-access-stq6z\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-oauth-serving-cert\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.712302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-oauth-config\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.712302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-serving-cert\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.712302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-metrics-client-ca\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.712662 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-service-ca\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.712662 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.712490    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-config\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.713104 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.713045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-trusted-ca-bundle\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.713104 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.713050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-service-ca\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.713390 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.713372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-oauth-serving-cert\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.715529 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.715505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-oauth-config\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.715638 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.715578    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-serving-cert\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.723850 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.723825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cxjx\" (UniqueName: \"kubernetes.io/projected/5c272268-45a3-4bf2-bdd8-cffe0520113a-kube-api-access-6cxjx\") pod \"console-bf59f7fdf-qpzlf\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") " pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.746101 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.746073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:49.813339 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-serving-certs-ca-bundle\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.813339 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-federate-client-tls\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.813636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-secret-telemeter-client\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.813636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stq6z\" (UniqueName: \"kubernetes.io/projected/2a697f4c-8e49-487c-b6ad-686913e10c5a-kube-api-access-stq6z\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.813636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.813636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-metrics-client-ca\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.813636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-telemeter-client-tls\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.813636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.813589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.814187 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.814135    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-serving-certs-ca-bundle\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.814438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.814413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-metrics-client-ca\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.814559 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.814513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a697f4c-8e49-487c-b6ad-686913e10c5a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.816512 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.816486    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.816663 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.816643    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-telemeter-client-tls\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.816723 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.816649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-federate-client-tls\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.816765 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.816724    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2a697f4c-8e49-487c-b6ad-686913e10c5a-secret-telemeter-client\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.822840 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.822816    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stq6z\" (UniqueName: \"kubernetes.io/projected/2a697f4c-8e49-487c-b6ad-686913e10c5a-kube-api-access-stq6z\") pod \"telemeter-client-7cbccc55b8-ltzc9\" (UID: \"2a697f4c-8e49-487c-b6ad-686913e10c5a\") " pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:49.846164 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.846133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:49.865060 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.865031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:00:49.911101 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:49.911070    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"
Jul 15 21:00:50.167698 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.167661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctnkg" event={"ID":"1859de22-2453-415e-96f7-c98435679c58","Type":"ContainerStarted","Data":"57f978d72d3abb8461440c43112d24b53a98f8e9a78b6f3e0ebfdba00bfb9cae"}
Jul 15 21:00:50.168095 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.167738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctnkg" event={"ID":"1859de22-2453-415e-96f7-c98435679c58","Type":"ContainerStarted","Data":"2abccaea72fc9c83f549fb48a746c6f263c5287452729255d31d1d7dbb8b6656"}
Jul 15 21:00:50.378520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.378441    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ctnkg" podStartSLOduration=4.582991372 podStartE2EDuration="6.378417318s" totalImagesPullingTime="1.703225215s" totalInitContainerRuntime="92.200731ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:50.194666496 +0000 UTC m=+101.348351019" watchObservedRunningTime="2026-07-15 21:00:50.378417318 +0000 UTC m=+101.532101841"
Jul 15 21:00:50.379518 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.379458    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf59f7fdf-qpzlf"]
Jul 15 21:00:50.382223 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:50.382198    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c272268_45a3_4bf2_bdd8_cffe0520113a.slice/crio-3d5439bad9a32888d48c3eb8daae895f16fef741d5f6ffa0dc2409c293544237 WatchSource:0}: Error finding container 3d5439bad9a32888d48c3eb8daae895f16fef741d5f6ffa0dc2409c293544237: Status 404 returned error can't find the container with id 3d5439bad9a32888d48c3eb8daae895f16fef741d5f6ffa0dc2409c293544237
Jul 15 21:00:50.395889 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:50.395864    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a697f4c_8e49_487c_b6ad_686913e10c5a.slice/crio-cd05e9f7f57a7d90da26ed9ab818398757f60f2a6cfd65923d5edee909028273 WatchSource:0}: Error finding container cd05e9f7f57a7d90da26ed9ab818398757f60f2a6cfd65923d5edee909028273: Status 404 returned error can't find the container with id cd05e9f7f57a7d90da26ed9ab818398757f60f2a6cfd65923d5edee909028273
Jul 15 21:00:50.400711 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.400690    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9"]
Jul 15 21:00:50.787902 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.787875    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:00:50.792906 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.792876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:50.814144 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.814115    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:00:50.814373 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.814275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.817468 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817149    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 21:00:50.817468 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817220    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eajlpmo95ikcr\""
Jul 15 21:00:50.817468 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817254    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 21:00:50.817468 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817148    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 21:00:50.817818 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817737    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 21:00:50.817818 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817776    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p2tbc\""
Jul 15 21:00:50.817818 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817805    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 21:00:50.817990 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817812    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 21:00:50.817990 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.817912    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 21:00:50.818307 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.818286    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 21:00:50.818307 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.818298    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 21:00:50.818883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.818863    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 21:00:50.818992 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.818906    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 21:00:50.819059 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.818994    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 21:00:50.819114 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.819066    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 21:00:50.821676 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.821652    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 21:00:50.825680 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.825486    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 21:00:50.924467 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f336e8-ff20-4715-87d9-fef641f3f3e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924608 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924608 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924693 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924693 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924693 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924661    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924693 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f336e8-ff20-4715-87d9-fef641f3f3e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.924843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.925041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.925041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.925041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-config\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.925041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924949    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqfkx\" (UniqueName: \"kubernetes.io/projected/75f336e8-ff20-4715-87d9-fef641f3f3e2-kube-api-access-mqfkx\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.925041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.924972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.925041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.925015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:50.925041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:50.925032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.025829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.025829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.025829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.025829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.025829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.025829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f336e8-ff20-4715-87d9-fef641f3f3e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.025883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026501 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026501 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026650 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026650 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026650 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-config\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqfkx\" (UniqueName: \"kubernetes.io/projected/75f336e8-ff20-4715-87d9-fef641f3f3e2-kube-api-access-mqfkx\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026734    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.026791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.027082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.027082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f336e8-ff20-4715-87d9-fef641f3f3e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.027082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.027082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.027082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.026957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.028097 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.027747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.030110 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.030076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.030810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.030790    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.031586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.031567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f336e8-ff20-4715-87d9-fef641f3f3e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.031727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.031583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.031828 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.031633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f336e8-ff20-4715-87d9-fef641f3f3e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.032317 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.032031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.032446 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.032273    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.032687 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.032665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.033759 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.033715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.034251 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.034227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f336e8-ff20-4715-87d9-fef641f3f3e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.034415 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.034392    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.035044 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.035005    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.036084 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.036062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-config\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.036176 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.036111    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f336e8-ff20-4715-87d9-fef641f3f3e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.045361 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.045341    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqfkx\" (UniqueName: \"kubernetes.io/projected/75f336e8-ff20-4715-87d9-fef641f3f3e2-kube-api-access-mqfkx\") pod \"prometheus-k8s-0\" (UID: \"75f336e8-ff20-4715-87d9-fef641f3f3e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.128526 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.128483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:00:51.177955 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.177913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9" event={"ID":"2a697f4c-8e49-487c-b6ad-686913e10c5a","Type":"ContainerStarted","Data":"cd05e9f7f57a7d90da26ed9ab818398757f60f2a6cfd65923d5edee909028273"}
Jul 15 21:00:51.180462 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.180434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" event={"ID":"5d2e1241-c97c-4df1-aa83-789a4e2512f3","Type":"ContainerStarted","Data":"2f5216b46b7535561bfd25d0119ffa0c2dc55ac7f7715b9f28452f72c7fd1b44"}
Jul 15 21:00:51.180617 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.180506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" event={"ID":"5d2e1241-c97c-4df1-aa83-789a4e2512f3","Type":"ContainerStarted","Data":"56a8f1d5a8b8fc81ba7939b9bea8a90dbe479c3ac7b574f9fc253ae33a88166b"}
Jul 15 21:00:51.180617 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.180596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" event={"ID":"5d2e1241-c97c-4df1-aa83-789a4e2512f3","Type":"ContainerStarted","Data":"1bd7e7c676eb1b92c1eb4a174b40f0ed2f2e456f6272e908a2e75ef590209d53"}
Jul 15 21:00:51.182194 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.182165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf59f7fdf-qpzlf" event={"ID":"5c272268-45a3-4bf2-bdd8-cffe0520113a","Type":"ContainerStarted","Data":"60b6f4eb312825a878645c502856aeccacd0dc7a2e55319eaae8aeda00eef2dd"}
Jul 15 21:00:51.182341 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.182212    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf59f7fdf-qpzlf" event={"ID":"5c272268-45a3-4bf2-bdd8-cffe0520113a","Type":"ContainerStarted","Data":"3d5439bad9a32888d48c3eb8daae895f16fef741d5f6ffa0dc2409c293544237"}
Jul 15 21:00:51.273490 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.273406    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:51.342052 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.342001    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bf59f7fdf-qpzlf" podStartSLOduration=2.341981441 podStartE2EDuration="2.341981441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:51.207307665 +0000 UTC m=+102.360992188" watchObservedRunningTime="2026-07-15 21:00:51.341981441 +0000 UTC m=+102.495665947"
Jul 15 21:00:51.342395 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.342370    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:00:51.342489 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:51.342425    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f336e8_ff20_4715_87d9_fef641f3f3e2.slice/crio-592da0e8f06ba8aa44ab7efc382b83285976d39fea0379e6582ac5a662869400 WatchSource:0}: Error finding container 592da0e8f06ba8aa44ab7efc382b83285976d39fea0379e6582ac5a662869400: Status 404 returned error can't find the container with id 592da0e8f06ba8aa44ab7efc382b83285976d39fea0379e6582ac5a662869400
Jul 15 21:00:51.373665 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:51.373035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:52.189448 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:52.189413    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerStarted","Data":"592da0e8f06ba8aa44ab7efc382b83285976d39fea0379e6582ac5a662869400"}
Jul 15 21:00:53.197416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:53.197379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" event={"ID":"5d2e1241-c97c-4df1-aa83-789a4e2512f3","Type":"ContainerStarted","Data":"ed41852f3c92113c72728d5d81451e8296be818c977bbb3fb27a5845284e81c0"}
Jul 15 21:00:53.197887 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:53.197457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" event={"ID":"5d2e1241-c97c-4df1-aa83-789a4e2512f3","Type":"ContainerStarted","Data":"146f00b0a6708545c30b6cfecdca5f2ff407f9c56584563671e9900482a36579"}
Jul 15 21:00:53.199135 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:53.199101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9" event={"ID":"2a697f4c-8e49-487c-b6ad-686913e10c5a","Type":"ContainerStarted","Data":"d4848ce78947d3de756452f2cceb0a0f87015024f59bb891dd60418ed3f9aa10"}
Jul 15 21:00:54.163065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.163032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:54.208724 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.208694    2573 generic.go:356] "Generic (PLEG): container finished" podID="75f336e8-ff20-4715-87d9-fef641f3f3e2" containerID="c8852ac467ac639108024dcf9369387915b763affd196938c3b9b1656503cf1f" exitCode=0
Jul 15 21:00:54.209150 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.208783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerDied","Data":"c8852ac467ac639108024dcf9369387915b763affd196938c3b9b1656503cf1f"}
Jul 15 21:00:54.211079 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.211053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9" event={"ID":"2a697f4c-8e49-487c-b6ad-686913e10c5a","Type":"ContainerStarted","Data":"b23ce3726798f176601a7b74bb189f88dd96164c2d59bd60596c534a0c2fb3ad"}
Jul 15 21:00:54.211211 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.211111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9" event={"ID":"2a697f4c-8e49-487c-b6ad-686913e10c5a","Type":"ContainerStarted","Data":"6886c9a809d4f007f39683055043c3b657538df9d2e358e00e014db73f16271e"}
Jul 15 21:00:54.214324 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.214303    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" event={"ID":"5d2e1241-c97c-4df1-aa83-789a4e2512f3","Type":"ContainerStarted","Data":"38187003ea0994162a3213dbda13bc050922fa093dcab58a80a77bb2c1c9cdd9"}
Jul 15 21:00:54.214447 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.214434    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:54.261368 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.261326    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq" podStartSLOduration=2.9609366660000003 podStartE2EDuration="7.261311364s" totalImagesPullingTime="4.300374698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:54.260785618 +0000 UTC m=+105.414470174" watchObservedRunningTime="2026-07-15 21:00:54.261311364 +0000 UTC m=+105.414995886"
Jul 15 21:00:54.268809 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.268770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:54.287860 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.287811    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cbccc55b8-ltzc9" podStartSLOduration=1.9350047959999999 podStartE2EDuration="5.287796502s" totalImagesPullingTime="3.352791706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:54.286648051 +0000 UTC m=+105.440332576" watchObservedRunningTime="2026-07-15 21:00:54.287796502 +0000 UTC m=+105.441481024"
Jul 15 21:00:54.485532 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.485495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:54.560340 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:54.560290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:00:55.031123 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.030403    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf59f7fdf-qpzlf"]
Jul 15 21:00:55.064586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.064557    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d455d57b-lf2fj"]
Jul 15 21:00:55.085651 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.085613    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d455d57b-lf2fj"]
Jul 15 21:00:55.085840 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.085739    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.167168 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.167132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-oauth-config\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.167168 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.167180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-serving-cert\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.167451 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.167287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-config\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.167451 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.167337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-service-ca\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.167664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.167462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-oauth-serving-cert\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.167664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.167509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-trusted-ca-bundle\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.167664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.167531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfbxb\" (UniqueName: \"kubernetes.io/projected/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-kube-api-access-hfbxb\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.226844 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.226820    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-dbc98fdbf-mg7zq"
Jul 15 21:00:55.269435 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.268709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-oauth-serving-cert\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.269435 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.268820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-trusted-ca-bundle\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.269435 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.268881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfbxb\" (UniqueName: \"kubernetes.io/projected/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-kube-api-access-hfbxb\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.269435 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.268975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-oauth-config\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.269435 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.269024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-serving-cert\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.269435 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.269068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-config\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.269435 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.269119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-service-ca\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.270030 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.269648    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-oauth-serving-cert\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.271308 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.270295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-trusted-ca-bundle\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.271308 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.270811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-service-ca\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.271308 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.271256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-config\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.273250 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.273228    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-oauth-config\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.273427 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.273407    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-serving-cert\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.280165 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.280140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfbxb\" (UniqueName: \"kubernetes.io/projected/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-kube-api-access-hfbxb\") pod \"console-78d455d57b-lf2fj\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") " pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.402567 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.402508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:00:55.579736 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:00:55.579701    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4cd8c9_6e7e_4d38_ba22_ee34498cfb4d.slice/crio-8eec844886ec7a0a732b7c6020b6868e74f7a5563247a3c97320f73fdfc48da7 WatchSource:0}: Error finding container 8eec844886ec7a0a732b7c6020b6868e74f7a5563247a3c97320f73fdfc48da7: Status 404 returned error can't find the container with id 8eec844886ec7a0a732b7c6020b6868e74f7a5563247a3c97320f73fdfc48da7
Jul 15 21:00:55.582309 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:55.582285    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d455d57b-lf2fj"]
Jul 15 21:00:56.229130 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:56.229094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d455d57b-lf2fj" event={"ID":"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d","Type":"ContainerStarted","Data":"fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909"}
Jul 15 21:00:56.229651 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:56.229212    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d455d57b-lf2fj" event={"ID":"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d","Type":"ContainerStarted","Data":"8eec844886ec7a0a732b7c6020b6868e74f7a5563247a3c97320f73fdfc48da7"}
Jul 15 21:00:56.249345 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:56.249296    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d455d57b-lf2fj" podStartSLOduration=1.249281976 podStartE2EDuration="1.249281976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:56.248926832 +0000 UTC m=+107.402611356" watchObservedRunningTime="2026-07-15 21:00:56.249281976 +0000 UTC m=+107.402966497"
Jul 15 21:00:59.247873 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.247836    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerStarted","Data":"226e5f1f6360e78d664fbecb823aba0df2c28f44237d0eec8831c42524fb69d4"}
Jul 15 21:00:59.248254 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.247918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerStarted","Data":"b3d6ea20be9fbaad67d82ebc59a222aceccc776c22a68bab4d91633156f76c24"}
Jul 15 21:00:59.248254 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.247957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerStarted","Data":"a88825159b17dba7e4ee7166457e723892dad7e970f39173d39493ed2ee71ba6"}
Jul 15 21:00:59.248254 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.248005    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerStarted","Data":"84ae7a17acee69d430fb4dfb929fe5851e6b64a088d1a861ca89c9408d5f7c7f"}
Jul 15 21:00:59.248254 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.248043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerStarted","Data":"3fbce688416ca915ba9e69f40d0663c6e83d44a9333631c06fa522a298c950bc"}
Jul 15 21:00:59.248254 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.248078    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f336e8-ff20-4715-87d9-fef641f3f3e2","Type":"ContainerStarted","Data":"5b257139c51d89a353c9ded1bd0c54325ec3dd450bdaa103c4d7e20655b3b634"}
Jul 15 21:00:59.282433 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.282376    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.690360903 podStartE2EDuration="9.282357699s" totalImagesPullingTime="6.57340972s" totalInitContainerRuntime="18.587076ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:59.279330169 +0000 UTC m=+110.433014692" watchObservedRunningTime="2026-07-15 21:00:59.282357699 +0000 UTC m=+110.436042220"
Jul 15 21:00:59.865833 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:00:59.865793    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:01:01.057892 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:01.057860    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hzpw7"
Jul 15 21:01:01.128952 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:01.128918    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:01:02.157375 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:02.157344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpkb2_97987fc5-dddf-4c40-ad72-043b5e16f9ea/serve-healthcheck-canary/0.log"
Jul 15 21:01:05.403367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:05.403334    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:01:05.403797 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:05.403385    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:01:05.408248 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:05.408227    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:01:06.280653 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:06.280625    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:01:06.335758 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:06.335725    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f78bf7489-756p5"]
Jul 15 21:01:06.457922 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:06.457880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:01:06.556751 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:06.556660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:01:06.633167 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:06.633133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:01:09.502390 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:09.502350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:01:09.598357 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:09.598319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:01:12.666522 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:12.666479    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bb6985c9c-476cp" podUID="b6f7395f-e98d-42fa-99eb-551989c8dcc8" containerName="console" containerID="cri-o://cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c" gracePeriod=15
Jul 15 21:01:12.918572 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:12.918492    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:01:13.040326 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040293    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6fv7\" (UniqueName: \"kubernetes.io/projected/b6f7395f-e98d-42fa-99eb-551989c8dcc8-kube-api-access-m6fv7\") pod \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") "
Jul 15 21:01:13.040586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040343    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-serving-cert\") pod \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") "
Jul 15 21:01:13.040586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040367    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-oauth-config\") pod \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") "
Jul 15 21:01:13.040586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040407    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-config\") pod \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") "
Jul 15 21:01:13.040586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040426    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-service-ca\") pod \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") "
Jul 15 21:01:13.040586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040452    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-oauth-serving-cert\") pod \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\" (UID: \"b6f7395f-e98d-42fa-99eb-551989c8dcc8\") "
Jul 15 21:01:13.040873 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040801    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6f7395f-e98d-42fa-99eb-551989c8dcc8" (UID: "b6f7395f-e98d-42fa-99eb-551989c8dcc8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:13.040967 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.040937    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6f7395f-e98d-42fa-99eb-551989c8dcc8" (UID: "b6f7395f-e98d-42fa-99eb-551989c8dcc8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:13.041067 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.041044    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-config" (OuterVolumeSpecName: "console-config") pod "b6f7395f-e98d-42fa-99eb-551989c8dcc8" (UID: "b6f7395f-e98d-42fa-99eb-551989c8dcc8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:13.042780 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.042755    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f7395f-e98d-42fa-99eb-551989c8dcc8-kube-api-access-m6fv7" (OuterVolumeSpecName: "kube-api-access-m6fv7") pod "b6f7395f-e98d-42fa-99eb-551989c8dcc8" (UID: "b6f7395f-e98d-42fa-99eb-551989c8dcc8"). InnerVolumeSpecName "kube-api-access-m6fv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:01:13.042780 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.042768    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6f7395f-e98d-42fa-99eb-551989c8dcc8" (UID: "b6f7395f-e98d-42fa-99eb-551989c8dcc8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:01:13.042959 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.042943    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6f7395f-e98d-42fa-99eb-551989c8dcc8" (UID: "b6f7395f-e98d-42fa-99eb-551989c8dcc8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:01:13.141165 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.141131    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-oauth-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:13.141165 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.141162    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:13.141165 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.141173    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:13.141384 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.141182    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f7395f-e98d-42fa-99eb-551989c8dcc8-oauth-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:13.141384 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.141192    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6fv7\" (UniqueName: \"kubernetes.io/projected/b6f7395f-e98d-42fa-99eb-551989c8dcc8-kube-api-access-m6fv7\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:13.141384 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.141201    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f7395f-e98d-42fa-99eb-551989c8dcc8-console-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:13.306184 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.306023    2573 generic.go:356] "Generic (PLEG): container finished" podID="b6f7395f-e98d-42fa-99eb-551989c8dcc8" containerID="cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c" exitCode=0
Jul 15 21:01:13.306184 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.306071    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6985c9c-476cp"
Jul 15 21:01:13.306184 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.306077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6985c9c-476cp" event={"ID":"b6f7395f-e98d-42fa-99eb-551989c8dcc8","Type":"ContainerDied","Data":"cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c"}
Jul 15 21:01:13.306184 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.306123    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6985c9c-476cp" event={"ID":"b6f7395f-e98d-42fa-99eb-551989c8dcc8","Type":"ContainerDied","Data":"63927643c5e4a361ac55ef58e9a8d6c9247c471112b4dac54c8aedb3684ae71c"}
Jul 15 21:01:13.306184 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.306150    2573 scope.go:117] "RemoveContainer" containerID="cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c"
Jul 15 21:01:13.317060 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.317040    2573 scope.go:117] "RemoveContainer" containerID="cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c"
Jul 15 21:01:13.317363 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:01:13.317334    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c\": container with ID starting with cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c not found: ID does not exist" containerID="cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c"
Jul 15 21:01:13.317427 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.317373    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c"} err="failed to get container status \"cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c\": rpc error: code = NotFound desc = could not find container \"cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c\": container with ID starting with cec31823fb47864a5e98b3c1e9e52e237fbf74d4dfd15e697311e1a6bc37279c not found: ID does not exist"
Jul 15 21:01:13.329063 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.329034    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb6985c9c-476cp"]
Jul 15 21:01:13.333148 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.333122    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb6985c9c-476cp"]
Jul 15 21:01:13.575932 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:13.575837    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f7395f-e98d-42fa-99eb-551989c8dcc8" path="/var/lib/kubelet/pods/b6f7395f-e98d-42fa-99eb-551989c8dcc8/volumes"
Jul 15 21:01:20.056832 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.056791    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bf59f7fdf-qpzlf" podUID="5c272268-45a3-4bf2-bdd8-cffe0520113a" containerName="console" containerID="cri-o://60b6f4eb312825a878645c502856aeccacd0dc7a2e55319eaae8aeda00eef2dd" gracePeriod=15
Jul 15 21:01:20.340004 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.339972    2573 generic.go:356] "Generic (PLEG): container finished" podID="5c272268-45a3-4bf2-bdd8-cffe0520113a" containerID="60b6f4eb312825a878645c502856aeccacd0dc7a2e55319eaae8aeda00eef2dd" exitCode=0
Jul 15 21:01:20.340159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.340016    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf59f7fdf-qpzlf" event={"ID":"5c272268-45a3-4bf2-bdd8-cffe0520113a","Type":"ContainerDied","Data":"60b6f4eb312825a878645c502856aeccacd0dc7a2e55319eaae8aeda00eef2dd"}
Jul 15 21:01:20.340159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.340083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf59f7fdf-qpzlf" event={"ID":"5c272268-45a3-4bf2-bdd8-cffe0520113a","Type":"ContainerDied","Data":"3d5439bad9a32888d48c3eb8daae895f16fef741d5f6ffa0dc2409c293544237"}
Jul 15 21:01:20.340159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.340098    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d5439bad9a32888d48c3eb8daae895f16fef741d5f6ffa0dc2409c293544237"
Jul 15 21:01:20.341518 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.341503    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:01:20.405180 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405146    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-trusted-ca-bundle\") pod \"5c272268-45a3-4bf2-bdd8-cffe0520113a\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") "
Jul 15 21:01:20.405359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405195    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-config\") pod \"5c272268-45a3-4bf2-bdd8-cffe0520113a\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") "
Jul 15 21:01:20.405359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405233    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-service-ca\") pod \"5c272268-45a3-4bf2-bdd8-cffe0520113a\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") "
Jul 15 21:01:20.405359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-oauth-config\") pod \"5c272268-45a3-4bf2-bdd8-cffe0520113a\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") "
Jul 15 21:01:20.405359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-serving-cert\") pod \"5c272268-45a3-4bf2-bdd8-cffe0520113a\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") "
Jul 15 21:01:20.405359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405301    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cxjx\" (UniqueName: \"kubernetes.io/projected/5c272268-45a3-4bf2-bdd8-cffe0520113a-kube-api-access-6cxjx\") pod \"5c272268-45a3-4bf2-bdd8-cffe0520113a\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") "
Jul 15 21:01:20.405359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405329    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-oauth-serving-cert\") pod \"5c272268-45a3-4bf2-bdd8-cffe0520113a\" (UID: \"5c272268-45a3-4bf2-bdd8-cffe0520113a\") "
Jul 15 21:01:20.405659 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405590    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c272268-45a3-4bf2-bdd8-cffe0520113a" (UID: "5c272268-45a3-4bf2-bdd8-cffe0520113a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:20.405718 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.405695    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c272268-45a3-4bf2-bdd8-cffe0520113a" (UID: "5c272268-45a3-4bf2-bdd8-cffe0520113a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:20.407582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.406175    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-config" (OuterVolumeSpecName: "console-config") pod "5c272268-45a3-4bf2-bdd8-cffe0520113a" (UID: "5c272268-45a3-4bf2-bdd8-cffe0520113a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:20.407582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.406294    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c272268-45a3-4bf2-bdd8-cffe0520113a" (UID: "5c272268-45a3-4bf2-bdd8-cffe0520113a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:20.412499 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.412443    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c272268-45a3-4bf2-bdd8-cffe0520113a" (UID: "5c272268-45a3-4bf2-bdd8-cffe0520113a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:01:20.412646 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.412580    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c272268-45a3-4bf2-bdd8-cffe0520113a" (UID: "5c272268-45a3-4bf2-bdd8-cffe0520113a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:01:20.412646 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.412605    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c272268-45a3-4bf2-bdd8-cffe0520113a-kube-api-access-6cxjx" (OuterVolumeSpecName: "kube-api-access-6cxjx") pod "5c272268-45a3-4bf2-bdd8-cffe0520113a" (UID: "5c272268-45a3-4bf2-bdd8-cffe0520113a"). InnerVolumeSpecName "kube-api-access-6cxjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:01:20.506681 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.506648    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:20.506681 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.506679    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-oauth-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:20.506681 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.506689    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:20.506901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.506698    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cxjx\" (UniqueName: \"kubernetes.io/projected/5c272268-45a3-4bf2-bdd8-cffe0520113a-kube-api-access-6cxjx\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:20.506901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.506707    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-oauth-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:20.506901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.506715    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-trusted-ca-bundle\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:20.506901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:20.506723    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c272268-45a3-4bf2-bdd8-cffe0520113a-console-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:21.343876 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:21.343847    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf59f7fdf-qpzlf"
Jul 15 21:01:21.372777 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:21.372748    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf59f7fdf-qpzlf"]
Jul 15 21:01:21.375224 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:21.375207    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bf59f7fdf-qpzlf"]
Jul 15 21:01:21.573860 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:21.573823    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c272268-45a3-4bf2-bdd8-cffe0520113a" path="/var/lib/kubelet/pods/5c272268-45a3-4bf2-bdd8-cffe0520113a/volumes"
Jul 15 21:01:25.007610 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:25.007564    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:01:31.359625 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.359580    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f78bf7489-756p5" podUID="14753fb3-f04b-4b61-870f-ef72db382d47" containerName="console" containerID="cri-o://b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4" gracePeriod=15
Jul 15 21:01:31.626515 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.626462    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:01:31.694649 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.694619    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-serving-cert\") pod \"14753fb3-f04b-4b61-870f-ef72db382d47\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") "
Jul 15 21:01:31.694809 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.694664    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-service-ca\") pod \"14753fb3-f04b-4b61-870f-ef72db382d47\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") "
Jul 15 21:01:31.694809 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.694687    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-oauth-serving-cert\") pod \"14753fb3-f04b-4b61-870f-ef72db382d47\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") "
Jul 15 21:01:31.694809 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.694713    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-console-config\") pod \"14753fb3-f04b-4b61-870f-ef72db382d47\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") "
Jul 15 21:01:31.694809 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.694745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-oauth-config\") pod \"14753fb3-f04b-4b61-870f-ef72db382d47\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") "
Jul 15 21:01:31.694974 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.694943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmwk2\" (UniqueName: \"kubernetes.io/projected/14753fb3-f04b-4b61-870f-ef72db382d47-kube-api-access-bmwk2\") pod \"14753fb3-f04b-4b61-870f-ef72db382d47\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") "
Jul 15 21:01:31.695008 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.694988    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-trusted-ca-bundle\") pod \"14753fb3-f04b-4b61-870f-ef72db382d47\" (UID: \"14753fb3-f04b-4b61-870f-ef72db382d47\") "
Jul 15 21:01:31.695105 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.695076    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14753fb3-f04b-4b61-870f-ef72db382d47" (UID: "14753fb3-f04b-4b61-870f-ef72db382d47"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:31.695151 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.695089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-service-ca" (OuterVolumeSpecName: "service-ca") pod "14753fb3-f04b-4b61-870f-ef72db382d47" (UID: "14753fb3-f04b-4b61-870f-ef72db382d47"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:31.695190 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.695171    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-console-config" (OuterVolumeSpecName: "console-config") pod "14753fb3-f04b-4b61-870f-ef72db382d47" (UID: "14753fb3-f04b-4b61-870f-ef72db382d47"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:31.695410 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.695390    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14753fb3-f04b-4b61-870f-ef72db382d47" (UID: "14753fb3-f04b-4b61-870f-ef72db382d47"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:01:31.695497 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.695420    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:31.695497 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.695441    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-oauth-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:31.695497 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.695455    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-console-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:31.697061 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.697040    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14753fb3-f04b-4b61-870f-ef72db382d47-kube-api-access-bmwk2" (OuterVolumeSpecName: "kube-api-access-bmwk2") pod "14753fb3-f04b-4b61-870f-ef72db382d47" (UID: "14753fb3-f04b-4b61-870f-ef72db382d47"). InnerVolumeSpecName "kube-api-access-bmwk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:01:31.697157 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.697055    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14753fb3-f04b-4b61-870f-ef72db382d47" (UID: "14753fb3-f04b-4b61-870f-ef72db382d47"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:01:31.697157 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.697107    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14753fb3-f04b-4b61-870f-ef72db382d47" (UID: "14753fb3-f04b-4b61-870f-ef72db382d47"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:01:31.796827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.796794    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-oauth-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:31.796827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.796823    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmwk2\" (UniqueName: \"kubernetes.io/projected/14753fb3-f04b-4b61-870f-ef72db382d47-kube-api-access-bmwk2\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:31.796827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.796834    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14753fb3-f04b-4b61-870f-ef72db382d47-trusted-ca-bundle\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:31.797039 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:31.796843    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14753fb3-f04b-4b61-870f-ef72db382d47-console-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:01:32.405876 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.405819    2573 generic.go:356] "Generic (PLEG): container finished" podID="14753fb3-f04b-4b61-870f-ef72db382d47" containerID="b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4" exitCode=0
Jul 15 21:01:32.405876 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.405868    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f78bf7489-756p5"
Jul 15 21:01:32.406363 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.405902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f78bf7489-756p5" event={"ID":"14753fb3-f04b-4b61-870f-ef72db382d47","Type":"ContainerDied","Data":"b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4"}
Jul 15 21:01:32.406363 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.405954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f78bf7489-756p5" event={"ID":"14753fb3-f04b-4b61-870f-ef72db382d47","Type":"ContainerDied","Data":"ed561ac1ad743a8319a6e6bcb11a1b472106daecaa8257e19fb721774bc1c430"}
Jul 15 21:01:32.406363 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.405975    2573 scope.go:117] "RemoveContainer" containerID="b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4"
Jul 15 21:01:32.414395 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.414381    2573 scope.go:117] "RemoveContainer" containerID="b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4"
Jul 15 21:01:32.414642 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:01:32.414625    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4\": container with ID starting with b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4 not found: ID does not exist" containerID="b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4"
Jul 15 21:01:32.414702 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.414648    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4"} err="failed to get container status \"b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4\": rpc error: code = NotFound desc = could not find container \"b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4\": container with ID starting with b9cc7f03b06a055e1ab21e2c54c07bc6b9fe544a35b0c886c3ed27e7e7c5f9a4 not found: ID does not exist"
Jul 15 21:01:32.427243 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.427224    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f78bf7489-756p5"]
Jul 15 21:01:32.433389 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:32.433369    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f78bf7489-756p5"]
Jul 15 21:01:33.574272 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:33.574237    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14753fb3-f04b-4b61-870f-ef72db382d47" path="/var/lib/kubelet/pods/14753fb3-f04b-4b61-870f-ef72db382d47/volumes"
Jul 15 21:01:51.129318 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:51.129267    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:01:51.152374 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:51.152345    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:01:51.492982 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:51.492900    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:01:58.305869 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:01:58.305832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:00.659049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:00.659003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:00.760381 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:00.760345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:01.213685 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.213656    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7567d6b666-f6xqb"]
Jul 15 21:02:01.213954 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.213943    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c272268-45a3-4bf2-bdd8-cffe0520113a" containerName="console"
Jul 15 21:02:01.214000 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.213956    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c272268-45a3-4bf2-bdd8-cffe0520113a" containerName="console"
Jul 15 21:02:01.214000 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.213970    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14753fb3-f04b-4b61-870f-ef72db382d47" containerName="console"
Jul 15 21:02:01.214000 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.213975    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="14753fb3-f04b-4b61-870f-ef72db382d47" containerName="console"
Jul 15 21:02:01.214000 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.213984    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f7395f-e98d-42fa-99eb-551989c8dcc8" containerName="console"
Jul 15 21:02:01.214000 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.213990    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f7395f-e98d-42fa-99eb-551989c8dcc8" containerName="console"
Jul 15 21:02:01.214167 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.214042    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f7395f-e98d-42fa-99eb-551989c8dcc8" containerName="console"
Jul 15 21:02:01.214167 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.214049    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="14753fb3-f04b-4b61-870f-ef72db382d47" containerName="console"
Jul 15 21:02:01.214167 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.214057    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c272268-45a3-4bf2-bdd8-cffe0520113a" containerName="console"
Jul 15 21:02:01.215875 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.215858    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.228338 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.228315    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7567d6b666-f6xqb"]
Jul 15 21:02:01.276789 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.276745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:01.350234 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.350164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-trusted-ca-bundle\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.350234 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.350202    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-console-config\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.350418 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.350289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-serving-cert\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.350418 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.350322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-oauth-config\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.350418 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.350345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-service-ca\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.350597 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.350447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrnl\" (UniqueName: \"kubernetes.io/projected/59be788e-7d32-44a8-a111-8c43c2abed46-kube-api-access-9mrnl\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.350597 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.350496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-oauth-serving-cert\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.353233 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.353208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:01.451524 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.451492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-trusted-ca-bundle\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.451709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.451534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-console-config\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.451709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.451602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-serving-cert\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.451709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.451628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-oauth-config\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.451709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.451670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-service-ca\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.451903 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.451722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrnl\" (UniqueName: \"kubernetes.io/projected/59be788e-7d32-44a8-a111-8c43c2abed46-kube-api-access-9mrnl\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.451903 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.451754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-oauth-serving-cert\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.452398 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.452373    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-console-config\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.452506 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.452463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-oauth-serving-cert\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.452506 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.452469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-service-ca\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.452617 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.452538    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-trusted-ca-bundle\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.454574 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.454541    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-oauth-config\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.454820 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.454799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-serving-cert\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.464182 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.464112    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrnl\" (UniqueName: \"kubernetes.io/projected/59be788e-7d32-44a8-a111-8c43c2abed46-kube-api-access-9mrnl\") pod \"console-7567d6b666-f6xqb\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") " pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.525065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.525028    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:01.659508 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:02:01.659473    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59be788e_7d32_44a8_a111_8c43c2abed46.slice/crio-1f1d394f966baf78b621293cc0622addfe4bc74bcbe28732a2f6390f08e78648 WatchSource:0}: Error finding container 1f1d394f966baf78b621293cc0622addfe4bc74bcbe28732a2f6390f08e78648: Status 404 returned error can't find the container with id 1f1d394f966baf78b621293cc0622addfe4bc74bcbe28732a2f6390f08e78648
Jul 15 21:02:01.659824 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:01.659636    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7567d6b666-f6xqb"]
Jul 15 21:02:02.523297 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:02.523264    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d6b666-f6xqb" event={"ID":"59be788e-7d32-44a8-a111-8c43c2abed46","Type":"ContainerStarted","Data":"58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea"}
Jul 15 21:02:02.523444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:02.523313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d6b666-f6xqb" event={"ID":"59be788e-7d32-44a8-a111-8c43c2abed46","Type":"ContainerStarted","Data":"1f1d394f966baf78b621293cc0622addfe4bc74bcbe28732a2f6390f08e78648"}
Jul 15 21:02:02.543438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:02.543388    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7567d6b666-f6xqb" podStartSLOduration=1.543372992 podStartE2EDuration="1.543372992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:02.54205113 +0000 UTC m=+173.695735652" watchObservedRunningTime="2026-07-15 21:02:02.543372992 +0000 UTC m=+173.697057512"
Jul 15 21:02:04.191437 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:04.191395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:04.335399 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:04.335363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:11.525309 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:11.525279    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:11.525711 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:11.525341    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:11.529988 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:11.529969    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:11.563770 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:11.563750    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:02:11.623730 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:11.623704    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d455d57b-lf2fj"]
Jul 15 21:02:11.801812 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:11.801721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:11.879624 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:11.879583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:12.719249 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:12.719214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:12.780701 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:12.780667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:24.490699 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:24.490655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:24.591792 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:24.591748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:32.324455 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:32.324410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:32.389154 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:32.389110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:36.644013 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.643978    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78d455d57b-lf2fj" podUID="cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" containerName="console" containerID="cri-o://fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909" gracePeriod=15
Jul 15 21:02:36.888511 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.888488    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:02:36.961356 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-oauth-config\") pod \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") "
Jul 15 21:02:36.961356 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961334    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-config\") pod \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") "
Jul 15 21:02:36.961606 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-oauth-serving-cert\") pod \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") "
Jul 15 21:02:36.961606 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfbxb\" (UniqueName: \"kubernetes.io/projected/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-kube-api-access-hfbxb\") pod \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") "
Jul 15 21:02:36.961606 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961493    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-serving-cert\") pod \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") "
Jul 15 21:02:36.961606 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961571    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-service-ca\") pod \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") "
Jul 15 21:02:36.961606 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961601    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-trusted-ca-bundle\") pod \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\" (UID: \"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d\") "
Jul 15 21:02:36.961877 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961788    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-config" (OuterVolumeSpecName: "console-config") pod "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" (UID: "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:02:36.961934 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961907    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" (UID: "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:02:36.961995 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.961958    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" (UID: "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:02:36.962120 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.962100    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" (UID: "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:02:36.963651 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.963622    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" (UID: "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:02:36.963928 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.963903    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" (UID: "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:02:36.964015 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:36.963928    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-kube-api-access-hfbxb" (OuterVolumeSpecName: "kube-api-access-hfbxb") pod "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" (UID: "cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d"). InnerVolumeSpecName "kube-api-access-hfbxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:02:37.062357 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.062323    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-oauth-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:02:37.062357 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.062350    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:02:37.062357 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.062360    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-oauth-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:02:37.062618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.062370    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfbxb\" (UniqueName: \"kubernetes.io/projected/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-kube-api-access-hfbxb\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:02:37.062618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.062379    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-console-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:02:37.062618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.062388    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:02:37.062618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.062396    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d-trusted-ca-bundle\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:02:37.659358 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.659323    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" containerID="fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909" exitCode=0
Jul 15 21:02:37.659783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.659367    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d455d57b-lf2fj"
Jul 15 21:02:37.659783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.659401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d455d57b-lf2fj" event={"ID":"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d","Type":"ContainerDied","Data":"fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909"}
Jul 15 21:02:37.659783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.659454    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d455d57b-lf2fj" event={"ID":"cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d","Type":"ContainerDied","Data":"8eec844886ec7a0a732b7c6020b6868e74f7a5563247a3c97320f73fdfc48da7"}
Jul 15 21:02:37.659783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.659484    2573 scope.go:117] "RemoveContainer" containerID="fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909"
Jul 15 21:02:37.668088 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.668073    2573 scope.go:117] "RemoveContainer" containerID="fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909"
Jul 15 21:02:37.668367 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:02:37.668344    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909\": container with ID starting with fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909 not found: ID does not exist" containerID="fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909"
Jul 15 21:02:37.668415 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.668384    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909"} err="failed to get container status \"fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909\": rpc error: code = NotFound desc = could not find container \"fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909\": container with ID starting with fefeedcf26f13d7537d4a3fafedb79a4e4571eca01789f2ee2ff322264a39909 not found: ID does not exist"
Jul 15 21:02:37.677071 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.677046    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d455d57b-lf2fj"]
Jul 15 21:02:37.678639 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:37.678622    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d455d57b-lf2fj"]
Jul 15 21:02:39.573592 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:39.573543    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" path="/var/lib/kubelet/pods/cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d/volumes"
Jul 15 21:02:55.225518 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:55.225481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:02:55.317391 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:02:55.317354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:22.116920 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:22.116884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:23.092097 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:23.092059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:25.919070 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:25.919037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:26.022572 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:26.022512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:28.382183 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:28.382151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:28.488209 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:28.488168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:29.157449 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:29.157414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:29.349572 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:29.349520    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:30.197077 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:30.197040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:30.814248 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:30.814211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:32.322967 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:32.322883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:32.415756 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:32.415725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:39.651490 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:39.651459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:42.320333 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:42.320294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:42.411074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:42.411038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:44.886737 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:44.886697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:44.997100 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:44.997065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:47.615082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:47.615049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:47.712103 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:47.712065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:03:49.729835 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:03:49.729798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:05.520822 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:05.520767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:05.610397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:05.610363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:06.190945 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.190908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:06.568652 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.568562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:06.663122 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.663087    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:06.717052 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.717022    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"]
Jul 15 21:04:06.717342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.717329    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" containerName="console"
Jul 15 21:04:06.717392 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.717343    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" containerName="console"
Jul 15 21:04:06.717430 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.717396    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd4cd8c9-6e7e-4d38-ba22-ee34498cfb4d" containerName="console"
Jul 15 21:04:06.719495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.719475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.724584 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.724542    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 21:04:06.724712 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.724582    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lktzz\""
Jul 15 21:04:06.724712 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.724695    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 21:04:06.724830 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.724771    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 21:04:06.725191 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.725176    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 21:04:06.739539 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.739518    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"]
Jul 15 21:04:06.815441 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.815408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.815441 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.815449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-tmp\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.815689 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.815470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-manifests\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.815689 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.815489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.815689 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.815513    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc5gs\" (UniqueName: \"kubernetes.io/projected/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-kube-api-access-nc5gs\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.890320 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.890290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:06.916441 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.916413    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.916580 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.916448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc5gs\" (UniqueName: \"kubernetes.io/projected/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-kube-api-access-nc5gs\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.916580 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.916506    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.916580 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.916533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-tmp\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.916580 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.916579    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-manifests\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.917017 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.916993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-manifests\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.918864 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.918842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-tmp\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.919070 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.919052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.919130 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.919115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.926599 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.926578    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc5gs\" (UniqueName: \"kubernetes.io/projected/5b5fc402-f0a4-4087-a7f7-7bc952836dc3-kube-api-access-nc5gs\") pod \"opendatahub-operator-controller-manager-74776f8bd9-9pmkx\" (UID: \"5b5fc402-f0a4-4087-a7f7-7bc952836dc3\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:06.982961 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:06.982930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:07.029148 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:07.029118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:07.089347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:07.089308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:07.164042 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:07.164020    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"]
Jul 15 21:04:07.166701 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:04:07.166672    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5fc402_f0a4_4087_a7f7_7bc952836dc3.slice/crio-eee2abfcefe33fe04b51c6153d38fe20e9db81675cd0c17702da833990181655 WatchSource:0}: Error finding container eee2abfcefe33fe04b51c6153d38fe20e9db81675cd0c17702da833990181655: Status 404 returned error can't find the container with id eee2abfcefe33fe04b51c6153d38fe20e9db81675cd0c17702da833990181655
Jul 15 21:04:07.168393 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:07.168364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:07.261222 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:07.261194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:07.359826 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:07.359782    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:08.009877 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:08.009842    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx" event={"ID":"5b5fc402-f0a4-4087-a7f7-7bc952836dc3","Type":"ContainerStarted","Data":"eee2abfcefe33fe04b51c6153d38fe20e9db81675cd0c17702da833990181655"}
Jul 15 21:04:10.176273 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:10.176244    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:04:10.177673 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:10.176456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:04:10.183104 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:10.183087    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 21:04:11.027061 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:11.027027    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx" event={"ID":"5b5fc402-f0a4-4087-a7f7-7bc952836dc3","Type":"ContainerStarted","Data":"34646e76bddcffab706374156d53bd37989354deb42beaf0992f60b7bd1e1edb"}
Jul 15 21:04:12.032718 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:12.032680    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b5fc402-f0a4-4087-a7f7-7bc952836dc3" containerID="34646e76bddcffab706374156d53bd37989354deb42beaf0992f60b7bd1e1edb" exitCode=0
Jul 15 21:04:12.033133 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:12.032767    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx" event={"ID":"5b5fc402-f0a4-4087-a7f7-7bc952836dc3","Type":"ContainerDied","Data":"34646e76bddcffab706374156d53bd37989354deb42beaf0992f60b7bd1e1edb"}
Jul 15 21:04:12.033238 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:12.033222    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:04:13.039624 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:13.039586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx" event={"ID":"5b5fc402-f0a4-4087-a7f7-7bc952836dc3","Type":"ContainerStarted","Data":"7d487bf43cf5697637c40b9fab3297491d07ac283b42d414b664f964cae23ba8"}
Jul 15 21:04:13.040088 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:13.039721    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:13.065274 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:13.065230    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx" podStartSLOduration=2.496158846 podStartE2EDuration="7.065212071s" totalImagesPullingTime="3.49305737s" totalInitContainerRuntime="1.075995855s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:13.063357626 +0000 UTC m=+304.217042148" watchObservedRunningTime="2026-07-15 21:04:13.065212071 +0000 UTC m=+304.218896594"
Jul 15 21:04:24.045985 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:24.045956    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-9pmkx"
Jul 15 21:04:25.861465 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:25.861422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:26.658650 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.658617    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"]
Jul 15 21:04:26.668161 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.668136    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.673066 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.673041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 21:04:26.673204 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.673043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 21:04:26.673204 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.673185    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 21:04:26.673292 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.673232    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 21:04:26.673338 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.673329    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6rzmb\""
Jul 15 21:04:26.695176 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.695146    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"]
Jul 15 21:04:26.790396 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.790363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2451d1da-3306-4bab-abb4-71bfbcdd142d-tls-certs\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.790396 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.790397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clmtn\" (UniqueName: \"kubernetes.io/projected/2451d1da-3306-4bab-abb4-71bfbcdd142d-kube-api-access-clmtn\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.790633 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.790468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2451d1da-3306-4bab-abb4-71bfbcdd142d-tmp\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.868535 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.868504    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sl25l"]
Jul 15 21:04:26.870690 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.870673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:26.874189 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.874168    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 21:04:26.874459 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.874435    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hx6tz\""
Jul 15 21:04:26.884909 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.884890    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sl25l"]
Jul 15 21:04:26.891381 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.891359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2451d1da-3306-4bab-abb4-71bfbcdd142d-tls-certs\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.891506 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.891397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clmtn\" (UniqueName: \"kubernetes.io/projected/2451d1da-3306-4bab-abb4-71bfbcdd142d-kube-api-access-clmtn\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.891506 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.891476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2451d1da-3306-4bab-abb4-71bfbcdd142d-tmp\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.893727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.893707    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2451d1da-3306-4bab-abb4-71bfbcdd142d-tmp\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.893950 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.893931    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2451d1da-3306-4bab-abb4-71bfbcdd142d-tls-certs\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.909154 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.909100    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clmtn\" (UniqueName: \"kubernetes.io/projected/2451d1da-3306-4bab-abb4-71bfbcdd142d-kube-api-access-clmtn\") pod \"kube-auth-proxy-55c97b5545-gggjh\" (UID: \"2451d1da-3306-4bab-abb4-71bfbcdd142d\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.977778 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.977733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"
Jul 15 21:04:26.993011 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.992939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:26.993152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:26.993041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2vb\" (UniqueName: \"kubernetes.io/projected/f2663829-3ae6-4f97-a24a-5db85e09e7b8-kube-api-access-bf2vb\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:27.093635 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.093586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:27.093810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.093691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2vb\" (UniqueName: \"kubernetes.io/projected/f2663829-3ae6-4f97-a24a-5db85e09e7b8-kube-api-access-bf2vb\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:27.093810 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:04:27.093734    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 21:04:27.093923 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:04:27.093847    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert podName:f2663829-3ae6-4f97-a24a-5db85e09e7b8 nodeName:}" failed. No retries permitted until 2026-07-15 21:04:27.593826779 +0000 UTC m=+318.747511281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert") pod "odh-model-controller-7998c67dc4-sl25l" (UID: "f2663829-3ae6-4f97-a24a-5db85e09e7b8") : secret "odh-model-controller-webhook-cert" not found
Jul 15 21:04:27.107820 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.107796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2vb\" (UniqueName: \"kubernetes.io/projected/f2663829-3ae6-4f97-a24a-5db85e09e7b8-kube-api-access-bf2vb\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:27.126883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.126864    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c97b5545-gggjh"]
Jul 15 21:04:27.127672 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:04:27.127651    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2451d1da_3306_4bab_abb4_71bfbcdd142d.slice/crio-2e1c86344e7507e5f5ea7ba1bbb38e1a4d44afc39e62c6283f68d00ae5ec7aaa WatchSource:0}: Error finding container 2e1c86344e7507e5f5ea7ba1bbb38e1a4d44afc39e62c6283f68d00ae5ec7aaa: Status 404 returned error can't find the container with id 2e1c86344e7507e5f5ea7ba1bbb38e1a4d44afc39e62c6283f68d00ae5ec7aaa
Jul 15 21:04:27.600967 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.600933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:27.601139 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:04:27.601082    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 21:04:27.601183 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:04:27.601142    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert podName:f2663829-3ae6-4f97-a24a-5db85e09e7b8 nodeName:}" failed. No retries permitted until 2026-07-15 21:04:28.601125979 +0000 UTC m=+319.754810480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert") pod "odh-model-controller-7998c67dc4-sl25l" (UID: "f2663829-3ae6-4f97-a24a-5db85e09e7b8") : secret "odh-model-controller-webhook-cert" not found
Jul 15 21:04:27.742220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.742185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:27.854159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.854078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:27.994019 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:27.993990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:28.011513 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.011485    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"]
Jul 15 21:04:28.013721 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.013695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.016866 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.016845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 21:04:28.016976 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.016847    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 21:04:28.017911 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.017892    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 21:04:28.019314 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.019295    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5ltlj\""
Jul 15 21:04:28.020709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.020690    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 21:04:28.042462 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.042322    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"]
Jul 15 21:04:28.082881 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.082795    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:28.105877 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.105806    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnmmn\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-kube-api-access-dnmmn\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.105877 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.105861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-cacerts\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.106094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.105925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-token\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.106094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.105957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.106094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.105982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.106094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.106015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.106094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.106055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-local-certs\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.106896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.106872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh" event={"ID":"2451d1da-3306-4bab-abb4-71bfbcdd142d","Type":"ContainerStarted","Data":"2e1c86344e7507e5f5ea7ba1bbb38e1a4d44afc39e62c6283f68d00ae5ec7aaa"}
Jul 15 21:04:28.182282 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.182244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:28.207404 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.207377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.207586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.207419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-local-certs\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.207586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.207489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnmmn\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-kube-api-access-dnmmn\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.207586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.207526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-cacerts\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.207759 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.207593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-token\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.207759 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.207624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.207870 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.207842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.208119 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.208087    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.210348 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.210316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-local-certs\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.210444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.210318    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.210748 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.210727    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-cacerts\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.211334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.211311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.229041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.229017    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-token\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.229287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.229265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnmmn\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-kube-api-access-dnmmn\") pod \"istiod-openshift-gateway-7574459656-hppnw\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.325094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.325062    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:28.464274 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.464234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:28.476076 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.476054    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"]
Jul 15 21:04:28.477847 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:04:28.477823    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e8acdb_3bfb_4f3c_ae5a_e4d92b266467.slice/crio-536730ec70e0c609ee6719f498df9fc57b6b806a5196dc507791e7e55e40e93b WatchSource:0}: Error finding container 536730ec70e0c609ee6719f498df9fc57b6b806a5196dc507791e7e55e40e93b: Status 404 returned error can't find the container with id 536730ec70e0c609ee6719f498df9fc57b6b806a5196dc507791e7e55e40e93b
Jul 15 21:04:28.567982 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.567946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:28.611885 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.611853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:28.614660 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.614633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2663829-3ae6-4f97-a24a-5db85e09e7b8-cert\") pod \"odh-model-controller-7998c67dc4-sl25l\" (UID: \"f2663829-3ae6-4f97-a24a-5db85e09e7b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:28.681175 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.681093    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:28.826369 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:28.826341    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sl25l"]
Jul 15 21:04:28.827501 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:04:28.827468    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2663829_3ae6_4f97_a24a_5db85e09e7b8.slice/crio-98294807f40ac1a309c0701b64be0978bb0844619fb74a231c8feb70e497648b WatchSource:0}: Error finding container 98294807f40ac1a309c0701b64be0978bb0844619fb74a231c8feb70e497648b: Status 404 returned error can't find the container with id 98294807f40ac1a309c0701b64be0978bb0844619fb74a231c8feb70e497648b
Jul 15 21:04:29.112887 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:29.112851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" event={"ID":"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467","Type":"ContainerStarted","Data":"536730ec70e0c609ee6719f498df9fc57b6b806a5196dc507791e7e55e40e93b"}
Jul 15 21:04:29.114006 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:29.113977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sl25l" event={"ID":"f2663829-3ae6-4f97-a24a-5db85e09e7b8","Type":"ContainerStarted","Data":"98294807f40ac1a309c0701b64be0978bb0844619fb74a231c8feb70e497648b"}
Jul 15 21:04:29.328511 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:29.328478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:32.794792 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:32.794750    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:04:32.795185 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:32.794822    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:04:33.135463 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.135427    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh" event={"ID":"2451d1da-3306-4bab-abb4-71bfbcdd142d","Type":"ContainerStarted","Data":"0ebba0f87447836076b3fd599446e59e05f20040ea1657a80b98031cc82812fd"}
Jul 15 21:04:33.137283 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.137257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" event={"ID":"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467","Type":"ContainerStarted","Data":"92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d"}
Jul 15 21:04:33.137444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.137311    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:33.138961 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.138939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sl25l" event={"ID":"f2663829-3ae6-4f97-a24a-5db85e09e7b8","Type":"ContainerStarted","Data":"e347b737ebf42be191d2ef2c3f6f171e1f0c9b9d73cc30204fa461044c9b3a69"}
Jul 15 21:04:33.139099 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.139002    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:04:33.139610 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.139584    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hppnw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 21:04:33.139709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.139634    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" podUID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:04:33.155686 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.155637    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55c97b5545-gggjh" podStartSLOduration=1.4907943860000001 podStartE2EDuration="7.15562118s" totalImagesPullingTime="5.664826794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:33.153495104 +0000 UTC m=+324.307179626" watchObservedRunningTime="2026-07-15 21:04:33.15562118 +0000 UTC m=+324.309305702"
Jul 15 21:04:33.171357 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.171299    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sl25l" podStartSLOduration=3.147561361 podStartE2EDuration="7.171276772s" totalImagesPullingTime="4.023715411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:33.170124649 +0000 UTC m=+324.323809173" watchObservedRunningTime="2026-07-15 21:04:33.171276772 +0000 UTC m=+324.324961294"
Jul 15 21:04:33.191770 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:33.191721    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" podStartSLOduration=1.877456065 podStartE2EDuration="6.191700371s" totalImagesPullingTime="4.314244306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:33.191011318 +0000 UTC m=+324.344695853" watchObservedRunningTime="2026-07-15 21:04:33.191700371 +0000 UTC m=+324.345384892"
Jul 15 21:04:34.007119 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:34.007083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:34.106567 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:34.106507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:34.143479 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:34.143451    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hppnw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 21:04:34.143639 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:34.143497    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" podUID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:04:34.354440 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:34.354392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:34.510596 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:34.510559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:34.604254 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:34.604217    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:35.096901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.096864    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"]
Jul 15 21:04:35.100287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.100268    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.114762 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.114740    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"]
Jul 15 21:04:35.278381 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.278348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeacc1f8-dfe2-4d67-979c-13a28c845024-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.278381 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.278385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzb9l\" (UniqueName: \"kubernetes.io/projected/eeacc1f8-dfe2-4d67-979c-13a28c845024-kube-api-access-dzb9l\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.278607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.278410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.278607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.278477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.278607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.278498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.278607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.278515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.278607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.278536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.379473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.379399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeacc1f8-dfe2-4d67-979c-13a28c845024-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.379473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.379438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzb9l\" (UniqueName: \"kubernetes.io/projected/eeacc1f8-dfe2-4d67-979c-13a28c845024-kube-api-access-dzb9l\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.379473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.379458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.379758 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.379512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.379758 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.379531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.379758 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.379571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.379758 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.379606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.380367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.380338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.381818 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.381786    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeacc1f8-dfe2-4d67-979c-13a28c845024-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.381985 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.381964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.382051 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.381996    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.382051 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.382022    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.388849 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.388822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeacc1f8-dfe2-4d67-979c-13a28c845024-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.388975 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.388958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzb9l\" (UniqueName: \"kubernetes.io/projected/eeacc1f8-dfe2-4d67-979c-13a28c845024-kube-api-access-dzb9l\") pod \"istiod-openshift-gateway-94bb8fbfd-mkrsl\" (UID: \"eeacc1f8-dfe2-4d67-979c-13a28c845024\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.409462 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.409443    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:35.556081 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.556052    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"]
Jul 15 21:04:35.557499 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:04:35.557467    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeacc1f8_dfe2_4d67_979c_13a28c845024.slice/crio-05e7756fd92a5ad90f4d30983527ed8ef4104a2e9fd9f1409b20dbdbde5305c5 WatchSource:0}: Error finding container 05e7756fd92a5ad90f4d30983527ed8ef4104a2e9fd9f1409b20dbdbde5305c5: Status 404 returned error can't find the container with id 05e7756fd92a5ad90f4d30983527ed8ef4104a2e9fd9f1409b20dbdbde5305c5
Jul 15 21:04:35.561447 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.561410    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:04:35.561563 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:35.561487    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:04:36.153454 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:36.153422    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl" event={"ID":"eeacc1f8-dfe2-4d67-979c-13a28c845024","Type":"ContainerStarted","Data":"3d2dc140919c58db30fb7800489c624ebb3f91e2bc0f1543e226acba4e666eb6"}
Jul 15 21:04:36.153883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:36.153471    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl" event={"ID":"eeacc1f8-dfe2-4d67-979c-13a28c845024","Type":"ContainerStarted","Data":"05e7756fd92a5ad90f4d30983527ed8ef4104a2e9fd9f1409b20dbdbde5305c5"}
Jul 15 21:04:36.153883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:36.153738    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:36.155501 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:36.155476    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mkrsl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 21:04:36.155665 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:36.155537    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl" podUID="eeacc1f8-dfe2-4d67-979c-13a28c845024" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:04:36.204144 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:36.204088    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl" podStartSLOduration=1.204071795 podStartE2EDuration="1.204071795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:36.204066639 +0000 UTC m=+327.357751157" watchObservedRunningTime="2026-07-15 21:04:36.204071795 +0000 UTC m=+327.357756299"
Jul 15 21:04:37.144041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.144005    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:37.157992 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.157969    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mkrsl"
Jul 15 21:04:37.280955 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.280925    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"]
Jul 15 21:04:37.281114 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.281089    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" podUID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" containerName="discovery" containerID="cri-o://92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d" gracePeriod=30
Jul 15 21:04:37.529252 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.529229    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:37.706191 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706115    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-cacerts\") pod \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") "
Jul 15 21:04:37.706191 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706168    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-token\") pod \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") "
Jul 15 21:04:37.706191 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706186    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-local-certs\") pod \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") "
Jul 15 21:04:37.706438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnmmn\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-kube-api-access-dnmmn\") pod \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") "
Jul 15 21:04:37.706438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706232    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-ca-configmap\") pod \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") "
Jul 15 21:04:37.706438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706254    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-kubeconfig\") pod \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") "
Jul 15 21:04:37.706438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706270    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-dns-cert\") pod \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\" (UID: \"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467\") "
Jul 15 21:04:37.706735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.706703    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" (UID: "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:37.708719 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.708693    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" (UID: "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:37.708830 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.708797    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" (UID: "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:04:37.708890 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.708878    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-kube-api-access-dnmmn" (OuterVolumeSpecName: "kube-api-access-dnmmn") pod "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" (UID: "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467"). InnerVolumeSpecName "kube-api-access-dnmmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:04:37.708946 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.708894    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" (UID: "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:37.708946 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.708938    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-local-certs" (OuterVolumeSpecName: "local-certs") pod "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" (UID: "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:04:37.709032 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.708964    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-cacerts" (OuterVolumeSpecName: "cacerts") pod "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" (UID: "e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:37.807688 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.807658    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-dns-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:04:37.807688 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.807685    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-cacerts\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:04:37.807688 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.807694    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-token\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:04:37.807931 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.807703    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-local-certs\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:04:37.807931 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.807711    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnmmn\" (UniqueName: \"kubernetes.io/projected/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-kube-api-access-dnmmn\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:04:37.807931 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.807721    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-csr-ca-configmap\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:04:37.807931 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:37.807729    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467-istio-kubeconfig\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:04:38.162347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.162312    2573 generic.go:356] "Generic (PLEG): container finished" podID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" containerID="92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d" exitCode=0
Jul 15 21:04:38.162823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.162362    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"
Jul 15 21:04:38.162823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.162399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" event={"ID":"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467","Type":"ContainerDied","Data":"92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d"}
Jul 15 21:04:38.162823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.162448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hppnw" event={"ID":"e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467","Type":"ContainerDied","Data":"536730ec70e0c609ee6719f498df9fc57b6b806a5196dc507791e7e55e40e93b"}
Jul 15 21:04:38.162823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.162468    2573 scope.go:117] "RemoveContainer" containerID="92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d"
Jul 15 21:04:38.171762 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.171748    2573 scope.go:117] "RemoveContainer" containerID="92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d"
Jul 15 21:04:38.171987 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:04:38.171969    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d\": container with ID starting with 92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d not found: ID does not exist" containerID="92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d"
Jul 15 21:04:38.172053 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.171998    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d"} err="failed to get container status \"92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d\": rpc error: code = NotFound desc = could not find container \"92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d\": container with ID starting with 92a93130aa2e2d504edef1ad2d9722b95957fdde5c09ebe722c11e4c1b5c233d not found: ID does not exist"
Jul 15 21:04:38.196961 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.196940    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"]
Jul 15 21:04:38.199646 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.199624    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hppnw"]
Jul 15 21:04:38.542759 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.542679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:38.634957 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.634922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:38.642243 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.642212    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"]
Jul 15 21:04:38.642570 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.642557    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" containerName="discovery"
Jul 15 21:04:38.642619 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.642571    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" containerName="discovery"
Jul 15 21:04:38.642653 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.642634    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" containerName="discovery"
Jul 15 21:04:38.646298 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.646281    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"]
Jul 15 21:04:38.646408 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.646389    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.650269 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.650248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:38.654490 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.654468    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 21:04:38.654628 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.654492    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kgp7h\""
Jul 15 21:04:38.659468 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.659447    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 21:04:38.659583 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.659450    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n9fss\""
Jul 15 21:04:38.663113 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.663086    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"]
Jul 15 21:04:38.664641 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.664621    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"]
Jul 15 21:04:38.794931 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.794831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:38.816600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.816563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jxmn\" (UniqueName: \"kubernetes.io/projected/3d33cf55-eecd-417c-bc0e-b0dc09220426-kube-api-access-8jxmn\") pod \"kserve-controller-manager-d6f4b65b8-w5vkx\" (UID: \"3d33cf55-eecd-417c-bc0e-b0dc09220426\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.816761 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.816615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637da003-2a84-4323-93c1-a409b8ffbcaa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ntjhc\" (UID: \"637da003-2a84-4323-93c1-a409b8ffbcaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:38.816761 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.816666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d33cf55-eecd-417c-bc0e-b0dc09220426-cert\") pod \"kserve-controller-manager-d6f4b65b8-w5vkx\" (UID: \"3d33cf55-eecd-417c-bc0e-b0dc09220426\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.816761 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.816690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zwkd\" (UniqueName: \"kubernetes.io/projected/637da003-2a84-4323-93c1-a409b8ffbcaa-kube-api-access-4zwkd\") pod \"llmisvc-controller-manager-777c6bd7d5-ntjhc\" (UID: \"637da003-2a84-4323-93c1-a409b8ffbcaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:38.917417 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.917379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jxmn\" (UniqueName: \"kubernetes.io/projected/3d33cf55-eecd-417c-bc0e-b0dc09220426-kube-api-access-8jxmn\") pod \"kserve-controller-manager-d6f4b65b8-w5vkx\" (UID: \"3d33cf55-eecd-417c-bc0e-b0dc09220426\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.917417 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.917420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637da003-2a84-4323-93c1-a409b8ffbcaa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ntjhc\" (UID: \"637da003-2a84-4323-93c1-a409b8ffbcaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:38.917716 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.917682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d33cf55-eecd-417c-bc0e-b0dc09220426-cert\") pod \"kserve-controller-manager-d6f4b65b8-w5vkx\" (UID: \"3d33cf55-eecd-417c-bc0e-b0dc09220426\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.917769 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.917726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zwkd\" (UniqueName: \"kubernetes.io/projected/637da003-2a84-4323-93c1-a409b8ffbcaa-kube-api-access-4zwkd\") pod \"llmisvc-controller-manager-777c6bd7d5-ntjhc\" (UID: \"637da003-2a84-4323-93c1-a409b8ffbcaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:38.919907 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.919879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d33cf55-eecd-417c-bc0e-b0dc09220426-cert\") pod \"kserve-controller-manager-d6f4b65b8-w5vkx\" (UID: \"3d33cf55-eecd-417c-bc0e-b0dc09220426\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.920010 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.919945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637da003-2a84-4323-93c1-a409b8ffbcaa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ntjhc\" (UID: \"637da003-2a84-4323-93c1-a409b8ffbcaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:38.930639 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.930610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jxmn\" (UniqueName: \"kubernetes.io/projected/3d33cf55-eecd-417c-bc0e-b0dc09220426-kube-api-access-8jxmn\") pod \"kserve-controller-manager-d6f4b65b8-w5vkx\" (UID: \"3d33cf55-eecd-417c-bc0e-b0dc09220426\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.930639 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.930625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zwkd\" (UniqueName: \"kubernetes.io/projected/637da003-2a84-4323-93c1-a409b8ffbcaa-kube-api-access-4zwkd\") pod \"llmisvc-controller-manager-777c6bd7d5-ntjhc\" (UID: \"637da003-2a84-4323-93c1-a409b8ffbcaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:38.939715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.939683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:38.958592 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.958565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:38.964652 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:38.964634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:39.104182 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:39.104154    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"]
Jul 15 21:04:39.105527 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:04:39.105487    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d33cf55_eecd_417c_bc0e_b0dc09220426.slice/crio-3c84839ec6f0830ff22b1b0f3a91af175da10016fd1a8ba48f5d7eab1246743e WatchSource:0}: Error finding container 3c84839ec6f0830ff22b1b0f3a91af175da10016fd1a8ba48f5d7eab1246743e: Status 404 returned error can't find the container with id 3c84839ec6f0830ff22b1b0f3a91af175da10016fd1a8ba48f5d7eab1246743e
Jul 15 21:04:39.120045 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:39.120006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"]
Jul 15 21:04:39.121305 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:04:39.121286    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod637da003_2a84_4323_93c1_a409b8ffbcaa.slice/crio-e5a023d128957f81d21f4c50965dd7f98f38589dce7771a05c1ea79390235d34 WatchSource:0}: Error finding container e5a023d128957f81d21f4c50965dd7f98f38589dce7771a05c1ea79390235d34: Status 404 returned error can't find the container with id e5a023d128957f81d21f4c50965dd7f98f38589dce7771a05c1ea79390235d34
Jul 15 21:04:39.169609 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:39.169576    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc" event={"ID":"637da003-2a84-4323-93c1-a409b8ffbcaa","Type":"ContainerStarted","Data":"e5a023d128957f81d21f4c50965dd7f98f38589dce7771a05c1ea79390235d34"}
Jul 15 21:04:39.170784 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:39.170756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx" event={"ID":"3d33cf55-eecd-417c-bc0e-b0dc09220426","Type":"ContainerStarted","Data":"3c84839ec6f0830ff22b1b0f3a91af175da10016fd1a8ba48f5d7eab1246743e"}
Jul 15 21:04:39.575236 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:39.575203    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467" path="/var/lib/kubelet/pods/e0e8acdb-3bfb-4f3c-ae5a-e4d92b266467/volumes"
Jul 15 21:04:39.876908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:39.876869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:39.971652 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:39.971612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:40.047351 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:40.047312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:04:42.188456 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:42.188371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx" event={"ID":"3d33cf55-eecd-417c-bc0e-b0dc09220426","Type":"ContainerStarted","Data":"bddb29a4939cc95cdb5f429652717ab9b72c8e431a673f9dd038daadc0ccb81e"}
Jul 15 21:04:42.188814 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:42.188465    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:04:42.209756 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:42.209712    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx" podStartSLOduration=1.434496198 podStartE2EDuration="4.209697718s" totalImagesPullingTime="2.77520152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:42.209082396 +0000 UTC m=+333.362766919" watchObservedRunningTime="2026-07-15 21:04:42.209697718 +0000 UTC m=+333.363382241"
Jul 15 21:04:43.195025 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:43.194925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc" event={"ID":"637da003-2a84-4323-93c1-a409b8ffbcaa","Type":"ContainerStarted","Data":"dd6bfcdde2336590dfdcb880c1d7d0c9539d620050cf6becbf65e2bf54c69c2f"}
Jul 15 21:04:43.195441 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:43.195080    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:04:43.215823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:43.215778    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc" podStartSLOduration=1.407598826 podStartE2EDuration="5.215762571s" totalImagesPullingTime="3.808163745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:43.214263807 +0000 UTC m=+334.367948331" watchObservedRunningTime="2026-07-15 21:04:43.215762571 +0000 UTC m=+334.369447093"
Jul 15 21:04:44.145257 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:04:44.145229    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sl25l"
Jul 15 21:05:00.185077 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:00.185045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:00.285669 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:00.285626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:09.445434 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:09.445397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:09.543108 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:09.543075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:13.200172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:13.200147    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w5vkx"
Jul 15 21:05:14.202081 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:14.202052    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntjhc"
Jul 15 21:05:17.743879 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:17.743841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:27.396295 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:27.396252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:27.495068 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:27.495034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:27.590349 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:27.590312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:55.883138 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:55.883100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:05:59.366453 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:05:59.366417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:01.406071 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:01.406035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:03.116409 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:03.116362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:03.274220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:03.274187    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:05.422740 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.422707    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"]
Jul 15 21:06:05.425966 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.425949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:05.428610 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.428589    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 21:06:05.428806 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.428793    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 21:06:05.429532 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.429514    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5sqxw\""
Jul 15 21:06:05.437237 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.437218    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"]
Jul 15 21:06:05.546020 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.545988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:05.576293 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.576257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxswx\" (UniqueName: \"kubernetes.io/projected/d20610d6-9e18-4481-b50f-cae0b00f9436-kube-api-access-rxswx\") pod \"limitador-operator-controller-manager-859d7b78bd-vf8rp\" (UID: \"d20610d6-9e18-4481-b50f-cae0b00f9436\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:05.661373 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.661340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:05.677462 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.677400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxswx\" (UniqueName: \"kubernetes.io/projected/d20610d6-9e18-4481-b50f-cae0b00f9436-kube-api-access-rxswx\") pod \"limitador-operator-controller-manager-859d7b78bd-vf8rp\" (UID: \"d20610d6-9e18-4481-b50f-cae0b00f9436\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:05.686953 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.686923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxswx\" (UniqueName: \"kubernetes.io/projected/d20610d6-9e18-4481-b50f-cae0b00f9436-kube-api-access-rxswx\") pod \"limitador-operator-controller-manager-859d7b78bd-vf8rp\" (UID: \"d20610d6-9e18-4481-b50f-cae0b00f9436\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:05.736936 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.736913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:05.873194 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:05.873163    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"]
Jul 15 21:06:05.873623 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:06:05.873600    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20610d6_9e18_4481_b50f_cae0b00f9436.slice/crio-65e5bffbbbae884ef99e4dfed19339c5f469c3fd542bad4f943e77743ef8c43b WatchSource:0}: Error finding container 65e5bffbbbae884ef99e4dfed19339c5f469c3fd542bad4f943e77743ef8c43b: Status 404 returned error can't find the container with id 65e5bffbbbae884ef99e4dfed19339c5f469c3fd542bad4f943e77743ef8c43b
Jul 15 21:06:06.071811 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.071742    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f946cccb9-6x25h"]
Jul 15 21:06:06.076067 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.076040    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.094375 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.093622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f946cccb9-6x25h"]
Jul 15 21:06:06.167471 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.167439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:06.182033 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.182010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bx8f\" (UniqueName: \"kubernetes.io/projected/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-kube-api-access-7bx8f\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.182129 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.182039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-service-ca\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.182129 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.182060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-serving-cert\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.182129 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.182074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-oauth-config\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.182129 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.182088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-config\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.182256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.182160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-trusted-ca-bundle\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.182256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.182181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-oauth-serving-cert\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.283618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.283576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bx8f\" (UniqueName: \"kubernetes.io/projected/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-kube-api-access-7bx8f\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.283774 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.283626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-service-ca\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.283774 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.283662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-serving-cert\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.283774 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.283684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-oauth-config\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.283774 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.283705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-config\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.283978 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.283807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-trusted-ca-bundle\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.283978 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.283851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-oauth-serving-cert\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.284520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.284495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-service-ca\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.284520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.284514    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-config\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.284685 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.284658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-oauth-serving-cert\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.284883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.284862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-trusted-ca-bundle\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.286187 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.286166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-oauth-config\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.286299 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.286279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-console-serving-cert\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.297173 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.297152    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bx8f\" (UniqueName: \"kubernetes.io/projected/1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b-kube-api-access-7bx8f\") pod \"console-6f946cccb9-6x25h\" (UID: \"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b\") " pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.385867 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.385825    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:06.523522 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.523455    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f946cccb9-6x25h"]
Jul 15 21:06:06.526383 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:06:06.526351    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec4d126_6ac5_4d3c_8f50_d0eba7bf8b6b.slice/crio-09f170c5c280c830fb4c5748669a6fe7c14116440993a08d8f6aa9a3672f1619 WatchSource:0}: Error finding container 09f170c5c280c830fb4c5748669a6fe7c14116440993a08d8f6aa9a3672f1619: Status 404 returned error can't find the container with id 09f170c5c280c830fb4c5748669a6fe7c14116440993a08d8f6aa9a3672f1619
Jul 15 21:06:06.570918 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.570891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f946cccb9-6x25h" event={"ID":"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b","Type":"ContainerStarted","Data":"09f170c5c280c830fb4c5748669a6fe7c14116440993a08d8f6aa9a3672f1619"}
Jul 15 21:06:06.572259 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:06.572236    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp" event={"ID":"d20610d6-9e18-4481-b50f-cae0b00f9436","Type":"ContainerStarted","Data":"65e5bffbbbae884ef99e4dfed19339c5f469c3fd542bad4f943e77743ef8c43b"}
Jul 15 21:06:07.298818 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:07.298788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:07.397603 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:07.397564    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:07.577988 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:07.577894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f946cccb9-6x25h" event={"ID":"1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b","Type":"ContainerStarted","Data":"0541a29280773f45250374d0ef390e20c394508c6581e5ab949c8fa8e8a5c677"}
Jul 15 21:06:07.598367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:07.598316    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f946cccb9-6x25h" podStartSLOduration=1.598298336 podStartE2EDuration="1.598298336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:07.597667427 +0000 UTC m=+418.751351950" watchObservedRunningTime="2026-07-15 21:06:07.598298336 +0000 UTC m=+418.751982859"
Jul 15 21:06:07.927905 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:07.927865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:08.584305 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:08.584265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp" event={"ID":"d20610d6-9e18-4481-b50f-cae0b00f9436","Type":"ContainerStarted","Data":"fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d"}
Jul 15 21:06:08.584751 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:08.584438    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:08.603187 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:08.603140    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp" podStartSLOduration=1.459101452 podStartE2EDuration="3.603124111s" totalImagesPullingTime="2.144022659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:08.601957431 +0000 UTC m=+419.755641953" watchObservedRunningTime="2026-07-15 21:06:08.603124111 +0000 UTC m=+419.756808633"
Jul 15 21:06:08.925929 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:08.925895    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"]
Jul 15 21:06:08.929310 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:08.929294    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"
Jul 15 21:06:08.932252 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:08.932228    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4p6vj\""
Jul 15 21:06:08.940196 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:08.940174    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"]
Jul 15 21:06:09.008911 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:09.008878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68nb\" (UniqueName: \"kubernetes.io/projected/a67963d7-3bf6-4464-9c9d-6337e46a12aa-kube-api-access-x68nb\") pod \"authorino-operator-75cc8d5cb7-ddf4x\" (UID: \"a67963d7-3bf6-4464-9c9d-6337e46a12aa\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"
Jul 15 21:06:09.109689 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:09.109653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68nb\" (UniqueName: \"kubernetes.io/projected/a67963d7-3bf6-4464-9c9d-6337e46a12aa-kube-api-access-x68nb\") pod \"authorino-operator-75cc8d5cb7-ddf4x\" (UID: \"a67963d7-3bf6-4464-9c9d-6337e46a12aa\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"
Jul 15 21:06:09.133131 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:09.133098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68nb\" (UniqueName: \"kubernetes.io/projected/a67963d7-3bf6-4464-9c9d-6337e46a12aa-kube-api-access-x68nb\") pod \"authorino-operator-75cc8d5cb7-ddf4x\" (UID: \"a67963d7-3bf6-4464-9c9d-6337e46a12aa\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"
Jul 15 21:06:09.239848 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:09.239759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"
Jul 15 21:06:09.380751 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:09.380731    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"]
Jul 15 21:06:09.383166 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:06:09.383145    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67963d7_3bf6_4464_9c9d_6337e46a12aa.slice/crio-0379a4b292d3f5a108fc0e73a2be2d5726de1564bad66291b845472c449b5eb4 WatchSource:0}: Error finding container 0379a4b292d3f5a108fc0e73a2be2d5726de1564bad66291b845472c449b5eb4: Status 404 returned error can't find the container with id 0379a4b292d3f5a108fc0e73a2be2d5726de1564bad66291b845472c449b5eb4
Jul 15 21:06:09.589958 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:09.589871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x" event={"ID":"a67963d7-3bf6-4464-9c9d-6337e46a12aa","Type":"ContainerStarted","Data":"0379a4b292d3f5a108fc0e73a2be2d5726de1564bad66291b845472c449b5eb4"}
Jul 15 21:06:10.903872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:10.903832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:11.008114 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:11.008072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:12.250533 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:12.250502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:12.607277 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:12.607238    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x" event={"ID":"a67963d7-3bf6-4464-9c9d-6337e46a12aa","Type":"ContainerStarted","Data":"5c82b32142426bb8794c14d1af7aff76169ada4d2a01201f8aa31e338e17de66"}
Jul 15 21:06:12.607462 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:12.607307    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"
Jul 15 21:06:12.624868 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:12.624820    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x" podStartSLOduration=1.786524021 podStartE2EDuration="4.624806135s" totalImagesPullingTime="2.838282114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:12.624579653 +0000 UTC m=+423.778264174" watchObservedRunningTime="2026-07-15 21:06:12.624806135 +0000 UTC m=+423.778490657"
Jul 15 21:06:12.629657 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:12.629625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:16.386653 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.386611    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:16.387045 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.386672    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:16.391361 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.391339    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:16.575027 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.574966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:16.629241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.629218    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f946cccb9-6x25h"
Jul 15 21:06:16.653853 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.653765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:16.684052 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.684015    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7567d6b666-f6xqb"]
Jul 15 21:06:16.802084 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:16.802054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:17.747163 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:17.747124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:17.882115 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:17.882079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:18.575677 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:18.575643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:18.669883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:18.669845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:19.592121 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:19.592093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:22.601404 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.601372    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"]
Jul 15 21:06:22.601947 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.601589    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp" podUID="d20610d6-9e18-4481-b50f-cae0b00f9436" containerName="manager" containerID="cri-o://fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d" gracePeriod=2
Jul 15 21:06:22.610642 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.610614    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"]
Jul 15 21:06:22.637709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.637680    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"]
Jul 15 21:06:22.638215 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.638194    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20610d6-9e18-4481-b50f-cae0b00f9436" containerName="manager"
Jul 15 21:06:22.638215 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.638217    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20610d6-9e18-4481-b50f-cae0b00f9436" containerName="manager"
Jul 15 21:06:22.638309 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.638285    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20610d6-9e18-4481-b50f-cae0b00f9436" containerName="manager"
Jul 15 21:06:22.641312 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.641297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"
Jul 15 21:06:22.656543 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.656512    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"]
Jul 15 21:06:22.676098 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:06:22.676068    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vf8rp\" is forbidden: User \"system:node:ip-10-0-135-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-15.ec2.internal' and this object" podUID="d20610d6-9e18-4481-b50f-cae0b00f9436" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:22.737428 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.737397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw9v5\" (UniqueName: \"kubernetes.io/projected/41e4f618-f546-4bab-a9a8-f6539dbf6e63-kube-api-access-jw9v5\") pod \"limitador-operator-controller-manager-859d7b78bd-jzdwf\" (UID: \"41e4f618-f546-4bab-a9a8-f6539dbf6e63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"
Jul 15 21:06:22.838796 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.838751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw9v5\" (UniqueName: \"kubernetes.io/projected/41e4f618-f546-4bab-a9a8-f6539dbf6e63-kube-api-access-jw9v5\") pod \"limitador-operator-controller-manager-859d7b78bd-jzdwf\" (UID: \"41e4f618-f546-4bab-a9a8-f6539dbf6e63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"
Jul 15 21:06:22.862127 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.862066    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw9v5\" (UniqueName: \"kubernetes.io/projected/41e4f618-f546-4bab-a9a8-f6539dbf6e63-kube-api-access-jw9v5\") pod \"limitador-operator-controller-manager-859d7b78bd-jzdwf\" (UID: \"41e4f618-f546-4bab-a9a8-f6539dbf6e63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"
Jul 15 21:06:22.865994 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.865973    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:22.871953 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:06:22.871926    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vf8rp\" is forbidden: User \"system:node:ip-10-0-135-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-15.ec2.internal' and this object" podUID="d20610d6-9e18-4481-b50f-cae0b00f9436" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:22.939176 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.939150    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxswx\" (UniqueName: \"kubernetes.io/projected/d20610d6-9e18-4481-b50f-cae0b00f9436-kube-api-access-rxswx\") pod \"d20610d6-9e18-4481-b50f-cae0b00f9436\" (UID: \"d20610d6-9e18-4481-b50f-cae0b00f9436\") "
Jul 15 21:06:22.941278 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.941249    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20610d6-9e18-4481-b50f-cae0b00f9436-kube-api-access-rxswx" (OuterVolumeSpecName: "kube-api-access-rxswx") pod "d20610d6-9e18-4481-b50f-cae0b00f9436" (UID: "d20610d6-9e18-4481-b50f-cae0b00f9436"). InnerVolumeSpecName "kube-api-access-rxswx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:06:22.973484 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:22.973430    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"
Jul 15 21:06:23.040166 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.040129    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxswx\" (UniqueName: \"kubernetes.io/projected/d20610d6-9e18-4481-b50f-cae0b00f9436-kube-api-access-rxswx\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:23.110035 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.110011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"]
Jul 15 21:06:23.111660 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:06:23.111631    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e4f618_f546_4bab_a9a8_f6539dbf6e63.slice/crio-c447aa25195f297bae1735d9239aa359bdfc1828641cecac6d827086eee76951 WatchSource:0}: Error finding container c447aa25195f297bae1735d9239aa359bdfc1828641cecac6d827086eee76951: Status 404 returned error can't find the container with id c447aa25195f297bae1735d9239aa359bdfc1828641cecac6d827086eee76951
Jul 15 21:06:23.392498 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.392410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:23.502911 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.502878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:23.575135 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.575100    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20610d6-9e18-4481-b50f-cae0b00f9436" path="/var/lib/kubelet/pods/d20610d6-9e18-4481-b50f-cae0b00f9436/volumes"
Jul 15 21:06:23.614036 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.614007    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddf4x"
Jul 15 21:06:23.661212 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.661118    2573 generic.go:356] "Generic (PLEG): container finished" podID="d20610d6-9e18-4481-b50f-cae0b00f9436" containerID="fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d" exitCode=0
Jul 15 21:06:23.661212 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.661163    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vf8rp"
Jul 15 21:06:23.661428 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.661218    2573 scope.go:117] "RemoveContainer" containerID="fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d"
Jul 15 21:06:23.663037 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.662947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf" event={"ID":"41e4f618-f546-4bab-a9a8-f6539dbf6e63","Type":"ContainerStarted","Data":"c45086baa5d7f8e3e109c3785704d3f466785cc4fbbd10c545508f4519e5fd9a"}
Jul 15 21:06:23.663037 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.663001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf" event={"ID":"41e4f618-f546-4bab-a9a8-f6539dbf6e63","Type":"ContainerStarted","Data":"c447aa25195f297bae1735d9239aa359bdfc1828641cecac6d827086eee76951"}
Jul 15 21:06:23.663538 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.663074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"
Jul 15 21:06:23.670587 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.670569    2573 scope.go:117] "RemoveContainer" containerID="fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d"
Jul 15 21:06:23.670883 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:06:23.670861    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d\": container with ID starting with fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d not found: ID does not exist" containerID="fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d"
Jul 15 21:06:23.670969 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.670893    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d"} err="failed to get container status \"fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d\": rpc error: code = NotFound desc = could not find container \"fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d\": container with ID starting with fde38fcddd7d249af578885ad1645b39464e2e986784b690884d1a8e10578d7d not found: ID does not exist"
Jul 15 21:06:23.709156 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:23.709100    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf" podStartSLOduration=1.709082641 podStartE2EDuration="1.709082641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:23.705777546 +0000 UTC m=+434.859462082" watchObservedRunningTime="2026-07-15 21:06:23.709082641 +0000 UTC m=+434.862767163"
Jul 15 21:06:28.163404 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:28.163367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:28.259867 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:28.259830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:32.098243 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:32.098160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:32.176303 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:32.176270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:34.670881 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:34.670848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jzdwf"
Jul 15 21:06:40.121837 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:40.121801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:40.205774 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:40.205739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:41.705532 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:41.705471    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7567d6b666-f6xqb" podUID="59be788e-7d32-44a8-a111-8c43c2abed46" containerName="console" containerID="cri-o://58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea" gracePeriod=15
Jul 15 21:06:41.949195 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:41.949169    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:06:42.005009 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.004943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-service-ca\") pod \"59be788e-7d32-44a8-a111-8c43c2abed46\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") "
Jul 15 21:06:42.005009 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.004980    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mrnl\" (UniqueName: \"kubernetes.io/projected/59be788e-7d32-44a8-a111-8c43c2abed46-kube-api-access-9mrnl\") pod \"59be788e-7d32-44a8-a111-8c43c2abed46\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") "
Jul 15 21:06:42.005009 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005003    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-console-config\") pod \"59be788e-7d32-44a8-a111-8c43c2abed46\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") "
Jul 15 21:06:42.005220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005057    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-oauth-config\") pod \"59be788e-7d32-44a8-a111-8c43c2abed46\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") "
Jul 15 21:06:42.005220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005119    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-trusted-ca-bundle\") pod \"59be788e-7d32-44a8-a111-8c43c2abed46\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") "
Jul 15 21:06:42.005220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005142    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-oauth-serving-cert\") pod \"59be788e-7d32-44a8-a111-8c43c2abed46\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") "
Jul 15 21:06:42.005220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-serving-cert\") pod \"59be788e-7d32-44a8-a111-8c43c2abed46\" (UID: \"59be788e-7d32-44a8-a111-8c43c2abed46\") "
Jul 15 21:06:42.005386 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005360    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-service-ca" (OuterVolumeSpecName: "service-ca") pod "59be788e-7d32-44a8-a111-8c43c2abed46" (UID: "59be788e-7d32-44a8-a111-8c43c2abed46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:06:42.005490 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005422    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-console-config" (OuterVolumeSpecName: "console-config") pod "59be788e-7d32-44a8-a111-8c43c2abed46" (UID: "59be788e-7d32-44a8-a111-8c43c2abed46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:06:42.005576 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005493    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:42.005763 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005736    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59be788e-7d32-44a8-a111-8c43c2abed46" (UID: "59be788e-7d32-44a8-a111-8c43c2abed46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:06:42.005898 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.005767    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59be788e-7d32-44a8-a111-8c43c2abed46" (UID: "59be788e-7d32-44a8-a111-8c43c2abed46"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:06:42.007241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.007217    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59be788e-7d32-44a8-a111-8c43c2abed46" (UID: "59be788e-7d32-44a8-a111-8c43c2abed46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:06:42.007241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.007230    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59be788e-7d32-44a8-a111-8c43c2abed46-kube-api-access-9mrnl" (OuterVolumeSpecName: "kube-api-access-9mrnl") pod "59be788e-7d32-44a8-a111-8c43c2abed46" (UID: "59be788e-7d32-44a8-a111-8c43c2abed46"). InnerVolumeSpecName "kube-api-access-9mrnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:06:42.007591 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.007572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59be788e-7d32-44a8-a111-8c43c2abed46" (UID: "59be788e-7d32-44a8-a111-8c43c2abed46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:06:42.106220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.106188    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-oauth-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:42.106220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.106217    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-trusted-ca-bundle\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:42.106220 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.106226    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-oauth-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:42.106438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.106235    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59be788e-7d32-44a8-a111-8c43c2abed46-console-serving-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:42.106438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.106244    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mrnl\" (UniqueName: \"kubernetes.io/projected/59be788e-7d32-44a8-a111-8c43c2abed46-kube-api-access-9mrnl\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:42.106438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.106253    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59be788e-7d32-44a8-a111-8c43c2abed46-console-config\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:06:42.759712 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.759681    2573 generic.go:356] "Generic (PLEG): container finished" podID="59be788e-7d32-44a8-a111-8c43c2abed46" containerID="58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea" exitCode=0
Jul 15 21:06:42.760147 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.759726    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d6b666-f6xqb"
Jul 15 21:06:42.760147 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.759767    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d6b666-f6xqb" event={"ID":"59be788e-7d32-44a8-a111-8c43c2abed46","Type":"ContainerDied","Data":"58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea"}
Jul 15 21:06:42.760147 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.759824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d6b666-f6xqb" event={"ID":"59be788e-7d32-44a8-a111-8c43c2abed46","Type":"ContainerDied","Data":"1f1d394f966baf78b621293cc0622addfe4bc74bcbe28732a2f6390f08e78648"}
Jul 15 21:06:42.760147 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.759850    2573 scope.go:117] "RemoveContainer" containerID="58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea"
Jul 15 21:06:42.769787 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.769769    2573 scope.go:117] "RemoveContainer" containerID="58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea"
Jul 15 21:06:42.770031 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:06:42.770014    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea\": container with ID starting with 58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea not found: ID does not exist" containerID="58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea"
Jul 15 21:06:42.770069 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.770039    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea"} err="failed to get container status \"58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea\": rpc error: code = NotFound desc = could not find container \"58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea\": container with ID starting with 58854f68338e3bac118b9b21b79b84dda285fd926d5da9f8dbc256d4531d10ea not found: ID does not exist"
Jul 15 21:06:42.787173 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.787147    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7567d6b666-f6xqb"]
Jul 15 21:06:42.791621 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:42.791602    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7567d6b666-f6xqb"]
Jul 15 21:06:43.574908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:43.574875    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59be788e-7d32-44a8-a111-8c43c2abed46" path="/var/lib/kubelet/pods/59be788e-7d32-44a8-a111-8c43c2abed46/volumes"
Jul 15 21:06:44.281929 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:44.281896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:44.391898 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:44.391866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:48.699472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:48.699440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:48.799817 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:48.799788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:51.229783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:51.229738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:51.467531 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:51.467495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:52.955580 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:52.955528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:53.048406 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.048371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:53.302578 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.302468    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:06:53.303322 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.303298    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59be788e-7d32-44a8-a111-8c43c2abed46" containerName="console"
Jul 15 21:06:53.303485 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.303473    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="59be788e-7d32-44a8-a111-8c43c2abed46" containerName="console"
Jul 15 21:06:53.303782 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.303767    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="59be788e-7d32-44a8-a111-8c43c2abed46" containerName="console"
Jul 15 21:06:53.311935 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.311914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.313019 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.312995    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:06:53.314908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.314887    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 21:06:53.315924 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.315903    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qntx\""
Jul 15 21:06:53.327405 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.327383    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:06:53.384677 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.384648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:53.407465 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.407436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31701a70-2b3b-4269-83ed-be51b3aee290-config-file\") pod \"limitador-limitador-54d6d988d5-wd8zx\" (UID: \"31701a70-2b3b-4269-83ed-be51b3aee290\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.407616 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.407601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfr89\" (UniqueName: \"kubernetes.io/projected/31701a70-2b3b-4269-83ed-be51b3aee290-kube-api-access-sfr89\") pod \"limitador-limitador-54d6d988d5-wd8zx\" (UID: \"31701a70-2b3b-4269-83ed-be51b3aee290\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.508621 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.508583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfr89\" (UniqueName: \"kubernetes.io/projected/31701a70-2b3b-4269-83ed-be51b3aee290-kube-api-access-sfr89\") pod \"limitador-limitador-54d6d988d5-wd8zx\" (UID: \"31701a70-2b3b-4269-83ed-be51b3aee290\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.508787 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.508645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31701a70-2b3b-4269-83ed-be51b3aee290-config-file\") pod \"limitador-limitador-54d6d988d5-wd8zx\" (UID: \"31701a70-2b3b-4269-83ed-be51b3aee290\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.509257 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.509234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31701a70-2b3b-4269-83ed-be51b3aee290-config-file\") pod \"limitador-limitador-54d6d988d5-wd8zx\" (UID: \"31701a70-2b3b-4269-83ed-be51b3aee290\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.517942 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.517922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfr89\" (UniqueName: \"kubernetes.io/projected/31701a70-2b3b-4269-83ed-be51b3aee290-kube-api-access-sfr89\") pod \"limitador-limitador-54d6d988d5-wd8zx\" (UID: \"31701a70-2b3b-4269-83ed-be51b3aee290\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.622640 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.622617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:53.757723 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.757692    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:06:53.760006 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:06:53.759979    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31701a70_2b3b_4269_83ed_be51b3aee290.slice/crio-dd9643cbb85d4239f7f19f5fad78f13209d86088b1ec9b4a4369390a86619950 WatchSource:0}: Error finding container dd9643cbb85d4239f7f19f5fad78f13209d86088b1ec9b4a4369390a86619950: Status 404 returned error can't find the container with id dd9643cbb85d4239f7f19f5fad78f13209d86088b1ec9b4a4369390a86619950
Jul 15 21:06:53.787022 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.786995    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:53.813913 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.813885    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx" event={"ID":"31701a70-2b3b-4269-83ed-be51b3aee290","Type":"ContainerStarted","Data":"dd9643cbb85d4239f7f19f5fad78f13209d86088b1ec9b4a4369390a86619950"}
Jul 15 21:06:53.887142 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:53.887062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:06:56.832430 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:56.832395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx" event={"ID":"31701a70-2b3b-4269-83ed-be51b3aee290","Type":"ContainerStarted","Data":"c02ec8a5ed97dcee2fbbcadf1fe8763655960dd995a943fe92269486269025ee"}
Jul 15 21:06:56.832911 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:56.832509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:06:56.852994 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:06:56.852956    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx" podStartSLOduration=1.396645666 podStartE2EDuration="3.85294204s" totalImagesPullingTime="2.456296374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:56.851124071 +0000 UTC m=+468.004808593" watchObservedRunningTime="2026-07-15 21:06:56.85294204 +0000 UTC m=+468.006626559"
Jul 15 21:07:07.838375 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:07.838340    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"
Jul 15 21:07:09.096763 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:09.096697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:09.189206 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:09.189160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:09.318803 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:09.318778    2573 scope.go:117] "RemoveContainer" containerID="60b6f4eb312825a878645c502856aeccacd0dc7a2e55319eaae8aeda00eef2dd"
Jul 15 21:07:09.701252 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:09.701214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:21.383140 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:21.383102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:21.601671 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:21.601633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:28.188002 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:28.187967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:28.273235 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:28.273202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:28.339231 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:28.339200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:28.671937 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:28.671905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:31.943203 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:31.943161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:07:32.038508 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:07:32.038469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:04.063875 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:04.063787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:04.160659 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:04.160627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:04.597824 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:04.597789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:04.862308 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:04.862218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:05.199644 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:05.199538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:05.290607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:05.290568    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:05.421212 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:05.421180    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:08:15.385188 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:15.385148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:15.481036 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:15.480997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:31.434131 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:31.434092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:31.902791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:31.902757    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:08:41.315979 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:41.315945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:42.116786 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:42.116751    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:08:42.828968 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:42.828906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:42.929244 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:42.929213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:48.333055 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:48.333015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:08:49.598039 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:08:49.598000    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:09:02.984520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:02.984489    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"]
Jul 15 21:09:02.987899 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:02.987882    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:02.991642 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:02.991621    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 21:09:02.991901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:02.991866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vqths\""
Jul 15 21:09:02.991901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:02.991873    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 21:09:02.992093 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:02.991919    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 21:09:02.997110 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:02.997085    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"]
Jul 15 21:09:03.000346 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.000317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:09:03.023273 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.023242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.023439 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.023293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74381800-b907-4131-8528-1285d18aacd2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.023439 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.023321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckk99\" (UniqueName: \"kubernetes.io/projected/74381800-b907-4131-8528-1285d18aacd2-kube-api-access-ckk99\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.023439 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.023384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.023572 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.023438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.023572 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.023476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.124529 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.124489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.124727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.124539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.124727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.124595    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74381800-b907-4131-8528-1285d18aacd2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.124727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.124615    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckk99\" (UniqueName: \"kubernetes.io/projected/74381800-b907-4131-8528-1285d18aacd2-kube-api-access-ckk99\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.124727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.124643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.124727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.124688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.125000 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.124952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.125080 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.125035    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.125080 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.125051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.126973 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.126951    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74381800-b907-4131-8528-1285d18aacd2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.127239 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.127218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74381800-b907-4131-8528-1285d18aacd2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.137450 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.137424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckk99\" (UniqueName: \"kubernetes.io/projected/74381800-b907-4131-8528-1285d18aacd2-kube-api-access-ckk99\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf\" (UID: \"74381800-b907-4131-8528-1285d18aacd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.299318 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.299213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:03.434568 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:03.434529    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"]
Jul 15 21:09:03.437033 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:09:03.437007    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74381800_b907_4131_8528_1285d18aacd2.slice/crio-57935c3f48a237ee5d2ad2cb69d8b1502b22e548f545f2d9f3f12728b066cfca WatchSource:0}: Error finding container 57935c3f48a237ee5d2ad2cb69d8b1502b22e548f545f2d9f3f12728b066cfca: Status 404 returned error can't find the container with id 57935c3f48a237ee5d2ad2cb69d8b1502b22e548f545f2d9f3f12728b066cfca
Jul 15 21:09:04.425730 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:04.425662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf" event={"ID":"74381800-b907-4131-8528-1285d18aacd2","Type":"ContainerStarted","Data":"57935c3f48a237ee5d2ad2cb69d8b1502b22e548f545f2d9f3f12728b066cfca"}
Jul 15 21:09:04.618859 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:04.618824    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:09:05.432669 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:05.432636    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf" event={"ID":"74381800-b907-4131-8528-1285d18aacd2","Type":"ContainerStarted","Data":"ef63aabfdf21fbfd2bba55f702aa829502922850b995e5fb7f0ad23ea52ff6ee"}
Jul 15 21:09:05.455323 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:05.455276    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf" podStartSLOduration=2.398692372 podStartE2EDuration="3.455259718s" totalImagesPullingTime="1.056567346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:05.45469684 +0000 UTC m=+596.608381365" watchObservedRunningTime="2026-07-15 21:09:05.455259718 +0000 UTC m=+596.608944239"
Jul 15 21:09:10.205141 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:10.205038    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:09:10.215317 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:10.206459    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:09:10.326834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:10.326791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:09:13.299439 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:13.299372    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:13.300031 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:13.299574    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:13.312166 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:13.312135    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:13.479731 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:13.479699    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf"
Jul 15 21:09:14.144596 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:14.144562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:09:16.010491 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:16.010455    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:09:21.144411 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:21.144363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:09:32.416321 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:32.416236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:09:34.792232 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:09:34.792196    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:10:04.286442 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:04.286403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:10:14.435169 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:14.435127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:10:14.537771 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:14.537736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:10:15.519876 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:15.519822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:10:15.611120 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:15.611077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:10:25.199542 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:25.199503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:10:25.301080 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:25.301047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:10:41.808235 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:41.808196    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:10:52.389067 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:10:52.389033    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:11:02.684958 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:11:02.684875    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:11:13.401233 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:11:13.401198    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:11:22.892059 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:11:22.892019    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:11:25.665710 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:11:25.665678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:11:27.091955 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:11:27.091922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:11:47.198719 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:11:47.198688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:11:49.507094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:11:49.507063    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:12:00.497437 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:00.497393    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:12:03.510306 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:03.510271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:03.840338 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:03.840237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:05.789223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:05.789184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:05.890537 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:05.890498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:06.031157 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:06.031118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:12.461514 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:12.461474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:12.537426 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:12.537395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:12.613323 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:12.613285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:12.815469 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:12.815383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:19.200836 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:19.200793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:19.340945 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:19.340914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:12:34.701020 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:34.700942    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:12:42.702990 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:42.702944    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:12:54.992731 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:12:54.992696    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:13:05.700048 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:13:05.700011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:13:14.690852 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:13:14.690821    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:13:24.892473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:13:24.892437    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:13:37.002723 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:13:37.002688    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:13:47.235866 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:13:47.235832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:14:08.706617 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:08.706583    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:14:10.232619 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:10.232509    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:14:10.239272 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:10.235079    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:14:18.192449 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:18.192406    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:14:23.029793 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:23.029757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:14:23.102467 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:23.102433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:14:41.003832 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:41.003801    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:14:44.311520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:44.311489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:14:53.995215 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:14:53.995180    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:15:08.512051 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:15:08.512017    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:15:19.914525 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:15:19.914490    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:15:28.899836 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:15:28.899804    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:15:38.695494 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:15:38.695403    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:15:48.893973 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:15:48.893940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:17:38.638737 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:17:38.638702    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:17:50.806564 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:17:50.806518    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:18:01.987912 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:01.987873    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:18:11.419086 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:11.419053    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:18:22.315782 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:22.315753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:18:30.502838 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:30.502799    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:18:39.982769 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:39.982695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:18:50.700697 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:50.700661    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:18:58.760208 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:58.760168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:18:58.833614 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:18:58.833578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:19:00.217021 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:00.216982    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:19:10.261058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:10.260947    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:19:10.264994 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:10.264047    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:19:11.028058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:11.028023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:19:11.421598 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:11.421568    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:19:23.425635 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:23.425598    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:19:30.924378 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:30.924345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:19:51.709018 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:51.708986    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:19:54.885522 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:19:54.885483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:20:00.468766 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:00.468726    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:20:06.249361 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:06.249278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:20:06.340390 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:06.340359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:20:11.232844 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:11.232809    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:20:22.316246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:22.316212    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:20:36.103634 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:36.103598    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:20:48.308693 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:48.308656    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:20:58.217329 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:20:58.217288    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:21:07.699675 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:21:07.699642    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:21:16.565815 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:21:16.565779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:21:27.913248 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:21:27.913207    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:21:37.392648 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:21:37.392528    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:21:51.523461 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:21:51.523429    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:22:07.506641 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:22:07.506608    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:22:21.211906 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:22:21.211869    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:22:31.603003 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:22:31.602969    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:22:43.486800 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:22:43.486767    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:23:01.102639 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:01.102605    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:23:13.708836 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:13.708793    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:23:27.204677 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:27.204643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:23:28.368652 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:28.368619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:23:35.599652 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:35.599612    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:23:40.238806 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:40.238771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:23:48.473373 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:48.473342    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:23:49.094190 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:49.094157    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:23:53.646477 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:53.646441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:23:56.621842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:56.621806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:23:56.712795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:56.712730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:23:57.099894 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:57.099854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:23:57.601720 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:23:57.601690    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:24:04.290088 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:04.290026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:04.389446 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:04.389407    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:04.905567 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:04.905512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:04.997770 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:04.997739    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"]
Jul 15 21:24:05.001468 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.001450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.004636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.004611    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:24:05.004753 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.004612    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0b8f8143-serving-cert\""
Jul 15 21:24:05.004753 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.004737    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:24:05.006345 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.006325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:24:05.013713 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.013690    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"]
Jul 15 21:24:05.014530 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.014508    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:05.052035 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.052003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced4d86f-55de-417e-ba2f-d462f1aa727c-openshift-service-ca\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.052172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.052064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh8sp\" (UniqueName: \"kubernetes.io/projected/ced4d86f-55de-417e-ba2f-d462f1aa727c-kube-api-access-zh8sp\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.052172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.052106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.099244 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.099210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:05.153241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.153203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.153402 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.153265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced4d86f-55de-417e-ba2f-d462f1aa727c-openshift-service-ca\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.153402 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.153332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh8sp\" (UniqueName: \"kubernetes.io/projected/ced4d86f-55de-417e-ba2f-d462f1aa727c-kube-api-access-zh8sp\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.153402 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:24:05.153363    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-serving-cert: secret "maas-api-e2e-ait-0b8f8143-serving-cert" not found
Jul 15 21:24:05.153517 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:24:05.153439    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls podName:ced4d86f-55de-417e-ba2f-d462f1aa727c nodeName:}" failed. No retries permitted until 2026-07-15 21:24:05.653418282 +0000 UTC m=+1496.807102782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls") pod "maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" (UID: "ced4d86f-55de-417e-ba2f-d462f1aa727c") : secret "maas-api-e2e-ait-0b8f8143-serving-cert" not found
Jul 15 21:24:05.153956 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.153937    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced4d86f-55de-417e-ba2f-d462f1aa727c-openshift-service-ca\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.162980 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.162922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh8sp\" (UniqueName: \"kubernetes.io/projected/ced4d86f-55de-417e-ba2f-d462f1aa727c-kube-api-access-zh8sp\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.389395 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.389359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:05.636977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.636947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:05.657365 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.657333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.659843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.659817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls\") pod \"maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:05.736884 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.736856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:05.913074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:05.912991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:06.049074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:06.049051    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"]
Jul 15 21:24:06.051033 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:24:06.051006    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced4d86f_55de_417e_ba2f_d462f1aa727c.slice/crio-af99195f70cb019dc17db0c8a2ad58a1918c9ed429e31819054ca4121f6ac1c0 WatchSource:0}: Error finding container af99195f70cb019dc17db0c8a2ad58a1918c9ed429e31819054ca4121f6ac1c0: Status 404 returned error can't find the container with id af99195f70cb019dc17db0c8a2ad58a1918c9ed429e31819054ca4121f6ac1c0
Jul 15 21:24:06.052773 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:06.052755    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:24:06.584135 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:06.584096    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" event={"ID":"ced4d86f-55de-417e-ba2f-d462f1aa727c","Type":"ContainerStarted","Data":"af99195f70cb019dc17db0c8a2ad58a1918c9ed429e31819054ca4121f6ac1c0"}
Jul 15 21:24:08.006495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:08.006446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:24:08.501137 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:08.500700    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:24:09.600081 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.600045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" event={"ID":"ced4d86f-55de-417e-ba2f-d462f1aa727c","Type":"ContainerStarted","Data":"77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b"}
Jul 15 21:24:09.600467 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.600105    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:09.622178 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.622131    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" podStartSLOduration=3.141953125 podStartE2EDuration="5.62210976s" totalImagesPullingTime="2.480156635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:24:09.620696403 +0000 UTC m=+1500.774380949" watchObservedRunningTime="2026-07-15 21:24:09.62210976 +0000 UTC m=+1500.775794260"
Jul 15 21:24:09.897508 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.897427    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"]
Jul 15 21:24:09.900764 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.900747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"
Jul 15 21:24:09.903731 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.903714    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:24:09.909907 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.909881    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"]
Jul 15 21:24:09.995959 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:09.995923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4465aef2-15ec-4577-926d-850f61fed8b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq\" (UID: \"4465aef2-15ec-4577-926d-850f61fed8b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"
Jul 15 21:24:10.096817 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:10.096788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4465aef2-15ec-4577-926d-850f61fed8b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq\" (UID: \"4465aef2-15ec-4577-926d-850f61fed8b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"
Jul 15 21:24:10.097401 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:10.097383    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4465aef2-15ec-4577-926d-850f61fed8b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq\" (UID: \"4465aef2-15ec-4577-926d-850f61fed8b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"
Jul 15 21:24:10.211326 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:10.211242    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"
Jul 15 21:24:10.297941 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:10.296789    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:24:10.299513 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:10.299277    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:24:10.347005 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:10.346984    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"]
Jul 15 21:24:10.348781 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:24:10.348738    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4465aef2_15ec_4577_926d_850f61fed8b4.slice/crio-0415b6735f004339cba355c03bec4222d5bbf365484dad7e7a2dfcd85d4e7cf4 WatchSource:0}: Error finding container 0415b6735f004339cba355c03bec4222d5bbf365484dad7e7a2dfcd85d4e7cf4: Status 404 returned error can't find the container with id 0415b6735f004339cba355c03bec4222d5bbf365484dad7e7a2dfcd85d4e7cf4
Jul 15 21:24:10.611706 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:10.611669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq" event={"ID":"4465aef2-15ec-4577-926d-850f61fed8b4","Type":"ContainerStarted","Data":"0415b6735f004339cba355c03bec4222d5bbf365484dad7e7a2dfcd85d4e7cf4"}
Jul 15 21:24:13.627943 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:13.627908    2573 generic.go:356] "Generic (PLEG): container finished" podID="4465aef2-15ec-4577-926d-850f61fed8b4" containerID="20f010ba9b2a2393daee5da9c6e9df5de724b2746788e12f4103309e9af30b03" exitCode=7
Jul 15 21:24:13.628334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:13.627962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq" event={"ID":"4465aef2-15ec-4577-926d-850f61fed8b4","Type":"ContainerDied","Data":"20f010ba9b2a2393daee5da9c6e9df5de724b2746788e12f4103309e9af30b03"}
Jul 15 21:24:13.628334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:13.628206    2573 scope.go:117] "RemoveContainer" containerID="20f010ba9b2a2393daee5da9c6e9df5de724b2746788e12f4103309e9af30b03"
Jul 15 21:24:14.634391 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:14.634357    2573 generic.go:356] "Generic (PLEG): container finished" podID="4465aef2-15ec-4577-926d-850f61fed8b4" containerID="99998de763b395b750a51177e865d0f8e7bd8db874ce25ea6382b9620a7d6c6a" exitCode=7
Jul 15 21:24:14.634803 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:14.634410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq" event={"ID":"4465aef2-15ec-4577-926d-850f61fed8b4","Type":"ContainerDied","Data":"99998de763b395b750a51177e865d0f8e7bd8db874ce25ea6382b9620a7d6c6a"}
Jul 15 21:24:14.634803 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:14.634468    2573 scope.go:117] "RemoveContainer" containerID="20f010ba9b2a2393daee5da9c6e9df5de724b2746788e12f4103309e9af30b03"
Jul 15 21:24:14.634803 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:14.634636    2573 scope.go:117] "RemoveContainer" containerID="99998de763b395b750a51177e865d0f8e7bd8db874ce25ea6382b9620a7d6c6a"
Jul 15 21:24:14.634912 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:24:14.634850    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq_odh-ai-gateway-infra(4465aef2-15ec-4577-926d-850f61fed8b4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq" podUID="4465aef2-15ec-4577-926d-850f61fed8b4"
Jul 15 21:24:15.617305 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:15.617278    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:24:15.640911 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:15.640883    2573 scope.go:117] "RemoveContainer" containerID="99998de763b395b750a51177e865d0f8e7bd8db874ce25ea6382b9620a7d6c6a"
Jul 15 21:24:15.641291 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:24:15.641059    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq_odh-ai-gateway-infra(4465aef2-15ec-4577-926d-850f61fed8b4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq" podUID="4465aef2-15ec-4577-926d-850f61fed8b4"
Jul 15 21:24:31.568819 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:31.568735    2573 scope.go:117] "RemoveContainer" containerID="99998de763b395b750a51177e865d0f8e7bd8db874ce25ea6382b9620a7d6c6a"
Jul 15 21:24:32.730056 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:32.730022    2573 generic.go:356] "Generic (PLEG): container finished" podID="4465aef2-15ec-4577-926d-850f61fed8b4" containerID="a1b53119aa765162c4915c6e0b303786665fcf12449790b962fa630feb6a1864" exitCode=0
Jul 15 21:24:32.730457 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:32.730084    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq" event={"ID":"4465aef2-15ec-4577-926d-850f61fed8b4","Type":"ContainerDied","Data":"a1b53119aa765162c4915c6e0b303786665fcf12449790b962fa630feb6a1864"}
Jul 15 21:24:32.730457 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:32.730162    2573 scope.go:117] "RemoveContainer" containerID="99998de763b395b750a51177e865d0f8e7bd8db874ce25ea6382b9620a7d6c6a"
Jul 15 21:24:33.764301 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:33.764262    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"]
Jul 15 21:24:33.871321 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:33.871296    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"
Jul 15 21:24:34.018970 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.018888    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4465aef2-15ec-4577-926d-850f61fed8b4-maas-api-service-ca\") pod \"4465aef2-15ec-4577-926d-850f61fed8b4\" (UID: \"4465aef2-15ec-4577-926d-850f61fed8b4\") "
Jul 15 21:24:34.019230 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.019208    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4465aef2-15ec-4577-926d-850f61fed8b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4465aef2-15ec-4577-926d-850f61fed8b4" (UID: "4465aef2-15ec-4577-926d-850f61fed8b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:24:34.119473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.119440    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4465aef2-15ec-4577-926d-850f61fed8b4-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:24:34.742169 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.742134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq" event={"ID":"4465aef2-15ec-4577-926d-850f61fed8b4","Type":"ContainerDied","Data":"0415b6735f004339cba355c03bec4222d5bbf365484dad7e7a2dfcd85d4e7cf4"}
Jul 15 21:24:34.742169 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.742169    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"
Jul 15 21:24:34.742405 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.742182    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0415b6735f004339cba355c03bec4222d5bbf365484dad7e7a2dfcd85d4e7cf4"
Jul 15 21:24:34.782406 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.782375    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"]
Jul 15 21:24:34.786355 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:34.786333    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-nwprq"]
Jul 15 21:24:35.574483 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:35.574449    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" path="/var/lib/kubelet/pods/4465aef2-15ec-4577-926d-850f61fed8b4/volumes"
Jul 15 21:24:50.880287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:24:50.880251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:09.951823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.951789    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"]
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952189    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952203    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952219    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952226    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952233    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952240    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952296    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952304    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.952347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.952312    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4465aef2-15ec-4577-926d-850f61fed8b4" containerName="revoke-keys"
Jul 15 21:25:09.954931 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.954916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"
Jul 15 21:25:09.958632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.958611    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:25:09.968209 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:09.968185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"]
Jul 15 21:25:10.041645 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.041620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02fc875f-89dd-48da-9fc7-2d005fa9373d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl\" (UID: \"02fc875f-89dd-48da-9fc7-2d005fa9373d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"
Jul 15 21:25:10.142261 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.142234    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02fc875f-89dd-48da-9fc7-2d005fa9373d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl\" (UID: \"02fc875f-89dd-48da-9fc7-2d005fa9373d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"
Jul 15 21:25:10.142847 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.142830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02fc875f-89dd-48da-9fc7-2d005fa9373d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl\" (UID: \"02fc875f-89dd-48da-9fc7-2d005fa9373d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"
Jul 15 21:25:10.264861 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.264780    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"
Jul 15 21:25:10.395416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.395385    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"]
Jul 15 21:25:10.395617 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:25:10.395596    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fc875f_89dd_48da_9fc7_2d005fa9373d.slice/crio-cbedeb850353396cbbca1443ca19d9df9011258294d3d35e94e62daf9211c021 WatchSource:0}: Error finding container cbedeb850353396cbbca1443ca19d9df9011258294d3d35e94e62daf9211c021: Status 404 returned error can't find the container with id cbedeb850353396cbbca1443ca19d9df9011258294d3d35e94e62daf9211c021
Jul 15 21:25:10.702327 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.702279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:10.911197 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.911108    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl" event={"ID":"02fc875f-89dd-48da-9fc7-2d005fa9373d","Type":"ContainerStarted","Data":"8df31d8cf4529946c575d3f0cd1da1a84c07bcc49d611b4a35ec5b52aa6f8541"}
Jul 15 21:25:10.911197 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.911157    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl" event={"ID":"02fc875f-89dd-48da-9fc7-2d005fa9373d","Type":"ContainerStarted","Data":"cbedeb850353396cbbca1443ca19d9df9011258294d3d35e94e62daf9211c021"}
Jul 15 21:25:10.930926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:10.930874    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl" podStartSLOduration=1.9308576899999998 podStartE2EDuration="1.93085769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:25:10.92872001 +0000 UTC m=+1562.082404533" watchObservedRunningTime="2026-07-15 21:25:10.93085769 +0000 UTC m=+1562.084542214"
Jul 15 21:25:11.918206 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:11.918171    2573 generic.go:356] "Generic (PLEG): container finished" podID="02fc875f-89dd-48da-9fc7-2d005fa9373d" containerID="8df31d8cf4529946c575d3f0cd1da1a84c07bcc49d611b4a35ec5b52aa6f8541" exitCode=0
Jul 15 21:25:11.918592 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:11.918256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl" event={"ID":"02fc875f-89dd-48da-9fc7-2d005fa9373d","Type":"ContainerDied","Data":"8df31d8cf4529946c575d3f0cd1da1a84c07bcc49d611b4a35ec5b52aa6f8541"}
Jul 15 21:25:13.051215 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:13.051191    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"
Jul 15 21:25:13.169618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:13.169593    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02fc875f-89dd-48da-9fc7-2d005fa9373d-maas-api-service-ca\") pod \"02fc875f-89dd-48da-9fc7-2d005fa9373d\" (UID: \"02fc875f-89dd-48da-9fc7-2d005fa9373d\") "
Jul 15 21:25:13.169913 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:13.169892    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02fc875f-89dd-48da-9fc7-2d005fa9373d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "02fc875f-89dd-48da-9fc7-2d005fa9373d" (UID: "02fc875f-89dd-48da-9fc7-2d005fa9373d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:25:13.270497 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:13.270423    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02fc875f-89dd-48da-9fc7-2d005fa9373d-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:25:13.929217 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:13.929188    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl"
Jul 15 21:25:13.929401 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:13.929184    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl" event={"ID":"02fc875f-89dd-48da-9fc7-2d005fa9373d","Type":"ContainerDied","Data":"cbedeb850353396cbbca1443ca19d9df9011258294d3d35e94e62daf9211c021"}
Jul 15 21:25:13.929401 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:13.929325    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbedeb850353396cbbca1443ca19d9df9011258294d3d35e94e62daf9211c021"
Jul 15 21:25:14.743894 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:14.743864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:20.517215 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.517178    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"]
Jul 15 21:25:20.517599 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.517415    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" podUID="ced4d86f-55de-417e-ba2f-d462f1aa727c" containerName="maas-api" containerID="cri-o://77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b" gracePeriod=30
Jul 15 21:25:20.555472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.555396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:20.612305 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.612259    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" podUID="ced4d86f-55de-417e-ba2f-d462f1aa727c" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.38:8443/health\": dial tcp 10.133.0.38:8443: connect: connection refused"
Jul 15 21:25:20.769862 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.769803    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:25:20.939373 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.939346    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh8sp\" (UniqueName: \"kubernetes.io/projected/ced4d86f-55de-417e-ba2f-d462f1aa727c-kube-api-access-zh8sp\") pod \"ced4d86f-55de-417e-ba2f-d462f1aa727c\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") "
Jul 15 21:25:20.939563 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.939443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced4d86f-55de-417e-ba2f-d462f1aa727c-openshift-service-ca\") pod \"ced4d86f-55de-417e-ba2f-d462f1aa727c\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") "
Jul 15 21:25:20.939563 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.939472    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls\") pod \"ced4d86f-55de-417e-ba2f-d462f1aa727c\" (UID: \"ced4d86f-55de-417e-ba2f-d462f1aa727c\") "
Jul 15 21:25:20.939806 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.939780    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ced4d86f-55de-417e-ba2f-d462f1aa727c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ced4d86f-55de-417e-ba2f-d462f1aa727c" (UID: "ced4d86f-55de-417e-ba2f-d462f1aa727c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:25:20.941660 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.941629    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced4d86f-55de-417e-ba2f-d462f1aa727c-kube-api-access-zh8sp" (OuterVolumeSpecName: "kube-api-access-zh8sp") pod "ced4d86f-55de-417e-ba2f-d462f1aa727c" (UID: "ced4d86f-55de-417e-ba2f-d462f1aa727c"). InnerVolumeSpecName "kube-api-access-zh8sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:25:20.941774 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.941719    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ced4d86f-55de-417e-ba2f-d462f1aa727c" (UID: "ced4d86f-55de-417e-ba2f-d462f1aa727c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:25:20.963366 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.963338    2573 generic.go:356] "Generic (PLEG): container finished" podID="ced4d86f-55de-417e-ba2f-d462f1aa727c" containerID="77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b" exitCode=0
Jul 15 21:25:20.963481 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.963379    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"
Jul 15 21:25:20.963481 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.963420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" event={"ID":"ced4d86f-55de-417e-ba2f-d462f1aa727c","Type":"ContainerDied","Data":"77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b"}
Jul 15 21:25:20.963481 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.963467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx" event={"ID":"ced4d86f-55de-417e-ba2f-d462f1aa727c","Type":"ContainerDied","Data":"af99195f70cb019dc17db0c8a2ad58a1918c9ed429e31819054ca4121f6ac1c0"}
Jul 15 21:25:20.963636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.963488    2573 scope.go:117] "RemoveContainer" containerID="77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b"
Jul 15 21:25:20.972138 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.972123    2573 scope.go:117] "RemoveContainer" containerID="77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b"
Jul 15 21:25:20.972397 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:25:20.972380    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b\": container with ID starting with 77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b not found: ID does not exist" containerID="77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b"
Jul 15 21:25:20.972443 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.972403    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b"} err="failed to get container status \"77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b\": rpc error: code = NotFound desc = could not find container \"77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b\": container with ID starting with 77acc115ffe25ce476116b9b49ec210b629a128821b70f64df24dcd1b3b9f16b not found: ID does not exist"
Jul 15 21:25:20.985042 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.985021    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"]
Jul 15 21:25:20.987891 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:20.987870    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8f8143-58ff77df8d-n8zgx"]
Jul 15 21:25:21.040253 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:21.040198    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced4d86f-55de-417e-ba2f-d462f1aa727c-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:25:21.040253 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:21.040219    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced4d86f-55de-417e-ba2f-d462f1aa727c-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:25:21.040253 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:21.040230    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh8sp\" (UniqueName: \"kubernetes.io/projected/ced4d86f-55de-417e-ba2f-d462f1aa727c-kube-api-access-zh8sp\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:25:21.574624 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:21.574592    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced4d86f-55de-417e-ba2f-d462f1aa727c" path="/var/lib/kubelet/pods/ced4d86f-55de-417e-ba2f-d462f1aa727c/volumes"
Jul 15 21:25:23.397823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:23.397791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:25:25.055821 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:25.055788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:25.208847 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:25.208804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:25.311172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:25.311053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:31.660945 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:31.660920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:32.459876 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:32.459846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:32.531269 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:32.531240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:32.728858 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:32.728768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:32.820242 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:32.820212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:32.936496 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:32.936462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:33.034184 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:33.034061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:34.253933 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.253896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:34.310791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.310762    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"]
Jul 15 21:25:34.311145 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.311131    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced4d86f-55de-417e-ba2f-d462f1aa727c" containerName="maas-api"
Jul 15 21:25:34.311145 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.311146    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced4d86f-55de-417e-ba2f-d462f1aa727c" containerName="maas-api"
Jul 15 21:25:34.311252 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.311171    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02fc875f-89dd-48da-9fc7-2d005fa9373d" containerName="revoke-keys"
Jul 15 21:25:34.311252 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.311177    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02fc875f-89dd-48da-9fc7-2d005fa9373d" containerName="revoke-keys"
Jul 15 21:25:34.311252 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.311236    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="02fc875f-89dd-48da-9fc7-2d005fa9373d" containerName="revoke-keys"
Jul 15 21:25:34.311252 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.311244    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced4d86f-55de-417e-ba2f-d462f1aa727c" containerName="maas-api"
Jul 15 21:25:34.315800 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.315781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.318860 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.318738    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-52019953-serving-cert\""
Jul 15 21:25:34.318860 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.318763    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:25:34.318860 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.318791    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:25:34.319580 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.319536    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:25:34.325142 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.325124    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"]
Jul 15 21:25:34.354719 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.354691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c84f398-ce05-461b-9575-96cac6090fbc-openshift-service-ca\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.354844 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.354794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c84f398-ce05-461b-9575-96cac6090fbc-maas-api-tls\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.354844 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.354833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zh7\" (UniqueName: \"kubernetes.io/projected/4c84f398-ce05-461b-9575-96cac6090fbc-kube-api-access-k8zh7\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.355361 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.355338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:34.455926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.455890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c84f398-ce05-461b-9575-96cac6090fbc-openshift-service-ca\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.456135 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.455974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c84f398-ce05-461b-9575-96cac6090fbc-maas-api-tls\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.456135 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.456010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zh7\" (UniqueName: \"kubernetes.io/projected/4c84f398-ce05-461b-9575-96cac6090fbc-kube-api-access-k8zh7\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.456645 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.456617    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c84f398-ce05-461b-9575-96cac6090fbc-openshift-service-ca\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.458058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.458031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:34.458444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.458426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c84f398-ce05-461b-9575-96cac6090fbc-maas-api-tls\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.465288 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.465266    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zh7\" (UniqueName: \"kubernetes.io/projected/4c84f398-ce05-461b-9575-96cac6090fbc-kube-api-access-k8zh7\") pod \"maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.630323 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.630291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:34.781201 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:34.781179    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"]
Jul 15 21:25:34.783162 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:25:34.783138    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c84f398_ce05_461b_9575_96cac6090fbc.slice/crio-b8e46f65f247eb2ca51f601461002771af35fb5febf5f4bcfe8d7d2aba46b18c WatchSource:0}: Error finding container b8e46f65f247eb2ca51f601461002771af35fb5febf5f4bcfe8d7d2aba46b18c: Status 404 returned error can't find the container with id b8e46f65f247eb2ca51f601461002771af35fb5febf5f4bcfe8d7d2aba46b18c
Jul 15 21:25:35.033372 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:35.033294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8" event={"ID":"4c84f398-ce05-461b-9575-96cac6090fbc","Type":"ContainerStarted","Data":"b8e46f65f247eb2ca51f601461002771af35fb5febf5f4bcfe8d7d2aba46b18c"}
Jul 15 21:25:35.048863 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:35.048833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:35.148615 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:35.148577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:36.039927 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:36.039891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8" event={"ID":"4c84f398-ce05-461b-9575-96cac6090fbc","Type":"ContainerStarted","Data":"d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc"}
Jul 15 21:25:36.040314 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:36.039949    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:36.060688 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:36.060645    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8" podStartSLOduration=1.573636661 podStartE2EDuration="2.060627503s" totalImagesPullingTime="486.990842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:25:36.058329983 +0000 UTC m=+1587.212014504" watchObservedRunningTime="2026-07-15 21:25:36.060627503 +0000 UTC m=+1587.214312027"
Jul 15 21:25:36.803250 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:36.803212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:25:37.494649 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:37.494613    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:25:38.643954 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.643922    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"]
Jul 15 21:25:38.647589 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.647572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"
Jul 15 21:25:38.650591 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.650566    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:25:38.656952 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.656932    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"]
Jul 15 21:25:38.688080 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.688057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68abeda-cd2a-4f72-8968-5de83fdc0bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52019953-c7x4r\" (UID: \"e68abeda-cd2a-4f72-8968-5de83fdc0bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"
Jul 15 21:25:38.788594 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.788536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68abeda-cd2a-4f72-8968-5de83fdc0bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52019953-c7x4r\" (UID: \"e68abeda-cd2a-4f72-8968-5de83fdc0bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"
Jul 15 21:25:38.789138 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.789114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68abeda-cd2a-4f72-8968-5de83fdc0bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52019953-c7x4r\" (UID: \"e68abeda-cd2a-4f72-8968-5de83fdc0bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"
Jul 15 21:25:38.959253 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:38.959159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"
Jul 15 21:25:39.086699 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:39.086677    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"]
Jul 15 21:25:39.088795 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:25:39.088759    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68abeda_cd2a_4f72_8968_5de83fdc0bd5.slice/crio-a252c972f9f9aadbb74f872b4768aef45fa998eff796ba2e6e7fdcce16a98ed1 WatchSource:0}: Error finding container a252c972f9f9aadbb74f872b4768aef45fa998eff796ba2e6e7fdcce16a98ed1: Status 404 returned error can't find the container with id a252c972f9f9aadbb74f872b4768aef45fa998eff796ba2e6e7fdcce16a98ed1
Jul 15 21:25:40.061356 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:40.061262    2573 generic.go:356] "Generic (PLEG): container finished" podID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerID="394423641f8e93e3d05daba2a1fecf190387fbc5dd142bac974e16954cc661c5" exitCode=7
Jul 15 21:25:40.061761 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:40.061345    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" event={"ID":"e68abeda-cd2a-4f72-8968-5de83fdc0bd5","Type":"ContainerDied","Data":"394423641f8e93e3d05daba2a1fecf190387fbc5dd142bac974e16954cc661c5"}
Jul 15 21:25:40.061761 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:40.061397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" event={"ID":"e68abeda-cd2a-4f72-8968-5de83fdc0bd5","Type":"ContainerStarted","Data":"a252c972f9f9aadbb74f872b4768aef45fa998eff796ba2e6e7fdcce16a98ed1"}
Jul 15 21:25:40.061761 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:40.061511    2573 scope.go:117] "RemoveContainer" containerID="394423641f8e93e3d05daba2a1fecf190387fbc5dd142bac974e16954cc661c5"
Jul 15 21:25:41.068652 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:41.068572    2573 generic.go:356] "Generic (PLEG): container finished" podID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerID="dbd00ce77cc1d345bd38d423683fdf1fea9182244c133973c6f0a57be98b40b8" exitCode=7
Jul 15 21:25:41.069152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:41.068662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" event={"ID":"e68abeda-cd2a-4f72-8968-5de83fdc0bd5","Type":"ContainerDied","Data":"dbd00ce77cc1d345bd38d423683fdf1fea9182244c133973c6f0a57be98b40b8"}
Jul 15 21:25:41.069152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:41.068719    2573 scope.go:117] "RemoveContainer" containerID="394423641f8e93e3d05daba2a1fecf190387fbc5dd142bac974e16954cc661c5"
Jul 15 21:25:41.069152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:41.068830    2573 scope.go:117] "RemoveContainer" containerID="dbd00ce77cc1d345bd38d423683fdf1fea9182244c133973c6f0a57be98b40b8"
Jul 15 21:25:41.069152 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:25:41.069028    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-52019953-c7x4r_odh-ai-gateway-infra(e68abeda-cd2a-4f72-8968-5de83fdc0bd5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5"
Jul 15 21:25:42.050700 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:42.050666    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:25:42.075196 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:42.075166    2573 scope.go:117] "RemoveContainer" containerID="dbd00ce77cc1d345bd38d423683fdf1fea9182244c133973c6f0a57be98b40b8"
Jul 15 21:25:42.075615 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:25:42.075371    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-52019953-c7x4r_odh-ai-gateway-infra(e68abeda-cd2a-4f72-8968-5de83fdc0bd5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5"
Jul 15 21:25:57.569311 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:57.569276    2573 scope.go:117] "RemoveContainer" containerID="dbd00ce77cc1d345bd38d423683fdf1fea9182244c133973c6f0a57be98b40b8"
Jul 15 21:25:58.153953 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:58.153928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" event={"ID":"e68abeda-cd2a-4f72-8968-5de83fdc0bd5","Type":"ContainerStarted","Data":"7448bfe0ef99faa6f2d8714693b477cc1bc43c2f7ced1d11f980cd1594728137"}
Jul 15 21:25:59.161171 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.161136    2573 generic.go:356] "Generic (PLEG): container finished" podID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerID="7448bfe0ef99faa6f2d8714693b477cc1bc43c2f7ced1d11f980cd1594728137" exitCode=0
Jul 15 21:25:59.161616 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.161226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" event={"ID":"e68abeda-cd2a-4f72-8968-5de83fdc0bd5","Type":"ContainerDied","Data":"7448bfe0ef99faa6f2d8714693b477cc1bc43c2f7ced1d11f980cd1594728137"}
Jul 15 21:25:59.161616 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.161311    2573 scope.go:117] "RemoveContainer" containerID="dbd00ce77cc1d345bd38d423683fdf1fea9182244c133973c6f0a57be98b40b8"
Jul 15 21:25:59.184706 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.184679    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"]
Jul 15 21:25:59.297731 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.297707    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"
Jul 15 21:25:59.350181 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.350143    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68abeda-cd2a-4f72-8968-5de83fdc0bd5-maas-api-service-ca\") pod \"e68abeda-cd2a-4f72-8968-5de83fdc0bd5\" (UID: \"e68abeda-cd2a-4f72-8968-5de83fdc0bd5\") "
Jul 15 21:25:59.350496 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.350473    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68abeda-cd2a-4f72-8968-5de83fdc0bd5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e68abeda-cd2a-4f72-8968-5de83fdc0bd5" (UID: "e68abeda-cd2a-4f72-8968-5de83fdc0bd5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:25:59.451682 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:25:59.451604    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68abeda-cd2a-4f72-8968-5de83fdc0bd5-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:26:00.167420 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:00.167391    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"
Jul 15 21:26:00.167814 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:00.167426    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r" event={"ID":"e68abeda-cd2a-4f72-8968-5de83fdc0bd5","Type":"ContainerDied","Data":"a252c972f9f9aadbb74f872b4768aef45fa998eff796ba2e6e7fdcce16a98ed1"}
Jul 15 21:26:00.167814 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:00.167473    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a252c972f9f9aadbb74f872b4768aef45fa998eff796ba2e6e7fdcce16a98ed1"
Jul 15 21:26:00.200495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:00.200467    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"]
Jul 15 21:26:00.208501 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:00.208470    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-c7x4r"]
Jul 15 21:26:01.575122 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:01.575037    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" path="/var/lib/kubelet/pods/e68abeda-cd2a-4f72-8968-5de83fdc0bd5/volumes"
Jul 15 21:26:38.699524 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699488    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"]
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699854    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699865    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699876    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699881    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699892    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699898    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699968    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.699977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.699977    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:38.703154 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.703137    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"
Jul 15 21:26:38.713083 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.713063    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:26:38.716141 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.716119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"]
Jul 15 21:26:38.790977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.790945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:38.794074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.794051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8946e-c7af-4753-9f19-cc8c13d53b82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52019953-r9n5f\" (UID: \"84f8946e-c7af-4753-9f19-cc8c13d53b82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"
Jul 15 21:26:38.895632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.895604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8946e-c7af-4753-9f19-cc8c13d53b82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52019953-r9n5f\" (UID: \"84f8946e-c7af-4753-9f19-cc8c13d53b82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"
Jul 15 21:26:38.896260 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.896234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8946e-c7af-4753-9f19-cc8c13d53b82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52019953-r9n5f\" (UID: \"84f8946e-c7af-4753-9f19-cc8c13d53b82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"
Jul 15 21:26:38.972487 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:38.972405    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:39.014602 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:39.014577    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"
Jul 15 21:26:39.349585 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:39.349563    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"]
Jul 15 21:26:39.351611 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:26:39.351584    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f8946e_c7af_4753_9f19_cc8c13d53b82.slice/crio-820f2f9509fbd6620bb21f48c617b37a32042d3882b4665f189cfe3177602202 WatchSource:0}: Error finding container 820f2f9509fbd6620bb21f48c617b37a32042d3882b4665f189cfe3177602202: Status 404 returned error can't find the container with id 820f2f9509fbd6620bb21f48c617b37a32042d3882b4665f189cfe3177602202
Jul 15 21:26:39.358919 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:39.358869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f" event={"ID":"84f8946e-c7af-4753-9f19-cc8c13d53b82","Type":"ContainerStarted","Data":"820f2f9509fbd6620bb21f48c617b37a32042d3882b4665f189cfe3177602202"}
Jul 15 21:26:40.365351 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:40.365319    2573 generic.go:356] "Generic (PLEG): container finished" podID="84f8946e-c7af-4753-9f19-cc8c13d53b82" containerID="55357ed17a1b7e168d128e02482d541be8da8fd8bbb12d7d9f54c73f698bb706" exitCode=0
Jul 15 21:26:40.365723 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:40.365408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f" event={"ID":"84f8946e-c7af-4753-9f19-cc8c13d53b82","Type":"ContainerDied","Data":"55357ed17a1b7e168d128e02482d541be8da8fd8bbb12d7d9f54c73f698bb706"}
Jul 15 21:26:41.499898 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:41.499877    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"
Jul 15 21:26:41.517734 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:41.517572    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8946e-c7af-4753-9f19-cc8c13d53b82-maas-api-service-ca\") pod \"84f8946e-c7af-4753-9f19-cc8c13d53b82\" (UID: \"84f8946e-c7af-4753-9f19-cc8c13d53b82\") "
Jul 15 21:26:41.517986 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:41.517963    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f8946e-c7af-4753-9f19-cc8c13d53b82-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84f8946e-c7af-4753-9f19-cc8c13d53b82" (UID: "84f8946e-c7af-4753-9f19-cc8c13d53b82"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:26:41.619132 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:41.619106    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8946e-c7af-4753-9f19-cc8c13d53b82-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:26:41.692059 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:41.691999    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:26:42.376308 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:42.376283    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f"
Jul 15 21:26:42.376455 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:42.376279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52019953-r9n5f" event={"ID":"84f8946e-c7af-4753-9f19-cc8c13d53b82","Type":"ContainerDied","Data":"820f2f9509fbd6620bb21f48c617b37a32042d3882b4665f189cfe3177602202"}
Jul 15 21:26:42.376455 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:42.376401    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="820f2f9509fbd6620bb21f48c617b37a32042d3882b4665f189cfe3177602202"
Jul 15 21:26:44.319298 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.319218    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"]
Jul 15 21:26:44.352257 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.352217    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:44.385195 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.385161    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8" podUID="4c84f398-ce05-461b-9575-96cac6090fbc" containerName="maas-api" containerID="cri-o://d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc" gracePeriod=30
Jul 15 21:26:44.630195 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.630173    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:26:44.745261 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.745233    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8zh7\" (UniqueName: \"kubernetes.io/projected/4c84f398-ce05-461b-9575-96cac6090fbc-kube-api-access-k8zh7\") pod \"4c84f398-ce05-461b-9575-96cac6090fbc\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") "
Jul 15 21:26:44.745431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.745267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c84f398-ce05-461b-9575-96cac6090fbc-openshift-service-ca\") pod \"4c84f398-ce05-461b-9575-96cac6090fbc\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") "
Jul 15 21:26:44.745431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.745286    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c84f398-ce05-461b-9575-96cac6090fbc-maas-api-tls\") pod \"4c84f398-ce05-461b-9575-96cac6090fbc\" (UID: \"4c84f398-ce05-461b-9575-96cac6090fbc\") "
Jul 15 21:26:44.745643 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.745619    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c84f398-ce05-461b-9575-96cac6090fbc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c84f398-ce05-461b-9575-96cac6090fbc" (UID: "4c84f398-ce05-461b-9575-96cac6090fbc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:26:44.747262 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.747241    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c84f398-ce05-461b-9575-96cac6090fbc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c84f398-ce05-461b-9575-96cac6090fbc" (UID: "4c84f398-ce05-461b-9575-96cac6090fbc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:26:44.747262 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.747245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c84f398-ce05-461b-9575-96cac6090fbc-kube-api-access-k8zh7" (OuterVolumeSpecName: "kube-api-access-k8zh7") pod "4c84f398-ce05-461b-9575-96cac6090fbc" (UID: "4c84f398-ce05-461b-9575-96cac6090fbc"). InnerVolumeSpecName "kube-api-access-k8zh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:26:44.846908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.846876    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8zh7\" (UniqueName: \"kubernetes.io/projected/4c84f398-ce05-461b-9575-96cac6090fbc-kube-api-access-k8zh7\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:26:44.846908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.846906    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c84f398-ce05-461b-9575-96cac6090fbc-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:26:44.846908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:44.846916    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c84f398-ce05-461b-9575-96cac6090fbc-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:26:45.392243 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.392217    2573 generic.go:356] "Generic (PLEG): container finished" podID="4c84f398-ce05-461b-9575-96cac6090fbc" containerID="d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc" exitCode=0
Jul 15 21:26:45.392590 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.392273    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"
Jul 15 21:26:45.392590 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.392293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8" event={"ID":"4c84f398-ce05-461b-9575-96cac6090fbc","Type":"ContainerDied","Data":"d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc"}
Jul 15 21:26:45.392590 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.392341    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8" event={"ID":"4c84f398-ce05-461b-9575-96cac6090fbc","Type":"ContainerDied","Data":"b8e46f65f247eb2ca51f601461002771af35fb5febf5f4bcfe8d7d2aba46b18c"}
Jul 15 21:26:45.392590 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.392365    2573 scope.go:117] "RemoveContainer" containerID="d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc"
Jul 15 21:26:45.403288 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.403257    2573 scope.go:117] "RemoveContainer" containerID="d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc"
Jul 15 21:26:45.403617 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:26:45.403598    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc\": container with ID starting with d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc not found: ID does not exist" containerID="d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc"
Jul 15 21:26:45.403703 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.403623    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc"} err="failed to get container status \"d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc\": rpc error: code = NotFound desc = could not find container \"d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc\": container with ID starting with d1485d759cf9e5b9e972c76c75b3a0d15ee89c96cbee25c9239cee91593b48dc not found: ID does not exist"
Jul 15 21:26:45.420541 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.420514    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"]
Jul 15 21:26:45.424517 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.424494    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52019953-6c55cb664c-4zgq8"]
Jul 15 21:26:45.545180 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.545150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:45.574494 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.574467    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c84f398-ce05-461b-9575-96cac6090fbc" path="/var/lib/kubelet/pods/4c84f398-ce05-461b-9575-96cac6090fbc/volumes"
Jul 15 21:26:45.628809 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:45.628784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:48.817246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:48.817214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:48.951031 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:48.951000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:51.533105 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:51.533073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:51.609926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:51.609895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:51.760870 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:51.760837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:51.844801 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:51.844758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:52.944044 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:52.944012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:53.013499 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.013471    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"]
Jul 15 21:26:53.014097 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.014072    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f8946e-c7af-4753-9f19-cc8c13d53b82" containerName="revoke-keys"
Jul 15 21:26:53.014300 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.014270    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f8946e-c7af-4753-9f19-cc8c13d53b82" containerName="revoke-keys"
Jul 15 21:26:53.014393 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.014337    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c84f398-ce05-461b-9575-96cac6090fbc" containerName="maas-api"
Jul 15 21:26:53.014393 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.014345    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c84f398-ce05-461b-9575-96cac6090fbc" containerName="maas-api"
Jul 15 21:26:53.014469 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.014423    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68abeda-cd2a-4f72-8968-5de83fdc0bd5" containerName="revoke-keys"
Jul 15 21:26:53.014469 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.014435    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f8946e-c7af-4753-9f19-cc8c13d53b82" containerName="revoke-keys"
Jul 15 21:26:53.014469 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.014442    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c84f398-ce05-461b-9575-96cac6090fbc" containerName="maas-api"
Jul 15 21:26:53.019017 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.018997    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.021996 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.021976    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f1c9c155-serving-cert\""
Jul 15 21:26:53.021996 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.021993    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:26:53.022157 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.021996    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:26:53.022323 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.022289    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:26:53.029459 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.029437    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"]
Jul 15 21:26:53.031021 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.030998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:53.124159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.124132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a42a728-d010-457a-baf8-f0ed7982788d-openshift-service-ca\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.124334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.124225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.124334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.124251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5fl8\" (UniqueName: \"kubernetes.io/projected/7a42a728-d010-457a-baf8-f0ed7982788d-kube-api-access-g5fl8\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.197464 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.197386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:53.225105 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.225069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.225256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.225113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5fl8\" (UniqueName: \"kubernetes.io/projected/7a42a728-d010-457a-baf8-f0ed7982788d-kube-api-access-g5fl8\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.225256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.225184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a42a728-d010-457a-baf8-f0ed7982788d-openshift-service-ca\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.225256 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:26:53.225207    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-serving-cert: secret "maas-api-e2e-ait-f1c9c155-serving-cert" not found
Jul 15 21:26:53.225425 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:26:53.225279    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls podName:7a42a728-d010-457a-baf8-f0ed7982788d nodeName:}" failed. No retries permitted until 2026-07-15 21:26:53.725259939 +0000 UTC m=+1664.878944439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls") pod "maas-api-e2e-ait-f1c9c155-58d746657-v4wxq" (UID: "7a42a728-d010-457a-baf8-f0ed7982788d") : secret "maas-api-e2e-ait-f1c9c155-serving-cert" not found
Jul 15 21:26:53.226093 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.226069    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a42a728-d010-457a-baf8-f0ed7982788d-openshift-service-ca\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.242849 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.242824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5fl8\" (UniqueName: \"kubernetes.io/projected/7a42a728-d010-457a-baf8-f0ed7982788d-kube-api-access-g5fl8\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.406759 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.406729    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:53.672807 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.672765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:53.729849 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.729822    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.732189 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.732162    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls\") pod \"maas-api-e2e-ait-f1c9c155-58d746657-v4wxq\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:53.788489 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.788464    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:53.931206 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:53.931131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:54.069341 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:54.069320    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"]
Jul 15 21:26:54.072122 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:26:54.072094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a42a728_d010_457a_baf8_f0ed7982788d.slice/crio-84cffd722a630027206fd7f9d9dba9802ad31a20a81a44d82d7985493cf1800d WatchSource:0}: Error finding container 84cffd722a630027206fd7f9d9dba9802ad31a20a81a44d82d7985493cf1800d: Status 404 returned error can't find the container with id 84cffd722a630027206fd7f9d9dba9802ad31a20a81a44d82d7985493cf1800d
Jul 15 21:26:54.438093 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:54.438059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq" event={"ID":"7a42a728-d010-457a-baf8-f0ed7982788d","Type":"ContainerStarted","Data":"84cffd722a630027206fd7f9d9dba9802ad31a20a81a44d82d7985493cf1800d"}
Jul 15 21:26:55.095038 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:55.095007    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:26:55.444764 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:55.444729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq" event={"ID":"7a42a728-d010-457a-baf8-f0ed7982788d","Type":"ContainerStarted","Data":"04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5"}
Jul 15 21:26:55.444943 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:55.444820    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:26:55.469155 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:55.469098    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq" podStartSLOduration=2.857385787 podStartE2EDuration="3.469083185s" totalImagesPullingTime="611.697398ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:26:55.468404273 +0000 UTC m=+1666.622088797" watchObservedRunningTime="2026-07-15 21:26:55.469083185 +0000 UTC m=+1666.622767721"
Jul 15 21:26:55.691074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:55.691043    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:26:58.139401 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.139366    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"]
Jul 15 21:26:58.143096 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.143081    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"
Jul 15 21:26:58.146916 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.146891    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:26:58.152882 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.152860    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"]
Jul 15 21:26:58.269147 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.269116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcca074-b994-47d4-b339-1a4c8b872efa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f1c9c155-69tls\" (UID: \"3fcca074-b994-47d4-b339-1a4c8b872efa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"
Jul 15 21:26:58.370398 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.370367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcca074-b994-47d4-b339-1a4c8b872efa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f1c9c155-69tls\" (UID: \"3fcca074-b994-47d4-b339-1a4c8b872efa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"
Jul 15 21:26:58.370994 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.370973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcca074-b994-47d4-b339-1a4c8b872efa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f1c9c155-69tls\" (UID: \"3fcca074-b994-47d4-b339-1a4c8b872efa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"
Jul 15 21:26:58.453931 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.453849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"
Jul 15 21:26:58.585705 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:58.585676    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"]
Jul 15 21:26:58.586778 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:26:58.586754    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fcca074_b994_47d4_b339_1a4c8b872efa.slice/crio-4eff4d9ebe0cdb3d864a07f072bdf4252175bba3631ff9bf6603fd99f123ad59 WatchSource:0}: Error finding container 4eff4d9ebe0cdb3d864a07f072bdf4252175bba3631ff9bf6603fd99f123ad59: Status 404 returned error can't find the container with id 4eff4d9ebe0cdb3d864a07f072bdf4252175bba3631ff9bf6603fd99f123ad59
Jul 15 21:26:59.465921 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:59.465834    2573 generic.go:356] "Generic (PLEG): container finished" podID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerID="1c0ccf9b75c96afc9f06b60c442b82fea14e298dfa3ea682fffc0047167c18a5" exitCode=7
Jul 15 21:26:59.465921 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:59.465899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls" event={"ID":"3fcca074-b994-47d4-b339-1a4c8b872efa","Type":"ContainerDied","Data":"1c0ccf9b75c96afc9f06b60c442b82fea14e298dfa3ea682fffc0047167c18a5"}
Jul 15 21:26:59.466295 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:59.465951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls" event={"ID":"3fcca074-b994-47d4-b339-1a4c8b872efa","Type":"ContainerStarted","Data":"4eff4d9ebe0cdb3d864a07f072bdf4252175bba3631ff9bf6603fd99f123ad59"}
Jul 15 21:26:59.466295 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:26:59.466154    2573 scope.go:117] "RemoveContainer" containerID="1c0ccf9b75c96afc9f06b60c442b82fea14e298dfa3ea682fffc0047167c18a5"
Jul 15 21:27:00.472033 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:00.472004    2573 generic.go:356] "Generic (PLEG): container finished" podID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerID="e25e95aed523c2c553d0e6cf6a2cec5e15142dda92d908a227aa13999c68bb5c" exitCode=7
Jul 15 21:27:00.472440 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:00.472092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls" event={"ID":"3fcca074-b994-47d4-b339-1a4c8b872efa","Type":"ContainerDied","Data":"e25e95aed523c2c553d0e6cf6a2cec5e15142dda92d908a227aa13999c68bb5c"}
Jul 15 21:27:00.472440 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:00.472149    2573 scope.go:117] "RemoveContainer" containerID="1c0ccf9b75c96afc9f06b60c442b82fea14e298dfa3ea682fffc0047167c18a5"
Jul 15 21:27:00.472440 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:00.472287    2573 scope.go:117] "RemoveContainer" containerID="e25e95aed523c2c553d0e6cf6a2cec5e15142dda92d908a227aa13999c68bb5c"
Jul 15 21:27:00.472562 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:27:00.472484    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f1c9c155-69tls_odh-ai-gateway-infra(3fcca074-b994-47d4-b339-1a4c8b872efa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa"
Jul 15 21:27:01.455764 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:01.455731    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:27:01.487136 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:01.487109    2573 scope.go:117] "RemoveContainer" containerID="e25e95aed523c2c553d0e6cf6a2cec5e15142dda92d908a227aa13999c68bb5c"
Jul 15 21:27:01.487580 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:27:01.487327    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f1c9c155-69tls_odh-ai-gateway-infra(3fcca074-b994-47d4-b339-1a4c8b872efa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa"
Jul 15 21:27:13.568800 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:13.568765    2573 scope.go:117] "RemoveContainer" containerID="e25e95aed523c2c553d0e6cf6a2cec5e15142dda92d908a227aa13999c68bb5c"
Jul 15 21:27:14.550306 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:14.550225    2573 generic.go:356] "Generic (PLEG): container finished" podID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerID="a5a7e008a0e5585a188526d7a1154affe7cf0a3bd08bbb38afaccca07cffffbd" exitCode=0
Jul 15 21:27:14.550306 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:14.550296    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls" event={"ID":"3fcca074-b994-47d4-b339-1a4c8b872efa","Type":"ContainerDied","Data":"a5a7e008a0e5585a188526d7a1154affe7cf0a3bd08bbb38afaccca07cffffbd"}
Jul 15 21:27:14.550497 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:14.550361    2573 scope.go:117] "RemoveContainer" containerID="e25e95aed523c2c553d0e6cf6a2cec5e15142dda92d908a227aa13999c68bb5c"
Jul 15 21:27:15.588770 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:15.588741    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"]
Jul 15 21:27:15.685997 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:15.685972    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"
Jul 15 21:27:15.728532 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:15.728503    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcca074-b994-47d4-b339-1a4c8b872efa-maas-api-service-ca\") pod \"3fcca074-b994-47d4-b339-1a4c8b872efa\" (UID: \"3fcca074-b994-47d4-b339-1a4c8b872efa\") "
Jul 15 21:27:15.728829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:15.728809    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fcca074-b994-47d4-b339-1a4c8b872efa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3fcca074-b994-47d4-b339-1a4c8b872efa" (UID: "3fcca074-b994-47d4-b339-1a4c8b872efa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:27:15.829664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:15.829578    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcca074-b994-47d4-b339-1a4c8b872efa-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:27:16.562108 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:16.562079    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"
Jul 15 21:27:16.562108 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:16.562085    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls" event={"ID":"3fcca074-b994-47d4-b339-1a4c8b872efa","Type":"ContainerDied","Data":"4eff4d9ebe0cdb3d864a07f072bdf4252175bba3631ff9bf6603fd99f123ad59"}
Jul 15 21:27:16.562352 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:16.562132    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eff4d9ebe0cdb3d864a07f072bdf4252175bba3631ff9bf6603fd99f123ad59"
Jul 15 21:27:16.604189 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:16.604157    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"]
Jul 15 21:27:16.609483 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:16.609458    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-69tls"]
Jul 15 21:27:17.574715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:17.574673    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" path="/var/lib/kubelet/pods/3fcca074-b994-47d4-b339-1a4c8b872efa/volumes"
Jul 15 21:27:48.200614 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.200519    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"]
Jul 15 21:27:48.201159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.201085    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:27:48.201159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.201105    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:27:48.201159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.201119    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:27:48.201159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.201129    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:27:48.201367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.201234    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:27:48.201367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.201249    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:27:48.204306 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.204286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"
Jul 15 21:27:48.207157 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.207138    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:27:48.220452 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.220428    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"]
Jul 15 21:27:48.304511 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.304476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6bb050-192f-4b34-919b-64c3eb3862b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl\" (UID: \"3b6bb050-192f-4b34-919b-64c3eb3862b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"
Jul 15 21:27:48.405356 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.405328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6bb050-192f-4b34-919b-64c3eb3862b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl\" (UID: \"3b6bb050-192f-4b34-919b-64c3eb3862b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"
Jul 15 21:27:48.405954 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.405936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6bb050-192f-4b34-919b-64c3eb3862b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl\" (UID: \"3b6bb050-192f-4b34-919b-64c3eb3862b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"
Jul 15 21:27:48.514231 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.514168    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"
Jul 15 21:27:48.846802 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:48.846780    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"]
Jul 15 21:27:48.848601 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:27:48.848577    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6bb050_192f_4b34_919b_64c3eb3862b1.slice/crio-8484dbebdd0356b72bb9a86e91504a5c89ac71f485236845c3fd968181112a8c WatchSource:0}: Error finding container 8484dbebdd0356b72bb9a86e91504a5c89ac71f485236845c3fd968181112a8c: Status 404 returned error can't find the container with id 8484dbebdd0356b72bb9a86e91504a5c89ac71f485236845c3fd968181112a8c
Jul 15 21:27:49.718786 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:49.718695    2573 generic.go:356] "Generic (PLEG): container finished" podID="3b6bb050-192f-4b34-919b-64c3eb3862b1" containerID="af12215160d326f7a9110a5d3719a37458be1f351b35fa47f92d654e4369f064" exitCode=0
Jul 15 21:27:49.719168 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:49.718786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl" event={"ID":"3b6bb050-192f-4b34-919b-64c3eb3862b1","Type":"ContainerDied","Data":"af12215160d326f7a9110a5d3719a37458be1f351b35fa47f92d654e4369f064"}
Jul 15 21:27:49.719168 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:49.718850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl" event={"ID":"3b6bb050-192f-4b34-919b-64c3eb3862b1","Type":"ContainerStarted","Data":"8484dbebdd0356b72bb9a86e91504a5c89ac71f485236845c3fd968181112a8c"}
Jul 15 21:27:50.873104 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:50.873083    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"
Jul 15 21:27:51.029822 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:51.029739    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6bb050-192f-4b34-919b-64c3eb3862b1-maas-api-service-ca\") pod \"3b6bb050-192f-4b34-919b-64c3eb3862b1\" (UID: \"3b6bb050-192f-4b34-919b-64c3eb3862b1\") "
Jul 15 21:27:51.030070 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:51.030048    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b6bb050-192f-4b34-919b-64c3eb3862b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b6bb050-192f-4b34-919b-64c3eb3862b1" (UID: "3b6bb050-192f-4b34-919b-64c3eb3862b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:27:51.131055 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:51.131025    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6bb050-192f-4b34-919b-64c3eb3862b1-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:27:51.729178 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:51.729147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl" event={"ID":"3b6bb050-192f-4b34-919b-64c3eb3862b1","Type":"ContainerDied","Data":"8484dbebdd0356b72bb9a86e91504a5c89ac71f485236845c3fd968181112a8c"}
Jul 15 21:27:51.729178 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:51.729170    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl"
Jul 15 21:27:51.729358 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:51.729193    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8484dbebdd0356b72bb9a86e91504a5c89ac71f485236845c3fd968181112a8c"
Jul 15 21:27:58.784094 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:58.784060    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"]
Jul 15 21:27:58.784560 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:58.784303    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq" podUID="7a42a728-d010-457a-baf8-f0ed7982788d" containerName="maas-api" containerID="cri-o://04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5" gracePeriod=30
Jul 15 21:27:58.833254 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:58.833224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:27:59.033452 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.033428    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:27:59.198159 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.198125    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5fl8\" (UniqueName: \"kubernetes.io/projected/7a42a728-d010-457a-baf8-f0ed7982788d-kube-api-access-g5fl8\") pod \"7a42a728-d010-457a-baf8-f0ed7982788d\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") "
Jul 15 21:27:59.198340 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.198218    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a42a728-d010-457a-baf8-f0ed7982788d-openshift-service-ca\") pod \"7a42a728-d010-457a-baf8-f0ed7982788d\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") "
Jul 15 21:27:59.198340 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.198246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls\") pod \"7a42a728-d010-457a-baf8-f0ed7982788d\" (UID: \"7a42a728-d010-457a-baf8-f0ed7982788d\") "
Jul 15 21:27:59.198626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.198603    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a42a728-d010-457a-baf8-f0ed7982788d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a42a728-d010-457a-baf8-f0ed7982788d" (UID: "7a42a728-d010-457a-baf8-f0ed7982788d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:27:59.200199 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.200176    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a42a728-d010-457a-baf8-f0ed7982788d-kube-api-access-g5fl8" (OuterVolumeSpecName: "kube-api-access-g5fl8") pod "7a42a728-d010-457a-baf8-f0ed7982788d" (UID: "7a42a728-d010-457a-baf8-f0ed7982788d"). InnerVolumeSpecName "kube-api-access-g5fl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:27:59.200287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.200204    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a42a728-d010-457a-baf8-f0ed7982788d" (UID: "7a42a728-d010-457a-baf8-f0ed7982788d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:27:59.299884 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.299839    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a42a728-d010-457a-baf8-f0ed7982788d-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:27:59.299884 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.299878    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5fl8\" (UniqueName: \"kubernetes.io/projected/7a42a728-d010-457a-baf8-f0ed7982788d-kube-api-access-g5fl8\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:27:59.299884 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.299889    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a42a728-d010-457a-baf8-f0ed7982788d-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:27:59.771714 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.771677    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a42a728-d010-457a-baf8-f0ed7982788d" containerID="04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5" exitCode=0
Jul 15 21:27:59.771896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.771738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"
Jul 15 21:27:59.771896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.771770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq" event={"ID":"7a42a728-d010-457a-baf8-f0ed7982788d","Type":"ContainerDied","Data":"04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5"}
Jul 15 21:27:59.771896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.771834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq" event={"ID":"7a42a728-d010-457a-baf8-f0ed7982788d","Type":"ContainerDied","Data":"84cffd722a630027206fd7f9d9dba9802ad31a20a81a44d82d7985493cf1800d"}
Jul 15 21:27:59.771896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.771862    2573 scope.go:117] "RemoveContainer" containerID="04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5"
Jul 15 21:27:59.786026 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.785790    2573 scope.go:117] "RemoveContainer" containerID="04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5"
Jul 15 21:27:59.786304 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:27:59.786069    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5\": container with ID starting with 04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5 not found: ID does not exist" containerID="04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5"
Jul 15 21:27:59.786304 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.786093    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5"} err="failed to get container status \"04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5\": rpc error: code = NotFound desc = could not find container \"04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5\": container with ID starting with 04a3a6367154303c16b610bd2355caa4994ed88b51818ffccfe6b8e6b3b6e1f5 not found: ID does not exist"
Jul 15 21:27:59.796188 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.796161    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"]
Jul 15 21:27:59.803313 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:27:59.803289    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1c9c155-58d746657-v4wxq"]
Jul 15 21:28:01.575018 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:01.574981    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a42a728-d010-457a-baf8-f0ed7982788d" path="/var/lib/kubelet/pods/7a42a728-d010-457a-baf8-f0ed7982788d/volumes"
Jul 15 21:28:01.597710 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:01.597683    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:28:03.322401 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:03.322369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:03.434827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:03.434792    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:04.538288 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:04.538258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:04.637293 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:04.637260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:10.996226 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:10.996197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:11.425893 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:11.425857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:11.529653 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:11.529620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:11.718786 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:11.718711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:11.837146 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:11.837111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:12.885023 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:12.884988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:13.104589 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.104541    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"]
Jul 15 21:28:13.105168 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105148    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6bb050-192f-4b34-919b-64c3eb3862b1" containerName="revoke-keys"
Jul 15 21:28:13.105212 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105175    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6bb050-192f-4b34-919b-64c3eb3862b1" containerName="revoke-keys"
Jul 15 21:28:13.105212 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105199    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:28:13.105212 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105208    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:28:13.105304 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105226    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a42a728-d010-457a-baf8-f0ed7982788d" containerName="maas-api"
Jul 15 21:28:13.105304 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105235    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a42a728-d010-457a-baf8-f0ed7982788d" containerName="maas-api"
Jul 15 21:28:13.105368 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105339    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6bb050-192f-4b34-919b-64c3eb3862b1" containerName="revoke-keys"
Jul 15 21:28:13.105368 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105354    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a42a728-d010-457a-baf8-f0ed7982788d" containerName="maas-api"
Jul 15 21:28:13.105368 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.105362    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fcca074-b994-47d4-b339-1a4c8b872efa" containerName="revoke-keys"
Jul 15 21:28:13.108752 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.108736    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.113087 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.113065    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:28:13.114078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.114056    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ceeadc32-serving-cert\""
Jul 15 21:28:13.114277 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.114262    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:28:13.114362 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.114308    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:28:13.123823 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.123784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56a5b06d-398a-4d78-97c0-06929f1d9394-openshift-service-ca\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.123959 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.123848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2cls\" (UniqueName: \"kubernetes.io/projected/56a5b06d-398a-4d78-97c0-06929f1d9394-kube-api-access-s2cls\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.124035 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.123989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.126269 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.126248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"]
Jul 15 21:28:13.225041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.224943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56a5b06d-398a-4d78-97c0-06929f1d9394-openshift-service-ca\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.225041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.224987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2cls\" (UniqueName: \"kubernetes.io/projected/56a5b06d-398a-4d78-97c0-06929f1d9394-kube-api-access-s2cls\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.225041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.225032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.225323 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:28:13.225138    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-serving-cert: secret "maas-api-e2e-derive-ceeadc32-serving-cert" not found
Jul 15 21:28:13.225323 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:28:13.225204    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls podName:56a5b06d-398a-4d78-97c0-06929f1d9394 nodeName:}" failed. No retries permitted until 2026-07-15 21:28:13.725184165 +0000 UTC m=+1744.878868665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls") pod "maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs" (UID: "56a5b06d-398a-4d78-97c0-06929f1d9394") : secret "maas-api-e2e-derive-ceeadc32-serving-cert" not found
Jul 15 21:28:13.225620 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.225600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56a5b06d-398a-4d78-97c0-06929f1d9394-openshift-service-ca\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.244089 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.244063    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2cls\" (UniqueName: \"kubernetes.io/projected/56a5b06d-398a-4d78-97c0-06929f1d9394-kube-api-access-s2cls\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.448819 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.448788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:13.569629 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.569536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:13.730639 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.730603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.732941 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.732921    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls\") pod \"maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:13.835170 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.835093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:13.930152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:13.930121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:14.018946 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:14.018920    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:14.159058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:14.159035    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"]
Jul 15 21:28:14.160873 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:28:14.160846    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a5b06d_398a_4d78_97c0_06929f1d9394.slice/crio-f8d0acd1b5cc5bb5e7c1df991a46fc575ce5b932ef63fd000fc1f457b12933dd WatchSource:0}: Error finding container f8d0acd1b5cc5bb5e7c1df991a46fc575ce5b932ef63fd000fc1f457b12933dd: Status 404 returned error can't find the container with id f8d0acd1b5cc5bb5e7c1df991a46fc575ce5b932ef63fd000fc1f457b12933dd
Jul 15 21:28:14.836327 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:14.836294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:28:14.848777 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:14.848747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs" event={"ID":"56a5b06d-398a-4d78-97c0-06929f1d9394","Type":"ContainerStarted","Data":"f8d0acd1b5cc5bb5e7c1df991a46fc575ce5b932ef63fd000fc1f457b12933dd"}
Jul 15 21:28:15.855359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:15.855323    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs" event={"ID":"56a5b06d-398a-4d78-97c0-06929f1d9394","Type":"ContainerStarted","Data":"5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e"}
Jul 15 21:28:15.855733 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:15.855457    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:15.877630 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:15.877574    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs" podStartSLOduration=2.2629018739999998 podStartE2EDuration="2.877538019s" totalImagesPullingTime="614.636145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:28:15.875877887 +0000 UTC m=+1747.029562408" watchObservedRunningTime="2026-07-15 21:28:15.877538019 +0000 UTC m=+1747.031222539"
Jul 15 21:28:17.169005 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.168970    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"]
Jul 15 21:28:17.172541 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.172524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"
Jul 15 21:28:17.175412 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.175383    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:28:17.184036 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.184011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"]
Jul 15 21:28:17.256926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.256891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce3a053-73fa-443c-bbcb-09095331d938-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd\" (UID: \"9ce3a053-73fa-443c-bbcb-09095331d938\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"
Jul 15 21:28:17.358030 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.357993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce3a053-73fa-443c-bbcb-09095331d938-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd\" (UID: \"9ce3a053-73fa-443c-bbcb-09095331d938\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"
Jul 15 21:28:17.358727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.358701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce3a053-73fa-443c-bbcb-09095331d938-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd\" (UID: \"9ce3a053-73fa-443c-bbcb-09095331d938\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"
Jul 15 21:28:17.483332 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.483249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"
Jul 15 21:28:17.623097 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.623065    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"]
Jul 15 21:28:17.626899 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:28:17.626869    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce3a053_73fa_443c_bbcb_09095331d938.slice/crio-bce6bd4320586d7d5388e9dc744368ead2b2412c7f8886d419e9aab99531bcf0 WatchSource:0}: Error finding container bce6bd4320586d7d5388e9dc744368ead2b2412c7f8886d419e9aab99531bcf0: Status 404 returned error can't find the container with id bce6bd4320586d7d5388e9dc744368ead2b2412c7f8886d419e9aab99531bcf0
Jul 15 21:28:17.866976 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:17.866946    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" event={"ID":"9ce3a053-73fa-443c-bbcb-09095331d938","Type":"ContainerStarted","Data":"bce6bd4320586d7d5388e9dc744368ead2b2412c7f8886d419e9aab99531bcf0"}
Jul 15 21:28:18.873527 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:18.873490    2573 generic.go:356] "Generic (PLEG): container finished" podID="9ce3a053-73fa-443c-bbcb-09095331d938" containerID="e5812c65f189570769cc1a61965e3b22443e888ce146950e7b4ce85227307b6c" exitCode=7
Jul 15 21:28:18.873967 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:18.873537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" event={"ID":"9ce3a053-73fa-443c-bbcb-09095331d938","Type":"ContainerDied","Data":"e5812c65f189570769cc1a61965e3b22443e888ce146950e7b4ce85227307b6c"}
Jul 15 21:28:18.873967 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:18.873779    2573 scope.go:117] "RemoveContainer" containerID="e5812c65f189570769cc1a61965e3b22443e888ce146950e7b4ce85227307b6c"
Jul 15 21:28:19.886890 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:19.886856    2573 generic.go:356] "Generic (PLEG): container finished" podID="9ce3a053-73fa-443c-bbcb-09095331d938" containerID="53dff9746224f4e01ed1f4063e453f22d25e6a8eda4b0a820c54d66caf137e4a" exitCode=7
Jul 15 21:28:19.887354 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:19.886945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" event={"ID":"9ce3a053-73fa-443c-bbcb-09095331d938","Type":"ContainerDied","Data":"53dff9746224f4e01ed1f4063e453f22d25e6a8eda4b0a820c54d66caf137e4a"}
Jul 15 21:28:19.887354 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:19.887024    2573 scope.go:117] "RemoveContainer" containerID="e5812c65f189570769cc1a61965e3b22443e888ce146950e7b4ce85227307b6c"
Jul 15 21:28:19.887354 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:19.887120    2573 scope.go:117] "RemoveContainer" containerID="53dff9746224f4e01ed1f4063e453f22d25e6a8eda4b0a820c54d66caf137e4a"
Jul 15 21:28:19.887354 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:28:19.887317    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd_odh-ai-gateway-infra(9ce3a053-73fa-443c-bbcb-09095331d938)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" podUID="9ce3a053-73fa-443c-bbcb-09095331d938"
Jul 15 21:28:20.894146 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:20.894121    2573 scope.go:117] "RemoveContainer" containerID="53dff9746224f4e01ed1f4063e453f22d25e6a8eda4b0a820c54d66caf137e4a"
Jul 15 21:28:20.894634 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:28:20.894355    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd_odh-ai-gateway-infra(9ce3a053-73fa-443c-bbcb-09095331d938)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" podUID="9ce3a053-73fa-443c-bbcb-09095331d938"
Jul 15 21:28:21.502108 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:21.502073    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:28:21.865934 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:21.865901    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:28:33.569389 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:33.569355    2573 scope.go:117] "RemoveContainer" containerID="53dff9746224f4e01ed1f4063e453f22d25e6a8eda4b0a820c54d66caf137e4a"
Jul 15 21:28:33.961317 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:33.961267    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" event={"ID":"9ce3a053-73fa-443c-bbcb-09095331d938","Type":"ContainerStarted","Data":"46d272beffb74533fd72aea8ba82366efc24d25d535cdddd4ba78fb8c332e354"}
Jul 15 21:28:33.979727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:33.979682    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" podStartSLOduration=16.979667218 podStartE2EDuration="16.979667218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:28:33.978360949 +0000 UTC m=+1765.132045472" watchObservedRunningTime="2026-07-15 21:28:33.979667218 +0000 UTC m=+1765.133351738"
Jul 15 21:28:34.967333 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:34.967299    2573 generic.go:356] "Generic (PLEG): container finished" podID="9ce3a053-73fa-443c-bbcb-09095331d938" containerID="46d272beffb74533fd72aea8ba82366efc24d25d535cdddd4ba78fb8c332e354" exitCode=0
Jul 15 21:28:34.967748 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:34.967372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" event={"ID":"9ce3a053-73fa-443c-bbcb-09095331d938","Type":"ContainerDied","Data":"46d272beffb74533fd72aea8ba82366efc24d25d535cdddd4ba78fb8c332e354"}
Jul 15 21:28:34.967748 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:34.967461    2573 scope.go:117] "RemoveContainer" containerID="53dff9746224f4e01ed1f4063e453f22d25e6a8eda4b0a820c54d66caf137e4a"
Jul 15 21:28:34.996118 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:34.996094    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"]
Jul 15 21:28:36.113978 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:36.113956    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"
Jul 15 21:28:36.219025 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:36.218989    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce3a053-73fa-443c-bbcb-09095331d938-maas-api-service-ca\") pod \"9ce3a053-73fa-443c-bbcb-09095331d938\" (UID: \"9ce3a053-73fa-443c-bbcb-09095331d938\") "
Jul 15 21:28:36.219302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:36.219282    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ce3a053-73fa-443c-bbcb-09095331d938-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ce3a053-73fa-443c-bbcb-09095331d938" (UID: "9ce3a053-73fa-443c-bbcb-09095331d938"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:28:36.320214 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:36.320148    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce3a053-73fa-443c-bbcb-09095331d938-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:28:36.980152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:36.980119    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"
Jul 15 21:28:36.980152 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:36.980141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd" event={"ID":"9ce3a053-73fa-443c-bbcb-09095331d938","Type":"ContainerDied","Data":"bce6bd4320586d7d5388e9dc744368ead2b2412c7f8886d419e9aab99531bcf0"}
Jul 15 21:28:36.980379 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:36.980188    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bce6bd4320586d7d5388e9dc744368ead2b2412c7f8886d419e9aab99531bcf0"
Jul 15 21:28:37.012898 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:37.012873    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"]
Jul 15 21:28:37.017149 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:37.017128    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-sx6nd"]
Jul 15 21:28:37.575052 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:28:37.575021    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" path="/var/lib/kubelet/pods/9ce3a053-73fa-443c-bbcb-09095331d938/volumes"
Jul 15 21:29:07.229385 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229312    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"]
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229740    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229752    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229763    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229769    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229777    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229783    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229850    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.229872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.229863    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:29:07.233052 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.233033    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"
Jul 15 21:29:07.236688 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.236669    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:29:07.244018 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.243989    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"]
Jul 15 21:29:07.292932 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.292903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v\" (UID: \"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"
Jul 15 21:29:07.393909 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.393877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v\" (UID: \"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"
Jul 15 21:29:07.394446 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.394427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v\" (UID: \"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"
Jul 15 21:29:07.542747 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.542643    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"
Jul 15 21:29:07.673602 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:07.673576    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"]
Jul 15 21:29:07.674911 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:29:07.674888    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1f6056_c6f4_4ee3_9034_ffaac3b0ee0f.slice/crio-2fc882858399da699273268ca030ab3ca7a325d3d131b2535d431e2206e0953a WatchSource:0}: Error finding container 2fc882858399da699273268ca030ab3ca7a325d3d131b2535d431e2206e0953a: Status 404 returned error can't find the container with id 2fc882858399da699273268ca030ab3ca7a325d3d131b2535d431e2206e0953a
Jul 15 21:29:08.132150 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:08.132118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v" event={"ID":"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f","Type":"ContainerStarted","Data":"ecd93be9a4e4e642a5344686e49cda15d06ebbc904ef47bf4663d4c5dbec4f2a"}
Jul 15 21:29:08.132318 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:08.132165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v" event={"ID":"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f","Type":"ContainerStarted","Data":"2fc882858399da699273268ca030ab3ca7a325d3d131b2535d431e2206e0953a"}
Jul 15 21:29:08.162072 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:08.162031    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v" podStartSLOduration=1.162016912 podStartE2EDuration="1.162016912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:08.160110999 +0000 UTC m=+1799.313795519" watchObservedRunningTime="2026-07-15 21:29:08.162016912 +0000 UTC m=+1799.315701423"
Jul 15 21:29:09.138770 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:09.138732    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f" containerID="ecd93be9a4e4e642a5344686e49cda15d06ebbc904ef47bf4663d4c5dbec4f2a" exitCode=0
Jul 15 21:29:09.139168 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:09.138825    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v" event={"ID":"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f","Type":"ContainerDied","Data":"ecd93be9a4e4e642a5344686e49cda15d06ebbc904ef47bf4663d4c5dbec4f2a"}
Jul 15 21:29:10.275728 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:10.275706    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"
Jul 15 21:29:10.315441 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:10.315353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f-maas-api-service-ca\") pod \"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f\" (UID: \"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f\") "
Jul 15 21:29:10.338330 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:10.315741    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f" (UID: "3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:29:10.338330 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:10.337740    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:29:10.341365 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:10.341348    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:29:10.416825 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:10.416768    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:29:11.149328 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:11.149294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v" event={"ID":"3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f","Type":"ContainerDied","Data":"2fc882858399da699273268ca030ab3ca7a325d3d131b2535d431e2206e0953a"}
Jul 15 21:29:11.149492 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:11.149346    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fc882858399da699273268ca030ab3ca7a325d3d131b2535d431e2206e0953a"
Jul 15 21:29:11.149492 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:11.149309    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v"
Jul 15 21:29:17.840827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:17.840797    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"]
Jul 15 21:29:17.841164 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:17.841003    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs" podUID="56a5b06d-398a-4d78-97c0-06929f1d9394" containerName="maas-api" containerID="cri-o://5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e" gracePeriod=30
Jul 15 21:29:17.874470 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:17.874444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:18.090859 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.090835    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:29:18.184626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.184588    2573 generic.go:356] "Generic (PLEG): container finished" podID="56a5b06d-398a-4d78-97c0-06929f1d9394" containerID="5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e" exitCode=0
Jul 15 21:29:18.184626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.184630    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"
Jul 15 21:29:18.184868 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.184640    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs" event={"ID":"56a5b06d-398a-4d78-97c0-06929f1d9394","Type":"ContainerDied","Data":"5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e"}
Jul 15 21:29:18.184868 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.184688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs" event={"ID":"56a5b06d-398a-4d78-97c0-06929f1d9394","Type":"ContainerDied","Data":"f8d0acd1b5cc5bb5e7c1df991a46fc575ce5b932ef63fd000fc1f457b12933dd"}
Jul 15 21:29:18.184868 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.184712    2573 scope.go:117] "RemoveContainer" containerID="5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e"
Jul 15 21:29:18.188018 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.187997    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2cls\" (UniqueName: \"kubernetes.io/projected/56a5b06d-398a-4d78-97c0-06929f1d9394-kube-api-access-s2cls\") pod \"56a5b06d-398a-4d78-97c0-06929f1d9394\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") "
Jul 15 21:29:18.188115 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.188046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56a5b06d-398a-4d78-97c0-06929f1d9394-openshift-service-ca\") pod \"56a5b06d-398a-4d78-97c0-06929f1d9394\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") "
Jul 15 21:29:18.188177 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.188151    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls\") pod \"56a5b06d-398a-4d78-97c0-06929f1d9394\" (UID: \"56a5b06d-398a-4d78-97c0-06929f1d9394\") "
Jul 15 21:29:18.188484 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.188453    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a5b06d-398a-4d78-97c0-06929f1d9394-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56a5b06d-398a-4d78-97c0-06929f1d9394" (UID: "56a5b06d-398a-4d78-97c0-06929f1d9394"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:29:18.190161 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.190138    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a5b06d-398a-4d78-97c0-06929f1d9394-kube-api-access-s2cls" (OuterVolumeSpecName: "kube-api-access-s2cls") pod "56a5b06d-398a-4d78-97c0-06929f1d9394" (UID: "56a5b06d-398a-4d78-97c0-06929f1d9394"). InnerVolumeSpecName "kube-api-access-s2cls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:29:18.190240 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.190163    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56a5b06d-398a-4d78-97c0-06929f1d9394" (UID: "56a5b06d-398a-4d78-97c0-06929f1d9394"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:29:18.195872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.195843    2573 scope.go:117] "RemoveContainer" containerID="5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e"
Jul 15 21:29:18.196167 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:29:18.196141    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e\": container with ID starting with 5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e not found: ID does not exist" containerID="5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e"
Jul 15 21:29:18.196262 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.196175    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e"} err="failed to get container status \"5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e\": rpc error: code = NotFound desc = could not find container \"5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e\": container with ID starting with 5c255637f54bf69109b65e042127f7bcecf8443c19d70024a113e4635840278e not found: ID does not exist"
Jul 15 21:29:18.289026 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.288997    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56a5b06d-398a-4d78-97c0-06929f1d9394-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:29:18.289026 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.289023    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2cls\" (UniqueName: \"kubernetes.io/projected/56a5b06d-398a-4d78-97c0-06929f1d9394-kube-api-access-s2cls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:29:18.289026 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.289033    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56a5b06d-398a-4d78-97c0-06929f1d9394-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:29:18.512912 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.512886    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"]
Jul 15 21:29:18.515923 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:18.515900    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceeadc32-6cd7d46b6f-w6pgs"]
Jul 15 21:29:19.573943 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:19.573908    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a5b06d-398a-4d78-97c0-06929f1d9394" path="/var/lib/kubelet/pods/56a5b06d-398a-4d78-97c0-06929f1d9394/volumes"
Jul 15 21:29:20.989856 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:20.989822    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:29:22.349895 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:22.349862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:22.513600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:22.513559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:22.620673 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:22.620594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:29.459611 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:29.459578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:29.565862 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:29.565826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:29.664330 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:29.664299    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:29.760249 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:29.760125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:31.248323 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:31.248292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:37.970736 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:37.970675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:38.070819 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:38.070776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:38.171526 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:38.171483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:38.272743 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:38.272657    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:29:38.718428 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:29:38.718398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:00.147359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147327    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9"]
Jul 15 21:30:00.147735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147691    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f" containerName="revoke-keys"
Jul 15 21:30:00.147735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147703    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f" containerName="revoke-keys"
Jul 15 21:30:00.147735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147724    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a5b06d-398a-4d78-97c0-06929f1d9394" containerName="maas-api"
Jul 15 21:30:00.147735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147731    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a5b06d-398a-4d78-97c0-06929f1d9394" containerName="maas-api"
Jul 15 21:30:00.147865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147782    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f" containerName="revoke-keys"
Jul 15 21:30:00.147865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147793    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a5b06d-398a-4d78-97c0-06929f1d9394" containerName="maas-api"
Jul 15 21:30:00.147865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.147799    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce3a053-73fa-443c-bbcb-09095331d938" containerName="revoke-keys"
Jul 15 21:30:00.150812 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.150796    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9"
Jul 15 21:30:00.153287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.153270    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:30:00.158505 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.158480    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9"]
Jul 15 21:30:00.161130 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.161110    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9"
Jul 15 21:30:00.293374 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.293349    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9"]
Jul 15 21:30:00.295289 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:30:00.295255    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35319982_beaa_4aab_ab07_dcba7db6ed70.slice/crio-7e6bd0bcea1703fce345226c24320bf4d3c4bd9bef5aef6238783b710dff7434 WatchSource:0}: Error finding container 7e6bd0bcea1703fce345226c24320bf4d3c4bd9bef5aef6238783b710dff7434: Status 404 returned error can't find the container with id 7e6bd0bcea1703fce345226c24320bf4d3c4bd9bef5aef6238783b710dff7434
Jul 15 21:30:00.387498 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:00.387476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9" event={"ID":"35319982-beaa-4aab-ab07-dcba7db6ed70","Type":"ContainerStarted","Data":"7e6bd0bcea1703fce345226c24320bf4d3c4bd9bef5aef6238783b710dff7434"}
Jul 15 21:30:01.394112 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:01.394019    2573 generic.go:356] "Generic (PLEG): container finished" podID="35319982-beaa-4aab-ab07-dcba7db6ed70" containerID="d848ccf3b16fa29fce0ab6155583d8eb33fc81d04704104914922ca88a1b56d0" exitCode=0
Jul 15 21:30:01.394112 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:01.394099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9" event={"ID":"35319982-beaa-4aab-ab07-dcba7db6ed70","Type":"ContainerDied","Data":"d848ccf3b16fa29fce0ab6155583d8eb33fc81d04704104914922ca88a1b56d0"}
Jul 15 21:30:02.525898 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:02.525872    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9"
Jul 15 21:30:03.405993 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:03.405964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9" event={"ID":"35319982-beaa-4aab-ab07-dcba7db6ed70","Type":"ContainerDied","Data":"7e6bd0bcea1703fce345226c24320bf4d3c4bd9bef5aef6238783b710dff7434"}
Jul 15 21:30:03.406169 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:03.406011    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e6bd0bcea1703fce345226c24320bf4d3c4bd9bef5aef6238783b710dff7434"
Jul 15 21:30:03.406169 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:03.405974    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-lsjq9"
Jul 15 21:30:04.680493 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:04.680462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:11.317671 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:11.317640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:11.431729 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:11.431700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:11.524421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:11.524393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:27.411052 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:27.411020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:33.819843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:33.819770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:33.931909 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:33.931878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:34.021294 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:34.021268    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:44.530881 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:44.530848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:45.333356 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:45.333325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:53.437636 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:53.437605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:53.561811 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:53.561777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:53.716487 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:53.716411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:54.467459 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:54.467427    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:54.567829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:54.567780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:54.750318 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:54.750241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:56.231392 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:56.231360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:30:56.490303 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:30:56.490224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:31:02.823983 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:02.823944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:02.924670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:02.924637    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:03.496446 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:03.496415    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:06.087198 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:06.087162    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:31:09.525659 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:09.525629    2573 scope.go:117] "RemoveContainer" containerID="a1b53119aa765162c4915c6e0b303786665fcf12449790b962fa630feb6a1864"
Jul 15 21:31:10.137969 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:10.137938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:10.238409 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:10.238381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:10.386397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:10.386366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:10.686398 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:10.686364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:10.847289 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:10.847262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:13.432354 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.432318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:13.534769 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.534737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:13.715341 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.715258    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"]
Jul 15 21:31:13.715709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.715693    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35319982-beaa-4aab-ab07-dcba7db6ed70" containerName="cleanup"
Jul 15 21:31:13.715793 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.715711    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="35319982-beaa-4aab-ab07-dcba7db6ed70" containerName="cleanup"
Jul 15 21:31:13.715793 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.715783    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="35319982-beaa-4aab-ab07-dcba7db6ed70" containerName="cleanup"
Jul 15 21:31:13.718431 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.718411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.721319 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.721301    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-77f212fb-serving-cert\""
Jul 15 21:31:13.721655 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.721638    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:31:13.722703 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.722684    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:31:13.722827 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.722724    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:31:13.730650 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.730630    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"]
Jul 15 21:31:13.747079 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.747045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:13.771082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.771058    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.771196 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.771096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847e9447-525a-4b52-a4c0-5531df81acfb-openshift-service-ca\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.771196 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.771119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqxvh\" (UniqueName: \"kubernetes.io/projected/847e9447-525a-4b52-a4c0-5531df81acfb-kube-api-access-gqxvh\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.872444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.872407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847e9447-525a-4b52-a4c0-5531df81acfb-openshift-service-ca\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.872444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.872450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqxvh\" (UniqueName: \"kubernetes.io/projected/847e9447-525a-4b52-a4c0-5531df81acfb-kube-api-access-gqxvh\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.878474 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.872567    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.878474 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:31:13.872998    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-serving-cert: secret "maas-api-e2e-mt-77f212fb-serving-cert" not found
Jul 15 21:31:13.878474 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:31:13.873083    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls podName:847e9447-525a-4b52-a4c0-5531df81acfb nodeName:}" failed. No retries permitted until 2026-07-15 21:31:14.373061252 +0000 UTC m=+1925.526745765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls") pod "maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg" (UID: "847e9447-525a-4b52-a4c0-5531df81acfb") : secret "maas-api-e2e-mt-77f212fb-serving-cert" not found
Jul 15 21:31:13.878474 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.873522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847e9447-525a-4b52-a4c0-5531df81acfb-openshift-service-ca\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:13.882256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:13.882232    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqxvh\" (UniqueName: \"kubernetes.io/projected/847e9447-525a-4b52-a4c0-5531df81acfb-kube-api-access-gqxvh\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:14.075395 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.075308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:14.233646 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.233616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:14.377959 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.377924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:14.380390 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.380366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls\") pod \"maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:14.629070 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.628990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:14.909125 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.909046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:14.963958 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.963928    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"]
Jul 15 21:31:14.966405 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:31:14.966371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847e9447_525a_4b52_a4c0_5531df81acfb.slice/crio-64a20c5c753138ac8434f3533d18b20f80d54bd26042b7531a8387630ba05a0c WatchSource:0}: Error finding container 64a20c5c753138ac8434f3533d18b20f80d54bd26042b7531a8387630ba05a0c: Status 404 returned error can't find the container with id 64a20c5c753138ac8434f3533d18b20f80d54bd26042b7531a8387630ba05a0c
Jul 15 21:31:14.967642 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:14.967619    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:31:15.759450 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:15.759414    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg" event={"ID":"847e9447-525a-4b52-a4c0-5531df81acfb","Type":"ContainerStarted","Data":"64a20c5c753138ac8434f3533d18b20f80d54bd26042b7531a8387630ba05a0c"}
Jul 15 21:31:16.765677 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:16.765642    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg" event={"ID":"847e9447-525a-4b52-a4c0-5531df81acfb","Type":"ContainerStarted","Data":"08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4"}
Jul 15 21:31:16.766125 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:16.765769    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:16.785725 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:16.785680    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg" podStartSLOduration=2.656337348 podStartE2EDuration="3.785665412s" totalImagesPullingTime="1.129328064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:31:16.783380472 +0000 UTC m=+1927.937064994" watchObservedRunningTime="2026-07-15 21:31:16.785665412 +0000 UTC m=+1927.939349933"
Jul 15 21:31:17.913982 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:17.913909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:18.869942 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:18.869912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:18.970412 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:18.970383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:19.076853 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:19.076822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:20.592624 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:20.592587    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:31:22.775844 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:22.775816    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:25.364453 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.364421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:25.450313 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.450283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:25.720573 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.720492    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"]
Jul 15 21:31:25.724223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.724208    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"
Jul 15 21:31:25.726813 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.726792    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:31:25.742392 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.742373    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"]
Jul 15 21:31:25.875078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.875053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced7363-df98-44e6-9213-59b58c5853d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x\" (UID: \"3ced7363-df98-44e6-9213-59b58c5853d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"
Jul 15 21:31:25.976097 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.976031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced7363-df98-44e6-9213-59b58c5853d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x\" (UID: \"3ced7363-df98-44e6-9213-59b58c5853d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"
Jul 15 21:31:25.976632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:25.976614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced7363-df98-44e6-9213-59b58c5853d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x\" (UID: \"3ced7363-df98-44e6-9213-59b58c5853d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"
Jul 15 21:31:26.033607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:26.033573    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"
Jul 15 21:31:26.166049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:26.166027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"]
Jul 15 21:31:26.167737 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:31:26.167710    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ced7363_df98_44e6_9213_59b58c5853d6.slice/crio-b66f9c58546e12732916a451c0c52e8d8d5bcdee69e4de7ef5d23455b82fdf0f WatchSource:0}: Error finding container b66f9c58546e12732916a451c0c52e8d8d5bcdee69e4de7ef5d23455b82fdf0f: Status 404 returned error can't find the container with id b66f9c58546e12732916a451c0c52e8d8d5bcdee69e4de7ef5d23455b82fdf0f
Jul 15 21:31:26.816735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:26.816705    2573 generic.go:356] "Generic (PLEG): container finished" podID="3ced7363-df98-44e6-9213-59b58c5853d6" containerID="c8aba565c06d8bf3eb0d388197c3550041d5727c955db740d33f8725dba84ee7" exitCode=0
Jul 15 21:31:26.817199 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:26.816742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x" event={"ID":"3ced7363-df98-44e6-9213-59b58c5853d6","Type":"ContainerDied","Data":"c8aba565c06d8bf3eb0d388197c3550041d5727c955db740d33f8725dba84ee7"}
Jul 15 21:31:26.817199 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:26.816820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x" event={"ID":"3ced7363-df98-44e6-9213-59b58c5853d6","Type":"ContainerStarted","Data":"b66f9c58546e12732916a451c0c52e8d8d5bcdee69e4de7ef5d23455b82fdf0f"}
Jul 15 21:31:27.953241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:27.953218    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"
Jul 15 21:31:28.096838 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:28.096815    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced7363-df98-44e6-9213-59b58c5853d6-maas-api-service-ca\") pod \"3ced7363-df98-44e6-9213-59b58c5853d6\" (UID: \"3ced7363-df98-44e6-9213-59b58c5853d6\") "
Jul 15 21:31:28.097151 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:28.097128    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ced7363-df98-44e6-9213-59b58c5853d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ced7363-df98-44e6-9213-59b58c5853d6" (UID: "3ced7363-df98-44e6-9213-59b58c5853d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:31:28.197542 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:28.197514    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced7363-df98-44e6-9213-59b58c5853d6-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:31:28.827619 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:28.827587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x" event={"ID":"3ced7363-df98-44e6-9213-59b58c5853d6","Type":"ContainerDied","Data":"b66f9c58546e12732916a451c0c52e8d8d5bcdee69e4de7ef5d23455b82fdf0f"}
Jul 15 21:31:28.827775 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:28.827637    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b66f9c58546e12732916a451c0c52e8d8d5bcdee69e4de7ef5d23455b82fdf0f"
Jul 15 21:31:28.827775 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:28.827666    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x"
Jul 15 21:31:36.347040 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.347007    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"]
Jul 15 21:31:36.347467 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.347244    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg" podUID="847e9447-525a-4b52-a4c0-5531df81acfb" containerName="maas-api" containerID="cri-o://08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4" gracePeriod=30
Jul 15 21:31:36.375543 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.375519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:36.594256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.594231    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:36.774599 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.774518    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls\") pod \"847e9447-525a-4b52-a4c0-5531df81acfb\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") "
Jul 15 21:31:36.774599 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.774587    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847e9447-525a-4b52-a4c0-5531df81acfb-openshift-service-ca\") pod \"847e9447-525a-4b52-a4c0-5531df81acfb\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") "
Jul 15 21:31:36.774772 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.774619    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqxvh\" (UniqueName: \"kubernetes.io/projected/847e9447-525a-4b52-a4c0-5531df81acfb-kube-api-access-gqxvh\") pod \"847e9447-525a-4b52-a4c0-5531df81acfb\" (UID: \"847e9447-525a-4b52-a4c0-5531df81acfb\") "
Jul 15 21:31:36.774916 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.774894    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/847e9447-525a-4b52-a4c0-5531df81acfb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "847e9447-525a-4b52-a4c0-5531df81acfb" (UID: "847e9447-525a-4b52-a4c0-5531df81acfb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:31:36.776629 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.776603    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847e9447-525a-4b52-a4c0-5531df81acfb-kube-api-access-gqxvh" (OuterVolumeSpecName: "kube-api-access-gqxvh") pod "847e9447-525a-4b52-a4c0-5531df81acfb" (UID: "847e9447-525a-4b52-a4c0-5531df81acfb"). InnerVolumeSpecName "kube-api-access-gqxvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:31:36.776629 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.776613    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "847e9447-525a-4b52-a4c0-5531df81acfb" (UID: "847e9447-525a-4b52-a4c0-5531df81acfb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:31:36.867901 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.867873    2573 generic.go:356] "Generic (PLEG): container finished" podID="847e9447-525a-4b52-a4c0-5531df81acfb" containerID="08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4" exitCode=0
Jul 15 21:31:36.868025 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.867912    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"
Jul 15 21:31:36.868025 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.867958    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg" event={"ID":"847e9447-525a-4b52-a4c0-5531df81acfb","Type":"ContainerDied","Data":"08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4"}
Jul 15 21:31:36.868025 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.867998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg" event={"ID":"847e9447-525a-4b52-a4c0-5531df81acfb","Type":"ContainerDied","Data":"64a20c5c753138ac8434f3533d18b20f80d54bd26042b7531a8387630ba05a0c"}
Jul 15 21:31:36.868025 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.868018    2573 scope.go:117] "RemoveContainer" containerID="08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4"
Jul 15 21:31:36.875332 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.875307    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847e9447-525a-4b52-a4c0-5531df81acfb-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:31:36.875426 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.875336    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqxvh\" (UniqueName: \"kubernetes.io/projected/847e9447-525a-4b52-a4c0-5531df81acfb-kube-api-access-gqxvh\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:31:36.875426 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.875352    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847e9447-525a-4b52-a4c0-5531df81acfb-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:31:36.876940 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.876923    2573 scope.go:117] "RemoveContainer" containerID="08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4"
Jul 15 21:31:36.877178 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:31:36.877160    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4\": container with ID starting with 08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4 not found: ID does not exist" containerID="08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4"
Jul 15 21:31:36.877230 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.877186    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4"} err="failed to get container status \"08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4\": rpc error: code = NotFound desc = could not find container \"08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4\": container with ID starting with 08e42f2a6b5a21e2d2d1e191605bcbf3944ce4c85ffa1eb889c280164a8f01f4 not found: ID does not exist"
Jul 15 21:31:36.890339 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.890320    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"]
Jul 15 21:31:36.895897 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:36.895880    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f212fb-78c6bd8b6d-bxhzg"]
Jul 15 21:31:37.574136 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:37.574103    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847e9447-525a-4b52-a4c0-5531df81acfb" path="/var/lib/kubelet/pods/847e9447-525a-4b52-a4c0-5531df81acfb/volumes"
Jul 15 21:31:39.508700 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:39.508669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:31:40.812059 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:40.812030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:41.222093 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:41.222060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:46.899070 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:46.899038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:46.999816 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:46.999786    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:47.584200 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:47.584166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:47.971793 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:47.971758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:48.066541 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:48.066506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:48.234272 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:48.234195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:48.394520 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:48.394476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:48.497618 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:48.497516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:49.606080 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:49.606046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:49.706972 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:49.706936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:49.815707 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:49.815670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:49.914375 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:49.914291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:54.735347 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:54.735307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:54.844507 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:54.844476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:54.938834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:54.938806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:31:55.105930 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:31:55.105897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:01.072112 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:01.072072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:01.173122 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:01.173078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:07.912448 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:07.912420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:08.154536 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:08.154495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:08.258342 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:08.258237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:09.545264 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:09.545232    2573 scope.go:117] "RemoveContainer" containerID="7448bfe0ef99faa6f2d8714693b477cc1bc43c2f7ced1d11f980cd1594728137"
Jul 15 21:32:10.717505 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.717467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:10.795560 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.795515    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"]
Jul 15 21:32:10.796065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.796037    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847e9447-525a-4b52-a4c0-5531df81acfb" containerName="maas-api"
Jul 15 21:32:10.796065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.796055    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="847e9447-525a-4b52-a4c0-5531df81acfb" containerName="maas-api"
Jul 15 21:32:10.796065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.796065    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ced7363-df98-44e6-9213-59b58c5853d6" containerName="revoke-keys"
Jul 15 21:32:10.796065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.796071    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ced7363-df98-44e6-9213-59b58c5853d6" containerName="revoke-keys"
Jul 15 21:32:10.796324 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.796170    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ced7363-df98-44e6-9213-59b58c5853d6" containerName="revoke-keys"
Jul 15 21:32:10.796324 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.796180    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="847e9447-525a-4b52-a4c0-5531df81acfb" containerName="maas-api"
Jul 15 21:32:10.800996 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.800976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.803918 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.803901    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:32:10.804149 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.804132    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-372e1c00-serving-cert\""
Jul 15 21:32:10.804193 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.804172    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:32:10.804895 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.804882    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:32:10.810037 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.809422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:10.811040 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.811018    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"]
Jul 15 21:32:10.868975 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.868941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b178f915-a1ca-4219-98fa-657ad97f5338-openshift-service-ca\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.869155 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.868983    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhvv\" (UniqueName: \"kubernetes.io/projected/b178f915-a1ca-4219-98fa-657ad97f5338-kube-api-access-clhvv\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.869155 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.869023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.881153 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.881122    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:10.970432 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.970338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b178f915-a1ca-4219-98fa-657ad97f5338-openshift-service-ca\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.970432 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.970386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhvv\" (UniqueName: \"kubernetes.io/projected/b178f915-a1ca-4219-98fa-657ad97f5338-kube-api-access-clhvv\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.970697 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.970438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.970697 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:32:10.970584    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-serving-cert: secret "maas-api-e2e-mt-372e1c00-serving-cert" not found
Jul 15 21:32:10.970697 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:32:10.970649    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls podName:b178f915-a1ca-4219-98fa-657ad97f5338 nodeName:}" failed. No retries permitted until 2026-07-15 21:32:11.4706285 +0000 UTC m=+1982.624313000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls") pod "maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t" (UID: "b178f915-a1ca-4219-98fa-657ad97f5338") : secret "maas-api-e2e-mt-372e1c00-serving-cert" not found
Jul 15 21:32:10.970921 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.970901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b178f915-a1ca-4219-98fa-657ad97f5338-openshift-service-ca\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:10.980831 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:10.980810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhvv\" (UniqueName: \"kubernetes.io/projected/b178f915-a1ca-4219-98fa-657ad97f5338-kube-api-access-clhvv\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:11.086561 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:11.086523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:11.475615 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:11.475583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:11.478065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:11.478038    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls\") pod \"maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:11.510943 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:11.510910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:11.604275 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:11.604245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:11.714563 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:11.714512    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:11.846363 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:32:11.846330    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb178f915_a1ca_4219_98fa_657ad97f5338.slice/crio-67dd2a763027b5e23e16c34f0846750ed7523241cce560d73b118fd1803d817d WatchSource:0}: Error finding container 67dd2a763027b5e23e16c34f0846750ed7523241cce560d73b118fd1803d817d: Status 404 returned error can't find the container with id 67dd2a763027b5e23e16c34f0846750ed7523241cce560d73b118fd1803d817d
Jul 15 21:32:11.849889 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:11.849866    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"]
Jul 15 21:32:12.043150 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:12.043069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t" event={"ID":"b178f915-a1ca-4219-98fa-657ad97f5338","Type":"ContainerStarted","Data":"67dd2a763027b5e23e16c34f0846750ed7523241cce560d73b118fd1803d817d"}
Jul 15 21:32:13.049829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:13.049795    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t" event={"ID":"b178f915-a1ca-4219-98fa-657ad97f5338","Type":"ContainerStarted","Data":"ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e"}
Jul 15 21:32:13.050199 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:13.049905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:13.069267 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:13.069225    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t" podStartSLOduration=2.511233667 podStartE2EDuration="3.069210646s" totalImagesPullingTime="557.976979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:32:13.068127807 +0000 UTC m=+1984.221812330" watchObservedRunningTime="2026-07-15 21:32:13.069210646 +0000 UTC m=+1984.222895166"
Jul 15 21:32:15.616843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:15.616812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:17.195755 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:17.195719    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:32:19.059813 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:19.059785    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:32:23.930698 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:23.930662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:32:28.311729 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:28.311693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:32:41.093917 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:41.093879    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:32:48.655495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.655459    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"]
Jul 15 21:32:48.658963 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.658945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"
Jul 15 21:32:48.661891 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.661866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:32:48.669559 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.669520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"]
Jul 15 21:32:48.705676 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.705648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ced6a3-4519-4791-84f6-87ed646ba886-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8\" (UID: \"43ced6a3-4519-4791-84f6-87ed646ba886\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"
Jul 15 21:32:48.806758 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.806732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ced6a3-4519-4791-84f6-87ed646ba886-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8\" (UID: \"43ced6a3-4519-4791-84f6-87ed646ba886\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"
Jul 15 21:32:48.807275 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.807256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ced6a3-4519-4791-84f6-87ed646ba886-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8\" (UID: \"43ced6a3-4519-4791-84f6-87ed646ba886\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"
Jul 15 21:32:48.970620 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:48.970535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"
Jul 15 21:32:49.114877 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:49.114843    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"]
Jul 15 21:32:49.115843 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:32:49.115816    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ced6a3_4519_4791_84f6_87ed646ba886.slice/crio-73c620b6b3bafacbb286b2abc1db11c7d1e81cf4ebbf2ab2dec8cf674d305852 WatchSource:0}: Error finding container 73c620b6b3bafacbb286b2abc1db11c7d1e81cf4ebbf2ab2dec8cf674d305852: Status 404 returned error can't find the container with id 73c620b6b3bafacbb286b2abc1db11c7d1e81cf4ebbf2ab2dec8cf674d305852
Jul 15 21:32:49.232301 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:49.232224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8" event={"ID":"43ced6a3-4519-4791-84f6-87ed646ba886","Type":"ContainerStarted","Data":"73c620b6b3bafacbb286b2abc1db11c7d1e81cf4ebbf2ab2dec8cf674d305852"}
Jul 15 21:32:50.238914 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:50.238880    2573 generic.go:356] "Generic (PLEG): container finished" podID="43ced6a3-4519-4791-84f6-87ed646ba886" containerID="06e2c23a5b993c779007fba4da3a5d2611f8759fe409b55cdc69760120e1e866" exitCode=0
Jul 15 21:32:50.239380 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:50.238938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8" event={"ID":"43ced6a3-4519-4791-84f6-87ed646ba886","Type":"ContainerDied","Data":"06e2c23a5b993c779007fba4da3a5d2611f8759fe409b55cdc69760120e1e866"}
Jul 15 21:32:51.377393 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:51.377372    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"
Jul 15 21:32:51.429812 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:51.429779    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ced6a3-4519-4791-84f6-87ed646ba886-maas-api-service-ca\") pod \"43ced6a3-4519-4791-84f6-87ed646ba886\" (UID: \"43ced6a3-4519-4791-84f6-87ed646ba886\") "
Jul 15 21:32:51.430098 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:51.430075    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ced6a3-4519-4791-84f6-87ed646ba886-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43ced6a3-4519-4791-84f6-87ed646ba886" (UID: "43ced6a3-4519-4791-84f6-87ed646ba886"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:32:51.530661 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:51.530578    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ced6a3-4519-4791-84f6-87ed646ba886-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:32:52.250927 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:52.250891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8" event={"ID":"43ced6a3-4519-4791-84f6-87ed646ba886","Type":"ContainerDied","Data":"73c620b6b3bafacbb286b2abc1db11c7d1e81cf4ebbf2ab2dec8cf674d305852"}
Jul 15 21:32:52.250927 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:52.250921    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8"
Jul 15 21:32:52.250927 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:32:52.250938    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73c620b6b3bafacbb286b2abc1db11c7d1e81cf4ebbf2ab2dec8cf674d305852"
Jul 15 21:33:03.096599 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:03.096555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:33:04.326887 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.326847    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"]
Jul 15 21:33:04.327645 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.327597    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t" podUID="b178f915-a1ca-4219-98fa-657ad97f5338" containerName="maas-api" containerID="cri-o://ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e" gracePeriod=30
Jul 15 21:33:04.360958 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.360910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:33:04.576997 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.576926    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:33:04.649838 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.649802    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clhvv\" (UniqueName: \"kubernetes.io/projected/b178f915-a1ca-4219-98fa-657ad97f5338-kube-api-access-clhvv\") pod \"b178f915-a1ca-4219-98fa-657ad97f5338\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") "
Jul 15 21:33:04.650036 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.649865    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls\") pod \"b178f915-a1ca-4219-98fa-657ad97f5338\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") "
Jul 15 21:33:04.650036 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.649906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b178f915-a1ca-4219-98fa-657ad97f5338-openshift-service-ca\") pod \"b178f915-a1ca-4219-98fa-657ad97f5338\" (UID: \"b178f915-a1ca-4219-98fa-657ad97f5338\") "
Jul 15 21:33:04.650328 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.650299    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b178f915-a1ca-4219-98fa-657ad97f5338-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b178f915-a1ca-4219-98fa-657ad97f5338" (UID: "b178f915-a1ca-4219-98fa-657ad97f5338"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:33:04.651998 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.651956    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b178f915-a1ca-4219-98fa-657ad97f5338-kube-api-access-clhvv" (OuterVolumeSpecName: "kube-api-access-clhvv") pod "b178f915-a1ca-4219-98fa-657ad97f5338" (UID: "b178f915-a1ca-4219-98fa-657ad97f5338"). InnerVolumeSpecName "kube-api-access-clhvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:33:04.652097 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.652019    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b178f915-a1ca-4219-98fa-657ad97f5338" (UID: "b178f915-a1ca-4219-98fa-657ad97f5338"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:33:04.750538 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.750492    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clhvv\" (UniqueName: \"kubernetes.io/projected/b178f915-a1ca-4219-98fa-657ad97f5338-kube-api-access-clhvv\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:33:04.750538 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.750529    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b178f915-a1ca-4219-98fa-657ad97f5338-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:33:04.750538 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:04.750541    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b178f915-a1ca-4219-98fa-657ad97f5338-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:33:05.320031 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.319994    2573 generic.go:356] "Generic (PLEG): container finished" podID="b178f915-a1ca-4219-98fa-657ad97f5338" containerID="ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e" exitCode=0
Jul 15 21:33:05.320213 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.320043    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"
Jul 15 21:33:05.320213 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.320074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t" event={"ID":"b178f915-a1ca-4219-98fa-657ad97f5338","Type":"ContainerDied","Data":"ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e"}
Jul 15 21:33:05.320213 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.320133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t" event={"ID":"b178f915-a1ca-4219-98fa-657ad97f5338","Type":"ContainerDied","Data":"67dd2a763027b5e23e16c34f0846750ed7523241cce560d73b118fd1803d817d"}
Jul 15 21:33:05.320213 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.320156    2573 scope.go:117] "RemoveContainer" containerID="ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e"
Jul 15 21:33:05.330318 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.330161    2573 scope.go:117] "RemoveContainer" containerID="ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e"
Jul 15 21:33:05.330539 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:33:05.330470    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e\": container with ID starting with ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e not found: ID does not exist" containerID="ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e"
Jul 15 21:33:05.330539 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.330499    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e"} err="failed to get container status \"ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e\": rpc error: code = NotFound desc = could not find container \"ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e\": container with ID starting with ac7398512af596495df344407475d1174a4a5d46f6ba1a769fb2ef3d81abd49e not found: ID does not exist"
Jul 15 21:33:05.344292 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.344260    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"]
Jul 15 21:33:05.348651 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.348623    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-372e1c00-5cf9b47ff8-r8c4t"]
Jul 15 21:33:05.575217 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:05.575137    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b178f915-a1ca-4219-98fa-657ad97f5338" path="/var/lib/kubelet/pods/b178f915-a1ca-4219-98fa-657ad97f5338/volumes"
Jul 15 21:33:08.774267 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:08.774229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:33:11.235760 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:11.235729    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:33:12.889361 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:12.889324    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:33:15.912571 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:15.912519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:33:16.272567 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:16.272476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:33:52.552165 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:52.552091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:33:53.783477 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:53.783442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:33:59.889072 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:33:59.889035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:09.581110 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:09.581081    2573 scope.go:117] "RemoveContainer" containerID="a5a7e008a0e5585a188526d7a1154affe7cf0a3bd08bbb38afaccca07cffffbd"
Jul 15 21:34:10.368483 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:10.368456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:34:10.373226 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:10.373205    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:34:14.871969 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:14.871931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:14.972242 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:14.972211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:15.254113 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:15.254027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:15.464739 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:15.464705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:16.664199 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:16.664164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:16.755179 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:16.755151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:16.856394 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:16.856360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:17.703387 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:17.703350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:17.811315 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:17.811278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:17.906804 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:17.906770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:19.276194 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:19.276156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:19.293940 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:19.293905    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:34:25.932907 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:25.932873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:26.081024 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:26.080989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:26.606452 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:26.606420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:29.421134 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:29.421101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:34:34.148216 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:34.148185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:34.228063 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:34.228020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:44.296256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:44.296219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:34:44.738737 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:34:44.738690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:05.743530 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:05.743447    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:09.600791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:09.600753    2573 scope.go:117] "RemoveContainer" containerID="46d272beffb74533fd72aea8ba82366efc24d25d535cdddd4ba78fb8c332e354"
Jul 15 21:35:13.551154 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:13.551120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:13.655412 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:13.655382    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:14.954016 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:14.953983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:15.056850 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:15.056820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:16.931810 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:16.931762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:17.027233 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.027204    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:17.120958 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.120924    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"]
Jul 15 21:35:17.121333 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.121319    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ced6a3-4519-4791-84f6-87ed646ba886" containerName="revoke-keys"
Jul 15 21:35:17.121387 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.121336    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ced6a3-4519-4791-84f6-87ed646ba886" containerName="revoke-keys"
Jul 15 21:35:17.121387 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.121348    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b178f915-a1ca-4219-98fa-657ad97f5338" containerName="maas-api"
Jul 15 21:35:17.121387 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.121356    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b178f915-a1ca-4219-98fa-657ad97f5338" containerName="maas-api"
Jul 15 21:35:17.121481 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.121440    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ced6a3-4519-4791-84f6-87ed646ba886" containerName="revoke-keys"
Jul 15 21:35:17.121481 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.121451    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b178f915-a1ca-4219-98fa-657ad97f5338" containerName="maas-api"
Jul 15 21:35:17.124513 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.124496    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.127217 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.127198    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-945d24-serving-cert\""
Jul 15 21:35:17.129278 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.129258    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:35:17.129567 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.129532    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:35:17.129657 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.129534    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:35:17.167914 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.167886    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"]
Jul 15 21:35:17.228013 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.227924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:17.309365 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.309325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed182c18-e3aa-4c92-8e84-807e79c87c41-openshift-service-ca\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.309588 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.309387    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed182c18-e3aa-4c92-8e84-807e79c87c41-maas-api-tls\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.309588 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.309455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc5ff\" (UniqueName: \"kubernetes.io/projected/ed182c18-e3aa-4c92-8e84-807e79c87c41-kube-api-access-mc5ff\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.378999 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.378970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:17.410444 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.410403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc5ff\" (UniqueName: \"kubernetes.io/projected/ed182c18-e3aa-4c92-8e84-807e79c87c41-kube-api-access-mc5ff\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.410632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.410465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed182c18-e3aa-4c92-8e84-807e79c87c41-openshift-service-ca\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.410632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.410519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed182c18-e3aa-4c92-8e84-807e79c87c41-maas-api-tls\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.411111 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.411087    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed182c18-e3aa-4c92-8e84-807e79c87c41-openshift-service-ca\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.412956 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.412936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed182c18-e3aa-4c92-8e84-807e79c87c41-maas-api-tls\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.421926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.421905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc5ff\" (UniqueName: \"kubernetes.io/projected/ed182c18-e3aa-4c92-8e84-807e79c87c41-kube-api-access-mc5ff\") pod \"maas-api-e2e-inf-a-945d24-675dffbbf-f5m48\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.435073 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.435051    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:17.572922 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:35:17.572889    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded182c18_e3aa_4c92_8e84_807e79c87c41.slice/crio-257b3706a9df3ebd28064592d043b1cecd9fdd63d7cf8fb99358f83f92733e63 WatchSource:0}: Error finding container 257b3706a9df3ebd28064592d043b1cecd9fdd63d7cf8fb99358f83f92733e63: Status 404 returned error can't find the container with id 257b3706a9df3ebd28064592d043b1cecd9fdd63d7cf8fb99358f83f92733e63
Jul 15 21:35:17.575014 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.574996    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"]
Jul 15 21:35:17.865295 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.865264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:17.966845 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:17.966822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:18.003591 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:18.003564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48" event={"ID":"ed182c18-e3aa-4c92-8e84-807e79c87c41","Type":"ContainerStarted","Data":"257b3706a9df3ebd28064592d043b1cecd9fdd63d7cf8fb99358f83f92733e63"}
Jul 15 21:35:19.009922 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:19.009880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48" event={"ID":"ed182c18-e3aa-4c92-8e84-807e79c87c41","Type":"ContainerStarted","Data":"48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013"}
Jul 15 21:35:19.010366 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:19.009943    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:19.031678 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:19.031632    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48" podStartSLOduration=1.642156667 podStartE2EDuration="2.031616694s" totalImagesPullingTime="389.460027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:19.030087758 +0000 UTC m=+2170.183772282" watchObservedRunningTime="2026-07-15 21:35:19.031616694 +0000 UTC m=+2170.185301216"
Jul 15 21:35:20.990570 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:20.989980    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:35:21.425203 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:21.425169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:21.799051 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:21.798968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:22.093739 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:22.093710    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:23.427866 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:23.427830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:25.008600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.008570    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"]
Jul 15 21:35:25.012612 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.012593    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.016209 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.016186    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6874e2-serving-cert\""
Jul 15 21:35:25.021977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.021611    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:35:25.025105 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.025084    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"]
Jul 15 21:35:25.072894 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.072859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c48c75-0530-40f9-ae02-1bf0bff12602-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.073074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.073006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c48c75-0530-40f9-ae02-1bf0bff12602-maas-api-tls\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.073074 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.073052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcg9c\" (UniqueName: \"kubernetes.io/projected/84c48c75-0530-40f9-ae02-1bf0bff12602-kube-api-access-xcg9c\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.173696 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.173661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c48c75-0530-40f9-ae02-1bf0bff12602-maas-api-tls\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.173894 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.173704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcg9c\" (UniqueName: \"kubernetes.io/projected/84c48c75-0530-40f9-ae02-1bf0bff12602-kube-api-access-xcg9c\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.173894 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.173741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c48c75-0530-40f9-ae02-1bf0bff12602-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.174367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.174347    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c48c75-0530-40f9-ae02-1bf0bff12602-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.176026 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.176010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c48c75-0530-40f9-ae02-1bf0bff12602-maas-api-tls\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.182952 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.182922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcg9c\" (UniqueName: \"kubernetes.io/projected/84c48c75-0530-40f9-ae02-1bf0bff12602-kube-api-access-xcg9c\") pod \"maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.325704 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.325621    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:25.467829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.467808    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"]
Jul 15 21:35:25.470130 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:35:25.470104    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c48c75_0530_40f9_ae02_1bf0bff12602.slice/crio-9560e54435c951288d764d4a2b62d6717aafefd036adf76a6b0d6dd8d7707386 WatchSource:0}: Error finding container 9560e54435c951288d764d4a2b62d6717aafefd036adf76a6b0d6dd8d7707386: Status 404 returned error can't find the container with id 9560e54435c951288d764d4a2b62d6717aafefd036adf76a6b0d6dd8d7707386
Jul 15 21:35:25.869449 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:25.869413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:26.014100 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:26.014060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:26.048053 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:26.048012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7" event={"ID":"84c48c75-0530-40f9-ae02-1bf0bff12602","Type":"ContainerStarted","Data":"9560e54435c951288d764d4a2b62d6717aafefd036adf76a6b0d6dd8d7707386"}
Jul 15 21:35:27.053819 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:27.053783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7" event={"ID":"84c48c75-0530-40f9-ae02-1bf0bff12602","Type":"ContainerStarted","Data":"ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8"}
Jul 15 21:35:27.054209 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:27.053909    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:27.078105 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:27.078059    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7" podStartSLOduration=1.611305714 podStartE2EDuration="3.078045515s" totalImagesPullingTime="1.466739801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:27.076008518 +0000 UTC m=+2178.229693050" watchObservedRunningTime="2026-07-15 21:35:27.078045515 +0000 UTC m=+2178.231730037"
Jul 15 21:35:29.489779 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:29.489745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:33.063900 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:33.063873    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:35:34.009605 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:34.009574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:38.406879 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:38.406844    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:35:39.078107 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:39.078077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:39.193600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:39.193543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:46.559988 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:46.559950    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:35:46.666417 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:35:46.666380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:09.587864 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:09.587831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:13.696926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:13.696893    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:36:27.991563 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:27.991509    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:36:28.454082 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:28.454055    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:29.381736 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.381697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:29.499476 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.499438    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"]
Jul 15 21:36:29.503063 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.503045    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"
Jul 15 21:36:29.505649 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.505622    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:36:29.512177 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.512146    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"]
Jul 15 21:36:29.532056 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.532023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261b815a-3c7d-41b8-9d6d-0d4266afb997-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-945d24-t949x\" (UID: \"261b815a-3c7d-41b8-9d6d-0d4266afb997\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"
Jul 15 21:36:29.633168 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.633087    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261b815a-3c7d-41b8-9d6d-0d4266afb997-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-945d24-t949x\" (UID: \"261b815a-3c7d-41b8-9d6d-0d4266afb997\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"
Jul 15 21:36:29.633757 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.633739    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261b815a-3c7d-41b8-9d6d-0d4266afb997-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-945d24-t949x\" (UID: \"261b815a-3c7d-41b8-9d6d-0d4266afb997\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"
Jul 15 21:36:29.814747 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.814711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"
Jul 15 21:36:29.952681 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:29.952654    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"]
Jul 15 21:36:29.954001 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:36:29.953974    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261b815a_3c7d_41b8_9d6d_0d4266afb997.slice/crio-431685bc9bf0b4167b12f6f89478e4388cd245d9399be7b9815bec4cab8b32ce WatchSource:0}: Error finding container 431685bc9bf0b4167b12f6f89478e4388cd245d9399be7b9815bec4cab8b32ce: Status 404 returned error can't find the container with id 431685bc9bf0b4167b12f6f89478e4388cd245d9399be7b9815bec4cab8b32ce
Jul 15 21:36:30.078418 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:30.078388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:30.178072 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:30.178043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:30.383632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:30.383594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x" event={"ID":"261b815a-3c7d-41b8-9d6d-0d4266afb997","Type":"ContainerStarted","Data":"0c8cb08a884bc001170f5c835243424527f845255b1cb4cd2a4b3cf83e6b94e0"}
Jul 15 21:36:30.384009 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:30.383646    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x" event={"ID":"261b815a-3c7d-41b8-9d6d-0d4266afb997","Type":"ContainerStarted","Data":"431685bc9bf0b4167b12f6f89478e4388cd245d9399be7b9815bec4cab8b32ce"}
Jul 15 21:36:30.403451 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:30.403332    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x" podStartSLOduration=1.40331554 podStartE2EDuration="1.40331554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:30.402886667 +0000 UTC m=+2241.556571189" watchObservedRunningTime="2026-07-15 21:36:30.40331554 +0000 UTC m=+2241.557000060"
Jul 15 21:36:31.390605 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:31.390507    2573 generic.go:356] "Generic (PLEG): container finished" podID="261b815a-3c7d-41b8-9d6d-0d4266afb997" containerID="0c8cb08a884bc001170f5c835243424527f845255b1cb4cd2a4b3cf83e6b94e0" exitCode=0
Jul 15 21:36:31.390973 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:31.390594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x" event={"ID":"261b815a-3c7d-41b8-9d6d-0d4266afb997","Type":"ContainerDied","Data":"0c8cb08a884bc001170f5c835243424527f845255b1cb4cd2a4b3cf83e6b94e0"}
Jul 15 21:36:32.529115 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:32.529086    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"
Jul 15 21:36:32.662141 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:32.662052    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261b815a-3c7d-41b8-9d6d-0d4266afb997-maas-api-service-ca\") pod \"261b815a-3c7d-41b8-9d6d-0d4266afb997\" (UID: \"261b815a-3c7d-41b8-9d6d-0d4266afb997\") "
Jul 15 21:36:32.662413 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:32.662391    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/261b815a-3c7d-41b8-9d6d-0d4266afb997-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "261b815a-3c7d-41b8-9d6d-0d4266afb997" (UID: "261b815a-3c7d-41b8-9d6d-0d4266afb997"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:36:32.762981 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:32.762931    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261b815a-3c7d-41b8-9d6d-0d4266afb997-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:36:33.402816 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:33.402782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x" event={"ID":"261b815a-3c7d-41b8-9d6d-0d4266afb997","Type":"ContainerDied","Data":"431685bc9bf0b4167b12f6f89478e4388cd245d9399be7b9815bec4cab8b32ce"}
Jul 15 21:36:33.402816 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:33.402811    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-945d24-t949x"
Jul 15 21:36:33.403029 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:33.402830    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="431685bc9bf0b4167b12f6f89478e4388cd245d9399be7b9815bec4cab8b32ce"
Jul 15 21:36:39.585709 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:39.585681    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:36:39.990656 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:39.990626    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"]
Jul 15 21:36:39.990863 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:39.990844    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48" podUID="ed182c18-e3aa-4c92-8e84-807e79c87c41" containerName="maas-api" containerID="cri-o://48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013" gracePeriod=30
Jul 15 21:36:40.015466 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.015413    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48" podUID="ed182c18-e3aa-4c92-8e84-807e79c87c41" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.55:8443/health\": dial tcp 10.133.0.55:8443: connect: connection refused"
Jul 15 21:36:40.024648 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.024623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:40.242182 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.242117    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:36:40.328819 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.328783    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed182c18-e3aa-4c92-8e84-807e79c87c41-maas-api-tls\") pod \"ed182c18-e3aa-4c92-8e84-807e79c87c41\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") "
Jul 15 21:36:40.329014 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.328897    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc5ff\" (UniqueName: \"kubernetes.io/projected/ed182c18-e3aa-4c92-8e84-807e79c87c41-kube-api-access-mc5ff\") pod \"ed182c18-e3aa-4c92-8e84-807e79c87c41\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") "
Jul 15 21:36:40.329014 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.328941    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed182c18-e3aa-4c92-8e84-807e79c87c41-openshift-service-ca\") pod \"ed182c18-e3aa-4c92-8e84-807e79c87c41\" (UID: \"ed182c18-e3aa-4c92-8e84-807e79c87c41\") "
Jul 15 21:36:40.329338 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.329309    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed182c18-e3aa-4c92-8e84-807e79c87c41-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed182c18-e3aa-4c92-8e84-807e79c87c41" (UID: "ed182c18-e3aa-4c92-8e84-807e79c87c41"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:36:40.330971 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.330946    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed182c18-e3aa-4c92-8e84-807e79c87c41-kube-api-access-mc5ff" (OuterVolumeSpecName: "kube-api-access-mc5ff") pod "ed182c18-e3aa-4c92-8e84-807e79c87c41" (UID: "ed182c18-e3aa-4c92-8e84-807e79c87c41"). InnerVolumeSpecName "kube-api-access-mc5ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:36:40.331060 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.331019    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed182c18-e3aa-4c92-8e84-807e79c87c41-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed182c18-e3aa-4c92-8e84-807e79c87c41" (UID: "ed182c18-e3aa-4c92-8e84-807e79c87c41"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:36:40.429783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.429743    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc5ff\" (UniqueName: \"kubernetes.io/projected/ed182c18-e3aa-4c92-8e84-807e79c87c41-kube-api-access-mc5ff\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:36:40.429783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.429775    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed182c18-e3aa-4c92-8e84-807e79c87c41-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:36:40.429783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.429786    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed182c18-e3aa-4c92-8e84-807e79c87c41-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:36:40.436902 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.436869    2573 generic.go:356] "Generic (PLEG): container finished" podID="ed182c18-e3aa-4c92-8e84-807e79c87c41" containerID="48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013" exitCode=0
Jul 15 21:36:40.437038 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.436930    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"
Jul 15 21:36:40.437038 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.436956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48" event={"ID":"ed182c18-e3aa-4c92-8e84-807e79c87c41","Type":"ContainerDied","Data":"48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013"}
Jul 15 21:36:40.437038 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.437033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48" event={"ID":"ed182c18-e3aa-4c92-8e84-807e79c87c41","Type":"ContainerDied","Data":"257b3706a9df3ebd28064592d043b1cecd9fdd63d7cf8fb99358f83f92733e63"}
Jul 15 21:36:40.437137 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.437056    2573 scope.go:117] "RemoveContainer" containerID="48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013"
Jul 15 21:36:40.446576 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.446562    2573 scope.go:117] "RemoveContainer" containerID="48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013"
Jul 15 21:36:40.446845 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:36:40.446826    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013\": container with ID starting with 48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013 not found: ID does not exist" containerID="48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013"
Jul 15 21:36:40.446910 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.446859    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013"} err="failed to get container status \"48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013\": rpc error: code = NotFound desc = could not find container \"48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013\": container with ID starting with 48d083e5ad76dd8cabfc496c5885a7c9e5c929c02488fe35a9ecd1c9cccfe013 not found: ID does not exist"
Jul 15 21:36:40.461688 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.461657    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"]
Jul 15 21:36:40.465926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:40.465895    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-945d24-675dffbbf-f5m48"]
Jul 15 21:36:41.574564 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:41.574527    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed182c18-e3aa-4c92-8e84-807e79c87c41" path="/var/lib/kubelet/pods/ed182c18-e3aa-4c92-8e84-807e79c87c41/volumes"
Jul 15 21:36:44.607396 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:44.607364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:44.982490 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:44.982410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:48.100622 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:48.100582    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:36:50.441197 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:50.441151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:50.540137 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:50.540106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:52.033033 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.033006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:52.109321 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.109291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:52.331776 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.331698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:52.557361 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.557332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:52.665688 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.665656    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"]
Jul 15 21:36:52.666027 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.666016    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261b815a-3c7d-41b8-9d6d-0d4266afb997" containerName="revoke-keys"
Jul 15 21:36:52.666078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.666029    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="261b815a-3c7d-41b8-9d6d-0d4266afb997" containerName="revoke-keys"
Jul 15 21:36:52.666078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.666037    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed182c18-e3aa-4c92-8e84-807e79c87c41" containerName="maas-api"
Jul 15 21:36:52.666078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.666042    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed182c18-e3aa-4c92-8e84-807e79c87c41" containerName="maas-api"
Jul 15 21:36:52.666173 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.666115    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="261b815a-3c7d-41b8-9d6d-0d4266afb997" containerName="revoke-keys"
Jul 15 21:36:52.666173 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.666124    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed182c18-e3aa-4c92-8e84-807e79c87c41" containerName="maas-api"
Jul 15 21:36:52.669291 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.669275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"
Jul 15 21:36:52.675325 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.675305    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpm6w\""
Jul 15 21:36:52.682026 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.681999    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"]
Jul 15 21:36:52.743035 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.743012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln\" (UID: \"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"
Jul 15 21:36:52.843372 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.843350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln\" (UID: \"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"
Jul 15 21:36:52.843953 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.843935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln\" (UID: \"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"
Jul 15 21:36:52.981977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:52.981906    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"
Jul 15 21:36:53.118620 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:53.118592    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"]
Jul 15 21:36:53.120028 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:36:53.119989    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e9bb1a_1bb5_46dc_afb0_3ede61725ab2.slice/crio-728da7266a01363eded152714e02b3c584d89741ecc00f0eaeeed4173a2fb6e7 WatchSource:0}: Error finding container 728da7266a01363eded152714e02b3c584d89741ecc00f0eaeeed4173a2fb6e7: Status 404 returned error can't find the container with id 728da7266a01363eded152714e02b3c584d89741ecc00f0eaeeed4173a2fb6e7
Jul 15 21:36:53.506783 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:53.506754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln" event={"ID":"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2","Type":"ContainerStarted","Data":"f78d6a07d75f50f6147a0c3a9ce2ffa9e55878e452c0c9ce4f9fb708fc56a2da"}
Jul 15 21:36:53.506937 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:53.506802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln" event={"ID":"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2","Type":"ContainerStarted","Data":"728da7266a01363eded152714e02b3c584d89741ecc00f0eaeeed4173a2fb6e7"}
Jul 15 21:36:53.511255 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:53.511235    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:53.528253 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:53.528208    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln" podStartSLOduration=1.5281951390000001 podStartE2EDuration="1.528195139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:53.526485969 +0000 UTC m=+2264.680170489" watchObservedRunningTime="2026-07-15 21:36:53.528195139 +0000 UTC m=+2264.681879659"
Jul 15 21:36:53.616896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:53.616867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:36:54.513405 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:54.513374    2573 generic.go:356] "Generic (PLEG): container finished" podID="f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2" containerID="f78d6a07d75f50f6147a0c3a9ce2ffa9e55878e452c0c9ce4f9fb708fc56a2da" exitCode=0
Jul 15 21:36:54.513807 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:54.513465    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln" event={"ID":"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2","Type":"ContainerDied","Data":"f78d6a07d75f50f6147a0c3a9ce2ffa9e55878e452c0c9ce4f9fb708fc56a2da"}
Jul 15 21:36:55.655167 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:55.655143    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"
Jul 15 21:36:55.765486 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:55.765459    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2-maas-api-service-ca\") pod \"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2\" (UID: \"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2\") "
Jul 15 21:36:55.765813 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:55.765792    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2" (UID: "f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:36:55.866359 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:55.866335    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2-maas-api-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:36:56.524458 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:56.524424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln" event={"ID":"f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2","Type":"ContainerDied","Data":"728da7266a01363eded152714e02b3c584d89741ecc00f0eaeeed4173a2fb6e7"}
Jul 15 21:36:56.524458 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:56.524459    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln"
Jul 15 21:36:56.524684 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:36:56.524474    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="728da7266a01363eded152714e02b3c584d89741ecc00f0eaeeed4173a2fb6e7"
Jul 15 21:37:03.463036 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.462998    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"]
Jul 15 21:37:03.463873 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.463187    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7" podUID="84c48c75-0530-40f9-ae02-1bf0bff12602" containerName="maas-api" containerID="cri-o://ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8" gracePeriod=30
Jul 15 21:37:03.474646 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.474538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:03.713656 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.713593    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:37:03.837633 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.837596    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcg9c\" (UniqueName: \"kubernetes.io/projected/84c48c75-0530-40f9-ae02-1bf0bff12602-kube-api-access-xcg9c\") pod \"84c48c75-0530-40f9-ae02-1bf0bff12602\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") "
Jul 15 21:37:03.837797 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.837688    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c48c75-0530-40f9-ae02-1bf0bff12602-maas-api-tls\") pod \"84c48c75-0530-40f9-ae02-1bf0bff12602\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") "
Jul 15 21:37:03.837797 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.837718    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c48c75-0530-40f9-ae02-1bf0bff12602-openshift-service-ca\") pod \"84c48c75-0530-40f9-ae02-1bf0bff12602\" (UID: \"84c48c75-0530-40f9-ae02-1bf0bff12602\") "
Jul 15 21:37:03.838142 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.838122    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84c48c75-0530-40f9-ae02-1bf0bff12602-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84c48c75-0530-40f9-ae02-1bf0bff12602" (UID: "84c48c75-0530-40f9-ae02-1bf0bff12602"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:37:03.839794 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.839774    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c48c75-0530-40f9-ae02-1bf0bff12602-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84c48c75-0530-40f9-ae02-1bf0bff12602" (UID: "84c48c75-0530-40f9-ae02-1bf0bff12602"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:37:03.839890 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.839869    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c48c75-0530-40f9-ae02-1bf0bff12602-kube-api-access-xcg9c" (OuterVolumeSpecName: "kube-api-access-xcg9c") pod "84c48c75-0530-40f9-ae02-1bf0bff12602" (UID: "84c48c75-0530-40f9-ae02-1bf0bff12602"). InnerVolumeSpecName "kube-api-access-xcg9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:03.938393 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.938360    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcg9c\" (UniqueName: \"kubernetes.io/projected/84c48c75-0530-40f9-ae02-1bf0bff12602-kube-api-access-xcg9c\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:37:03.938393 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.938391    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c48c75-0530-40f9-ae02-1bf0bff12602-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:37:03.938575 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:03.938406    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c48c75-0530-40f9-ae02-1bf0bff12602-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:37:04.566283 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.566248    2573 generic.go:356] "Generic (PLEG): container finished" podID="84c48c75-0530-40f9-ae02-1bf0bff12602" containerID="ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8" exitCode=0
Jul 15 21:37:04.566717 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.566295    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"
Jul 15 21:37:04.566717 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.566330    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7" event={"ID":"84c48c75-0530-40f9-ae02-1bf0bff12602","Type":"ContainerDied","Data":"ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8"}
Jul 15 21:37:04.566717 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.566383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7" event={"ID":"84c48c75-0530-40f9-ae02-1bf0bff12602","Type":"ContainerDied","Data":"9560e54435c951288d764d4a2b62d6717aafefd036adf76a6b0d6dd8d7707386"}
Jul 15 21:37:04.566717 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.566406    2573 scope.go:117] "RemoveContainer" containerID="ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8"
Jul 15 21:37:04.575923 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.575906    2573 scope.go:117] "RemoveContainer" containerID="ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8"
Jul 15 21:37:04.576182 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:37:04.576166    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8\": container with ID starting with ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8 not found: ID does not exist" containerID="ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8"
Jul 15 21:37:04.576223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.576191    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8"} err="failed to get container status \"ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8\": rpc error: code = NotFound desc = could not find container \"ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8\": container with ID starting with ad5f06d890ced1880bc961c4aa44e0e3990db6ed2d73ba622788909bf9dc56d8 not found: ID does not exist"
Jul 15 21:37:04.591647 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.591624    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"]
Jul 15 21:37:04.595847 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:04.595825    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6874e2-6f5b9d8d6b-xvvq7"]
Jul 15 21:37:05.574310 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:05.574277    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c48c75-0530-40f9-ae02-1bf0bff12602" path="/var/lib/kubelet/pods/84c48c75-0530-40f9-ae02-1bf0bff12602/volumes"
Jul 15 21:37:06.493086 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:06.493052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:06.605416 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:06.605382    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:37:07.798959 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:07.798927    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:08.214069 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:08.214032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:14.646056 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:14.646018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:14.746694 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:14.746663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:14.930750 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:14.930668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:15.142487 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.142456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:15.524814 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.524780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:15.800125 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.800041    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"]
Jul 15 21:37:15.800472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.800412    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c48c75-0530-40f9-ae02-1bf0bff12602" containerName="maas-api"
Jul 15 21:37:15.800472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.800422    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c48c75-0530-40f9-ae02-1bf0bff12602" containerName="maas-api"
Jul 15 21:37:15.800472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.800441    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2" containerName="revoke-keys"
Jul 15 21:37:15.800472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.800447    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2" containerName="revoke-keys"
Jul 15 21:37:15.800669 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.800503    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c48c75-0530-40f9-ae02-1bf0bff12602" containerName="maas-api"
Jul 15 21:37:15.800669 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.800511    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2" containerName="revoke-keys"
Jul 15 21:37:15.803495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.803471    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.806463 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.806445    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a05ec7-openshift-default-dockercfg-tw5fq\""
Jul 15 21:37:15.819063 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.819030    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"]
Jul 15 21:37:15.825500 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.825469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:15.846751 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.846716    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-credential-socket\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.846949 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.846774    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-envoy\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.846949 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.846846    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-token\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.846949 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.846891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv7bb\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-kube-api-access-gv7bb\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.846949 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.846942    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-certs\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.847170 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.846991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istiod-ca-cert\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.847170 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.847020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-data\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.847170 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.847061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-podinfo\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.847170 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.847092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-socket\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.948539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-envoy\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.948655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-token\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.948721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv7bb\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-kube-api-access-gv7bb\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.948807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-certs\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.948884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istiod-ca-cert\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.948932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-data\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.948994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-podinfo\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.949042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-socket\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.949098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-credential-socket\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.949578    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-credential-socket\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.950090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istiod-ca-cert\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.950193    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-certs\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.950367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-data\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.950653    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-socket\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.955834 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.951436    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-envoy\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.956613 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.952904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-podinfo\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.958776 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.958746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-token\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:15.958893 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:15.958846    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv7bb\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-kube-api-access-gv7bb\") pod \"e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") " pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:16.096170 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:16.096126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:16.113689 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:16.113655    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:16.253842 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:16.253816    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"]
Jul 15 21:37:16.256141 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:37:16.256115    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72a7db4_2bcd_4441_a46a_8bda3f9369f5.slice/crio-757b1187d03810aa42282546bdec2e5a2ca66fe9b8788a3496f12bd0f40f6be7 WatchSource:0}: Error finding container 757b1187d03810aa42282546bdec2e5a2ca66fe9b8788a3496f12bd0f40f6be7: Status 404 returned error can't find the container with id 757b1187d03810aa42282546bdec2e5a2ca66fe9b8788a3496f12bd0f40f6be7
Jul 15 21:37:16.258426 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:16.258410    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:37:16.628878 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:16.628838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" event={"ID":"e72a7db4-2bcd-4441-a46a-8bda3f9369f5","Type":"ContainerStarted","Data":"757b1187d03810aa42282546bdec2e5a2ca66fe9b8788a3496f12bd0f40f6be7"}
Jul 15 21:37:18.864304 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:18.864275    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:18.864542 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:18.864340    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:18.864542 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:18.864369    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:19.646837 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:19.646806    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" event={"ID":"e72a7db4-2bcd-4441-a46a-8bda3f9369f5","Type":"ContainerStarted","Data":"3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d"}
Jul 15 21:37:19.676424 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:19.676377    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" podStartSLOduration=2.070965199 podStartE2EDuration="4.676361736s" totalImagesPullingTime="2.605396537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:19.675577448 +0000 UTC m=+2290.829261962" watchObservedRunningTime="2026-07-15 21:37:19.676361736 +0000 UTC m=+2290.830046256"
Jul 15 21:37:20.114056 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:20.114026    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:20.118619 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:20.118596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:20.652609 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:20.652576    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:20.653533 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:20.653509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:21.665299 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.665263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:21.754408 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.754379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:21.925242 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.925162    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"]
Jul 15 21:37:21.929039 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.929018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:21.931781 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.931764    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:37:21.932473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.932460    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:37:21.932768 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.932753    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a05ec7-serving-cert\""
Jul 15 21:37:21.932866 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.932811    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:37:21.940328 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.940305    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"]
Jul 15 21:37:21.960975 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:21.960955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:22.006134 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.006103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd49434-4207-45b4-9418-562fd4b5d0af-openshift-service-ca\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.006240 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.006210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj95j\" (UniqueName: \"kubernetes.io/projected/9bd49434-4207-45b4-9418-562fd4b5d0af-kube-api-access-gj95j\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.006290 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.006244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd49434-4207-45b4-9418-562fd4b5d0af-maas-api-tls\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.107560 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.107514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj95j\" (UniqueName: \"kubernetes.io/projected/9bd49434-4207-45b4-9418-562fd4b5d0af-kube-api-access-gj95j\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.107738 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.107574    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd49434-4207-45b4-9418-562fd4b5d0af-maas-api-tls\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.107738 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.107633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd49434-4207-45b4-9418-562fd4b5d0af-openshift-service-ca\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.108271 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.108246    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd49434-4207-45b4-9418-562fd4b5d0af-openshift-service-ca\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.109979 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.109958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd49434-4207-45b4-9418-562fd4b5d0af-maas-api-tls\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.126672 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.126648    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj95j\" (UniqueName: \"kubernetes.io/projected/9bd49434-4207-45b4-9418-562fd4b5d0af-kube-api-access-gj95j\") pod \"maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.164965 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.164943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:22.239871 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.239803    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:22.373129 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.373106    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"]
Jul 15 21:37:22.375108 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:37:22.375081    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd49434_4207_45b4_9418_562fd4b5d0af.slice/crio-954a37b3667cbfbfd88cf7f05c20b3c4b54db7a7ad107515450235bc2489588d WatchSource:0}: Error finding container 954a37b3667cbfbfd88cf7f05c20b3c4b54db7a7ad107515450235bc2489588d: Status 404 returned error can't find the container with id 954a37b3667cbfbfd88cf7f05c20b3c4b54db7a7ad107515450235bc2489588d
Jul 15 21:37:22.565564 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.565458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:22.663808 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.663774    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx" event={"ID":"9bd49434-4207-45b4-9418-562fd4b5d0af","Type":"ContainerStarted","Data":"954a37b3667cbfbfd88cf7f05c20b3c4b54db7a7ad107515450235bc2489588d"}
Jul 15 21:37:22.666502 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:22.666479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:23.670085 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:23.670055    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx" event={"ID":"9bd49434-4207-45b4-9418-562fd4b5d0af","Type":"ContainerStarted","Data":"991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51"}
Jul 15 21:37:23.670504 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:23.670177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:26.213607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:26.213541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:26.408198 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:26.408139    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx" podStartSLOduration=4.662164166 podStartE2EDuration="5.408120905s" totalImagesPullingTime="745.956739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:23.70593161 +0000 UTC m=+2294.859616133" watchObservedRunningTime="2026-07-15 21:37:26.408120905 +0000 UTC m=+2297.561805425"
Jul 15 21:37:26.408858 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:26.408841    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:37:26.739234 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:26.739202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:27.026909 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:27.026821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:27.488246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:27.488211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:29.682199 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:29.682173    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:29.748378 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:29.748346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:29.846101 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:29.846056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:30.041625 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.036430    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"]
Jul 15 21:37:30.056997 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.056971    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.060396 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.060186    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-351fa3-serving-cert\""
Jul 15 21:37:30.063240 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.063215    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"]
Jul 15 21:37:30.104825 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.104791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:30.182912 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.182876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5b8g\" (UniqueName: \"kubernetes.io/projected/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-kube-api-access-c5b8g\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.182912 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.182913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-openshift-service-ca\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.183114 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.183009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-maas-api-tls\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.228697 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.228665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:30.284132 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.284101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5b8g\" (UniqueName: \"kubernetes.io/projected/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-kube-api-access-c5b8g\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.284302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.284141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-openshift-service-ca\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.284302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.284166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-maas-api-tls\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.284791 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.284762    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-openshift-service-ca\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.286622 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.286592    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-maas-api-tls\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.296352 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.296297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5b8g\" (UniqueName: \"kubernetes.io/projected/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-kube-api-access-c5b8g\") pod \"maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.369602 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.369569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:30.552421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.552338    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"]
Jul 15 21:37:30.560227 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:37:30.560200    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae38ae24_a1fd_47f3_a8a4_7aaf33f1cb3a.slice/crio-4ffe557b1aba32a6978b46461d763d7c7b2623653d028242228866195e625356 WatchSource:0}: Error finding container 4ffe557b1aba32a6978b46461d763d7c7b2623653d028242228866195e625356: Status 404 returned error can't find the container with id 4ffe557b1aba32a6978b46461d763d7c7b2623653d028242228866195e625356
Jul 15 21:37:30.707644 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.707614    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx" event={"ID":"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a","Type":"ContainerStarted","Data":"4ffe557b1aba32a6978b46461d763d7c7b2623653d028242228866195e625356"}
Jul 15 21:37:30.841062 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.840931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:30.940315 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:30.940275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:31.715200 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:31.715168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx" event={"ID":"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a","Type":"ContainerStarted","Data":"b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9"}
Jul 15 21:37:31.715653 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:31.715247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:31.738142 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:31.738095    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx" podStartSLOduration=1.291246489 podStartE2EDuration="1.738077238s" totalImagesPullingTime="446.830749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:31.735109935 +0000 UTC m=+2302.888794466" watchObservedRunningTime="2026-07-15 21:37:31.738077238 +0000 UTC m=+2302.891761759"
Jul 15 21:37:34.249100 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:34.249012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:34.732707 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:34.732677    2573 generic.go:356] "Generic (PLEG): container finished" podID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerID="3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d" exitCode=0
Jul 15 21:37:34.733010 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:34.732714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" event={"ID":"e72a7db4-2bcd-4441-a46a-8bda3f9369f5","Type":"ContainerDied","Data":"3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d"}
Jul 15 21:37:34.733167 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:34.733149    2573 scope.go:117] "RemoveContainer" containerID="3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d"
Jul 15 21:37:34.735109 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:34.735076    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:34.735194 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:34.735148    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:34.735194 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:34.735183    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:35.652596 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:35.652525    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:35.744672 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:35.744628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" event={"ID":"e72a7db4-2bcd-4441-a46a-8bda3f9369f5","Type":"ContainerStarted","Data":"0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308"}
Jul 15 21:37:36.114297 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:36.114262    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:36.115387 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:36.115366    2573 patch_prober.go:28] interesting pod/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 15 21:37:36.115440 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:36.115424    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 15 21:37:37.114522 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:37.114488    2573 patch_prober.go:28] interesting pod/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 15 21:37:37.114919 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:37.114540    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 15 21:37:37.734883 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:37.734851    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:37:38.114932 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:38.114896    2573 patch_prober.go:28] interesting pod/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 15 21:37:38.115304 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:38.114957    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 15 21:37:39.114747 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:39.114710    2573 patch_prober.go:28] interesting pod/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 15 21:37:39.114913 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:39.114767    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 15 21:37:40.117795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:40.117764    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:40.118191 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:40.118108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:40.118796 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:40.118780    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:37:43.134313 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:43.134278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:43.226921 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:43.226894    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:43.608170 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:43.608138    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:37:51.847042 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:51.847006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:51.948860 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:51.948826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:57.531569 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.531518    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"]
Jul 15 21:37:57.532053 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.531775    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx" podUID="9bd49434-4207-45b4-9418-562fd4b5d0af" containerName="maas-api" containerID="cri-o://991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51" gracePeriod=30
Jul 15 21:37:57.555285 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.555254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:37:57.778972 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.778951    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:57.856133 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.856102    2573 generic.go:356] "Generic (PLEG): container finished" podID="9bd49434-4207-45b4-9418-562fd4b5d0af" containerID="991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51" exitCode=0
Jul 15 21:37:57.856269 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.856141    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"
Jul 15 21:37:57.856269 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.856178    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx" event={"ID":"9bd49434-4207-45b4-9418-562fd4b5d0af","Type":"ContainerDied","Data":"991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51"}
Jul 15 21:37:57.856269 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.856225    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx" event={"ID":"9bd49434-4207-45b4-9418-562fd4b5d0af","Type":"ContainerDied","Data":"954a37b3667cbfbfd88cf7f05c20b3c4b54db7a7ad107515450235bc2489588d"}
Jul 15 21:37:57.856269 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.856246    2573 scope.go:117] "RemoveContainer" containerID="991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51"
Jul 15 21:37:57.864459 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.864445    2573 scope.go:117] "RemoveContainer" containerID="991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51"
Jul 15 21:37:57.864723 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:37:57.864706    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51\": container with ID starting with 991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51 not found: ID does not exist" containerID="991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51"
Jul 15 21:37:57.864780 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.864732    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51"} err="failed to get container status \"991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51\": rpc error: code = NotFound desc = could not find container \"991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51\": container with ID starting with 991d152e5c515f210992835fa1c227538ec80fa50b8a135d9045ffecc4bd4f51 not found: ID does not exist"
Jul 15 21:37:57.941926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.941900    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd49434-4207-45b4-9418-562fd4b5d0af-openshift-service-ca\") pod \"9bd49434-4207-45b4-9418-562fd4b5d0af\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") "
Jul 15 21:37:57.942041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.941934    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj95j\" (UniqueName: \"kubernetes.io/projected/9bd49434-4207-45b4-9418-562fd4b5d0af-kube-api-access-gj95j\") pod \"9bd49434-4207-45b4-9418-562fd4b5d0af\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") "
Jul 15 21:37:57.942041 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.941997    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd49434-4207-45b4-9418-562fd4b5d0af-maas-api-tls\") pod \"9bd49434-4207-45b4-9418-562fd4b5d0af\" (UID: \"9bd49434-4207-45b4-9418-562fd4b5d0af\") "
Jul 15 21:37:57.942292 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.942266    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bd49434-4207-45b4-9418-562fd4b5d0af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bd49434-4207-45b4-9418-562fd4b5d0af" (UID: "9bd49434-4207-45b4-9418-562fd4b5d0af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:37:57.943878 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.943859    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bd49434-4207-45b4-9418-562fd4b5d0af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bd49434-4207-45b4-9418-562fd4b5d0af" (UID: "9bd49434-4207-45b4-9418-562fd4b5d0af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:37:57.943986 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:57.943973    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd49434-4207-45b4-9418-562fd4b5d0af-kube-api-access-gj95j" (OuterVolumeSpecName: "kube-api-access-gj95j") pod "9bd49434-4207-45b4-9418-562fd4b5d0af" (UID: "9bd49434-4207-45b4-9418-562fd4b5d0af"). InnerVolumeSpecName "kube-api-access-gj95j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:58.042855 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:58.042832    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd49434-4207-45b4-9418-562fd4b5d0af-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:37:58.042855 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:58.042853    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd49434-4207-45b4-9418-562fd4b5d0af-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:37:58.042998 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:58.042863    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj95j\" (UniqueName: \"kubernetes.io/projected/9bd49434-4207-45b4-9418-562fd4b5d0af-kube-api-access-gj95j\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:37:58.177796 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:58.177768    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"]
Jul 15 21:37:58.181735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:58.181714    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a05ec7-bccbc494c-tfhqx"]
Jul 15 21:37:59.580632 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:37:59.580592    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bd49434-4207-45b4-9418-562fd4b5d0af" path="/var/lib/kubelet/pods/9bd49434-4207-45b4-9418-562fd4b5d0af/volumes"
Jul 15 21:38:02.484484 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:02.484380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:02.509756 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:02.509720    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:38:02.887982 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:02.887947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:09.531723 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:09.531690    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"]
Jul 15 21:38:09.532241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:09.531965    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy" containerID="cri-o://0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308" gracePeriod=30
Jul 15 21:38:10.086277 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:10.086246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:10.120078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:10.120033    2573 patch_prober.go:28] interesting pod/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 21:38:10.120229 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:10.120114    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:38:10.187753 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:10.187705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:14.787226 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.787202    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:38:14.891728 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891697    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-token\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.891926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891744    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-credential-socket\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.891926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891789    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-podinfo\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.891926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891821    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istiod-ca-cert\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.891926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891872    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv7bb\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-kube-api-access-gv7bb\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.891926 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891898    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-socket\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.892276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891932    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-certs\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.892276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.891980    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-data\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.892276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.892034    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-envoy\") pod \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\" (UID: \"e72a7db4-2bcd-4441-a46a-8bda3f9369f5\") "
Jul 15 21:38:14.892276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.892081    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:38:14.892276 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.892239    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:38:14.892527 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.892326    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:38:14.892527 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.892378    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-credential-socket\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.892527 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.892399    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-socket\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.892527 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.892437    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:38:14.893065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.893031    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:38:14.894079 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.894050    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 21:38:14.894201 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.894057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:38:14.894201 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.894194    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-kube-api-access-gv7bb" (OuterVolumeSpecName: "kube-api-access-gv7bb") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "kube-api-access-gv7bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:38:14.894285 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.894268    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e72a7db4-2bcd-4441-a46a-8bda3f9369f5" (UID: "e72a7db4-2bcd-4441-a46a-8bda3f9369f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:38:14.944693 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.944659    2573 generic.go:356] "Generic (PLEG): container finished" podID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerID="0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308" exitCode=0
Jul 15 21:38:14.944861 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.944709    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"
Jul 15 21:38:14.944861 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.944746    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" event={"ID":"e72a7db4-2bcd-4441-a46a-8bda3f9369f5","Type":"ContainerDied","Data":"0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308"}
Jul 15 21:38:14.944861 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.944801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf" event={"ID":"e72a7db4-2bcd-4441-a46a-8bda3f9369f5","Type":"ContainerDied","Data":"757b1187d03810aa42282546bdec2e5a2ca66fe9b8788a3496f12bd0f40f6be7"}
Jul 15 21:38:14.944861 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.944827    2573 scope.go:117] "RemoveContainer" containerID="0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308"
Jul 15 21:38:14.954340 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.954326    2573 scope.go:117] "RemoveContainer" containerID="3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d"
Jul 15 21:38:14.962715 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.962698    2573 scope.go:117] "RemoveContainer" containerID="0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308"
Jul 15 21:38:14.962968 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:38:14.962947    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308\": container with ID starting with 0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308 not found: ID does not exist" containerID="0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308"
Jul 15 21:38:14.963018 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.962977    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308"} err="failed to get container status \"0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308\": rpc error: code = NotFound desc = could not find container \"0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308\": container with ID starting with 0ad25822b5f1c0a77d7a8bcaaca11a9945e24389d802ae08e30cbeff63040308 not found: ID does not exist"
Jul 15 21:38:14.963018 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.962996    2573 scope.go:117] "RemoveContainer" containerID="3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d"
Jul 15 21:38:14.963194 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:38:14.963179    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d\": container with ID starting with 3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d not found: ID does not exist" containerID="3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d"
Jul 15 21:38:14.963242 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.963200    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d"} err="failed to get container status \"3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d\": rpc error: code = NotFound desc = could not find container \"3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d\": container with ID starting with 3510bc20b60d03428856a47a00a896ae99b41fad28a58f2ba4dde1f9a9504c3d not found: ID does not exist"
Jul 15 21:38:14.969557 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.969517    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"]
Jul 15 21:38:14.977747 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.977724    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a05ec7-openshift-default-64bf74b6b5-646gf"]
Jul 15 21:38:14.992962 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.992934    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-workload-certs\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.992962 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.992957    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-data\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.992962 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.992966    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-envoy\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.993160 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.992974    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-token\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.993160 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.992981    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istio-podinfo\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.993160 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.992988    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-istiod-ca-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:14.993160 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:14.992996    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv7bb\" (UniqueName: \"kubernetes.io/projected/e72a7db4-2bcd-4441-a46a-8bda3f9369f5-kube-api-access-gv7bb\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:15.575044 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:15.575011    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" path="/var/lib/kubelet/pods/e72a7db4-2bcd-4441-a46a-8bda3f9369f5/volumes"
Jul 15 21:38:25.433792 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.433758    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"]
Jul 15 21:38:25.434248 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.434119    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx" podUID="ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" containerName="maas-api" containerID="cri-o://b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9" gracePeriod=30
Jul 15 21:38:25.468403 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.468373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:25.692045 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.691978    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:38:25.801351 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.801313    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-openshift-service-ca\") pod \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") "
Jul 15 21:38:25.801526 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.801391    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-maas-api-tls\") pod \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") "
Jul 15 21:38:25.801526 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.801419    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5b8g\" (UniqueName: \"kubernetes.io/projected/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-kube-api-access-c5b8g\") pod \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\" (UID: \"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a\") "
Jul 15 21:38:25.801732 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.801709    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" (UID: "ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:38:25.803504 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.803466    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" (UID: "ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:38:25.803638 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.803511    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-kube-api-access-c5b8g" (OuterVolumeSpecName: "kube-api-access-c5b8g") pod "ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" (UID: "ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a"). InnerVolumeSpecName "kube-api-access-c5b8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:38:25.902473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.902435    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:25.902473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.902468    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:25.902473 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:25.902478    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5b8g\" (UniqueName: \"kubernetes.io/projected/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a-kube-api-access-c5b8g\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:38:26.001421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.001334    2573 generic.go:356] "Generic (PLEG): container finished" podID="ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" containerID="b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9" exitCode=0
Jul 15 21:38:26.001421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.001377    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"
Jul 15 21:38:26.001675 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.001417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx" event={"ID":"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a","Type":"ContainerDied","Data":"b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9"}
Jul 15 21:38:26.001675 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.001469    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx" event={"ID":"ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a","Type":"ContainerDied","Data":"4ffe557b1aba32a6978b46461d763d7c7b2623653d028242228866195e625356"}
Jul 15 21:38:26.001675 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.001489    2573 scope.go:117] "RemoveContainer" containerID="b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9"
Jul 15 21:38:26.010156 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.010141    2573 scope.go:117] "RemoveContainer" containerID="b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9"
Jul 15 21:38:26.010407 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:38:26.010387    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9\": container with ID starting with b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9 not found: ID does not exist" containerID="b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9"
Jul 15 21:38:26.010471 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.010415    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9"} err="failed to get container status \"b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9\": rpc error: code = NotFound desc = could not find container \"b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9\": container with ID starting with b912df491d03bef5ba848b0fad3943717c0d33c41762189019bfb0c528b079b9 not found: ID does not exist"
Jul 15 21:38:26.023653 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.023626    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"]
Jul 15 21:38:26.027973 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:26.027953    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-351fa3-77b45d87c8-wlrmx"]
Jul 15 21:38:27.574976 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:27.574943    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" path="/var/lib/kubelet/pods/ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a/volumes"
Jul 15 21:38:30.038799 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:30.038757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:30.406241 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:30.406202    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:38:30.529651 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:30.529607    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:36.893281 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:36.893234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:36.993032 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:36.992974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:37.165900 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:37.165799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:37.428737 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:37.428638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:37.766413 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:37.766303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:38.080291 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080210    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"]
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080623    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" containerName="maas-api"
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080640    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" containerName="maas-api"
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080669    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy"
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080679    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy"
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080697    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy"
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080706    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy"
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080724    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd49434-4207-45b4-9418-562fd4b5d0af" containerName="maas-api"
Jul 15 21:38:38.080735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080733    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd49434-4207-45b4-9418-562fd4b5d0af" containerName="maas-api"
Jul 15 21:38:38.081058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080833    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy"
Jul 15 21:38:38.081058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080848    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae38ae24-a1fd-47f3-a8a4-7aaf33f1cb3a" containerName="maas-api"
Jul 15 21:38:38.081058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080858    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd49434-4207-45b4-9418-562fd4b5d0af" containerName="maas-api"
Jul 15 21:38:38.081058 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.080866    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e72a7db4-2bcd-4441-a46a-8bda3f9369f5" containerName="istio-proxy"
Jul 15 21:38:38.085432 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.085416    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.094312 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.094292    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-39670c-openshift-default-dockercfg-rc8bv\""
Jul 15 21:38:38.104289 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.104269    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"]
Jul 15 21:38:38.111714 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.111686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-podinfo\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.111822 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.111735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj7x6\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-kube-api-access-fj7x6\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.111822 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.111758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-credential-socket\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.111922 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.111842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istiod-ca-cert\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.111922 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.111888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-socket\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.111922 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.111913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-envoy\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.112076 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.111944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-data\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.112076 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.112039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-certs\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.112167 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.112085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-token\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.113811 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.113788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:38.212517 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-podinfo\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212696 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj7x6\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-kube-api-access-fj7x6\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212696 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-credential-socket\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212696 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istiod-ca-cert\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212696 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-socket\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-envoy\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-data\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-certs\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.212908 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-token\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.213096 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.212989    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-credential-socket\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.213096 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.213033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-socket\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.213207 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.213184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-data\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.213257 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.213241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-certs\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.213666 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.213647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istiod-ca-cert\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.214857 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.214836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-envoy\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.214953 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.214936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-podinfo\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.220982 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.220958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-token\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.221107 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.221090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj7x6\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-kube-api-access-fj7x6\") pod \"e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") " pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.397396 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.397364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:38.465301 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.465267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:38.535717 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.535681    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"]
Jul 15 21:38:38.536885 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:38:38.536862    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebbfdf1_e9ab_44c1_bcc5_e305ce0c5d17.slice/crio-1d012ec48d74d16e6904d0600860c4421e3b5f60cb96cb1177349cfa638b78a8 WatchSource:0}: Error finding container 1d012ec48d74d16e6904d0600860c4421e3b5f60cb96cb1177349cfa638b78a8: Status 404 returned error can't find the container with id 1d012ec48d74d16e6904d0600860c4421e3b5f60cb96cb1177349cfa638b78a8
Jul 15 21:38:38.539003 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.538972    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:38.539057 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.539045    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:38.539099 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:38.539074    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:39.072352 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:39.072319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" event={"ID":"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17","Type":"ContainerStarted","Data":"d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f"}
Jul 15 21:38:39.072526 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:39.072367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" event={"ID":"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17","Type":"ContainerStarted","Data":"1d012ec48d74d16e6904d0600860c4421e3b5f60cb96cb1177349cfa638b78a8"}
Jul 15 21:38:39.095040 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:39.094993    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podStartSLOduration=1.094979007 podStartE2EDuration="1.094979007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:39.092403643 +0000 UTC m=+2370.246088163" watchObservedRunningTime="2026-07-15 21:38:39.094979007 +0000 UTC m=+2370.248663528"
Jul 15 21:38:39.398451 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:39.398417    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:39.403160 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:39.403136    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:40.077952 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:40.077925    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:40.078723 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:40.078705    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:41.083683 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.083652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:41.200495 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.200466    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"]
Jul 15 21:38:41.204123 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.204099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.207158 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.207142    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:38:41.208162 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.208142    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:38:41.208301 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.208266    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-39670c-serving-cert\""
Jul 15 21:38:41.208463 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.208451    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wdxsw\""
Jul 15 21:38:41.219057 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.219033    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"]
Jul 15 21:38:41.224413 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.224385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:41.239341 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.239317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lt7g\" (UniqueName: \"kubernetes.io/projected/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-kube-api-access-7lt7g\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.239432 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.239356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.239472 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.239454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.340714 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.340635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.340714 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.340672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lt7g\" (UniqueName: \"kubernetes.io/projected/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-kube-api-access-7lt7g\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.340714 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.340709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.340925 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:38:41.340808    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-serving-cert: secret "maas-api-e2e-shared-a-39670c-serving-cert" not found
Jul 15 21:38:41.340925 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:38:41.340883    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls podName:3f12c68d-ddbf-4875-99d1-24a14eac6d3a nodeName:}" failed. No retries permitted until 2026-07-15 21:38:41.840863141 +0000 UTC m=+2372.994547643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls") pod "maas-api-e2e-shared-a-39670c-6457fd745-kggnx" (UID: "3f12c68d-ddbf-4875-99d1-24a14eac6d3a") : secret "maas-api-e2e-shared-a-39670c-serving-cert" not found
Jul 15 21:38:41.341376 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.341360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.349946 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.349920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:41.352020 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.351999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lt7g\" (UniqueName: \"kubernetes.io/projected/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-kube-api-access-7lt7g\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.600579 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.600535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:41.844390 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.844357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.846704 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.846678    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls\") pod \"maas-api-e2e-shared-a-39670c-6457fd745-kggnx\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:41.958132 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:41.958041    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:42.060564 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:42.060506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:42.115977 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:42.115951    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:42.256852 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:42.256827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"]
Jul 15 21:38:42.258673 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:38:42.258641    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f12c68d_ddbf_4875_99d1_24a14eac6d3a.slice/crio-60c18edcb1022c843ba3e1a7c82cf697c36c3f14c64523aba2aea94e7769343c WatchSource:0}: Error finding container 60c18edcb1022c843ba3e1a7c82cf697c36c3f14c64523aba2aea94e7769343c: Status 404 returned error can't find the container with id 60c18edcb1022c843ba3e1a7c82cf697c36c3f14c64523aba2aea94e7769343c
Jul 15 21:38:43.094725 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:43.094684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx" event={"ID":"3f12c68d-ddbf-4875-99d1-24a14eac6d3a","Type":"ContainerStarted","Data":"ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e"}
Jul 15 21:38:43.094902 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:43.094739    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx" event={"ID":"3f12c68d-ddbf-4875-99d1-24a14eac6d3a","Type":"ContainerStarted","Data":"60c18edcb1022c843ba3e1a7c82cf697c36c3f14c64523aba2aea94e7769343c"}
Jul 15 21:38:43.094902 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:43.094812    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:43.117088 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:43.117038    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx" podStartSLOduration=1.385699011 podStartE2EDuration="2.117017316s" totalImagesPullingTime="731.318305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:43.115259114 +0000 UTC m=+2374.268943635" watchObservedRunningTime="2026-07-15 21:38:43.117017316 +0000 UTC m=+2374.270701837"
Jul 15 21:38:43.431732 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:43.431702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:45.621941 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:45.621904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:45.946302 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:45.946220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:46.236976 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.236893    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"]
Jul 15 21:38:46.241385 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.241357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.244234 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.244213    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-feaa76-openshift-default-dockercfg-wz7hk\""
Jul 15 21:38:46.254271 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.254248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"]
Jul 15 21:38:46.265905 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.265879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:46.281412 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281383    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-socket\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281412 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-certs\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281444    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-data\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-token\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-credential-socket\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281600 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cftvq\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-kube-api-access-cftvq\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-podinfo\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-envoy\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.281735 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.281673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0933179e-d92a-4370-bbf6-f6205eb516f5-istiod-ca-cert\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383076 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0933179e-d92a-4370-bbf6-f6205eb516f5-istiod-ca-cert\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-socket\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383123    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-certs\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-data\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-token\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-credential-socket\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383480 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cftvq\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-kube-api-access-cftvq\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383480 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-podinfo\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383480 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-envoy\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383677 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-certs\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383746 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-credential-socket\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383746 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383733    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-data\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383844 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0933179e-d92a-4370-bbf6-f6205eb516f5-istiod-ca-cert\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.383880 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.383867    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-socket\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.385570 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.385536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-envoy\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.385864 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.385846    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-podinfo\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.392653 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.392628    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cftvq\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-kube-api-access-cftvq\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.392878 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.392858    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-token\") pod \"e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") " pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.551535 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.551464    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:46.607987 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.607942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:46.703219 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.703191    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"]
Jul 15 21:38:46.704312 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:38:46.704284    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0933179e_d92a_4370_bbf6_f6205eb516f5.slice/crio-7e4ea899e8450138c019a709462b48b355612a009a115412cc0277ff04bcbaff WatchSource:0}: Error finding container 7e4ea899e8450138c019a709462b48b355612a009a115412cc0277ff04bcbaff: Status 404 returned error can't find the container with id 7e4ea899e8450138c019a709462b48b355612a009a115412cc0277ff04bcbaff
Jul 15 21:38:46.706707 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.706675    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:46.706776 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.706743    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:46.706776 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:46.706770    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:47.119429 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:47.119382    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" event={"ID":"0933179e-d92a-4370-bbf6-f6205eb516f5","Type":"ContainerStarted","Data":"315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5"}
Jul 15 21:38:47.119673 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:47.119476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" event={"ID":"0933179e-d92a-4370-bbf6-f6205eb516f5","Type":"ContainerStarted","Data":"7e4ea899e8450138c019a709462b48b355612a009a115412cc0277ff04bcbaff"}
Jul 15 21:38:47.146968 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:47.146917    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podStartSLOduration=1.146900393 podStartE2EDuration="1.146900393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:47.145169093 +0000 UTC m=+2378.298853614" watchObservedRunningTime="2026-07-15 21:38:47.146900393 +0000 UTC m=+2378.300584912"
Jul 15 21:38:47.551877 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:47.551793    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:47.556714 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:47.556686    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:48.125088 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:48.125052    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:48.126141 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:48.126118    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:38:49.106037 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:49.106007    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:38:49.204606 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:49.204577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:49.304650 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:49.304618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:49.312173 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:49.312134    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:38:49.402802 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:49.402723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:49.801002 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:49.800923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:49.931316 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:49.931273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:50.030275 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:50.030238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:53.671692 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:53.671660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:54.496268 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:54.496234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:38:56.119741 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:56.119698    2573 patch_prober.go:28] interesting pod/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 21:38:56.120161 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:56.119775    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 21:38:58.181451 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:58.181419    2573 generic.go:356] "Generic (PLEG): container finished" podID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerID="d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f" exitCode=0
Jul 15 21:38:58.181878 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:58.181491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" event={"ID":"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17","Type":"ContainerDied","Data":"d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f"}
Jul 15 21:38:58.182002 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:58.181985    2573 scope.go:117] "RemoveContainer" containerID="d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f"
Jul 15 21:38:58.182949 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:58.182925    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:58.182998 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:58.182988    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:58.183032 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:58.183019    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:38:59.188605 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:59.188572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" event={"ID":"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17","Type":"ContainerStarted","Data":"22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5"}
Jul 15 21:38:59.398617 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:59.398154    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:38:59.398617 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:59.398288    2573 patch_prober.go:28] interesting pod/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 21:38:59.398617 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:38:59.398334    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 21:39:00.316154 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:00.316119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:39:00.324714 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:00.324677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:00.398406 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:00.398373    2573 patch_prober.go:28] interesting pod/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 21:39:00.398582 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:00.398423    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 21:39:01.398727 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:01.398681    2573 patch_prober.go:28] interesting pod/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 21:39:01.399253 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:01.398750    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 21:39:02.398065 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:02.398027    2573 patch_prober.go:28] interesting pod/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 21:39:02.398246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:02.398082    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 21:39:02.766273 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:02.766187    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:02.867146 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:02.867115    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:03.453454 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:03.453418    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:39:03.453829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:03.453801    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:39:03.457253 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:03.457231    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:39:04.075743 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.075165    2573 patch_prober.go:28] interesting pod/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": read tcp 10.133.0.2:40764->10.133.0.64:15021: read: connection reset by peer" start-of-body=
Jul 15 21:39:04.075743 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.075243    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": read tcp 10.133.0.2:40764->10.133.0.64:15021: read: connection reset by peer"
Jul 15 21:39:04.218033 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.218003    2573 generic.go:356] "Generic (PLEG): container finished" podID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerID="315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5" exitCode=0
Jul 15 21:39:04.218200 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.218077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" event={"ID":"0933179e-d92a-4370-bbf6-f6205eb516f5","Type":"ContainerDied","Data":"315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5"}
Jul 15 21:39:04.218604 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.218586    2573 scope.go:117] "RemoveContainer" containerID="315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5"
Jul 15 21:39:04.219512 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.219486    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:39:04.219641 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.219561    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:39:04.219641 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:04.219595    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:39:05.228292 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:05.228255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" event={"ID":"0933179e-d92a-4370-bbf6-f6205eb516f5","Type":"ContainerStarted","Data":"bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827"}
Jul 15 21:39:05.551996 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:05.551905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:39:05.552217 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:05.552194    2573 patch_prober.go:28] interesting pod/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 21:39:05.552303 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:05.552264    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 21:39:05.854687 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:05.854651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:06.552179 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:06.552135    2573 patch_prober.go:28] interesting pod/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 21:39:06.552610 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:06.552207    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 21:39:07.551979 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:07.551938    2573 patch_prober.go:28] interesting pod/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 21:39:07.552173 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:07.552005    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 21:39:08.552438 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:08.552400    2573 patch_prober.go:28] interesting pod/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 21:39:08.552857 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:08.552453    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 21:39:09.555794 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:09.555766    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:39:09.556177 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:09.556012    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:39:09.556630 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:09.556615    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:39:10.409795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:10.409759    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:39:10.417087 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:10.417069    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:39:10.510886 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:10.510853    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:10.967256 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:10.967223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:11.067222 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:11.067193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:13.603089 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:13.603056    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:39:14.751286 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:14.751252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:46.624966 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:46.624896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:39:50.496902 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:39:50.496869    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:40:08.999992 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:40:08.999959    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:40:26.992067 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:40:26.992035    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:40:46.094315 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:40:46.094283    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:40:58.899608 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:40:58.899572    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:41:15.410143 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:41:15.410110    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:41:35.197725 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:41:35.197694    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:41:51.527364 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:41:51.527328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:41:52.831426 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:41:52.831398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:41:52.897214 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:41:52.897177    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:41:57.974107 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:41:57.974075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:41:58.791022 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:41:58.790982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:42:04.281355 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:42:04.281324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:42:09.197386 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:42:09.197352    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:42:23.176400 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:42:23.176363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:42:26.699466 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:42:26.699433    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:42:44.204672 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:42:44.204599    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:43:01.703214 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:01.703177    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:43:08.066813 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:08.066773    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:43:08.846586 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:08.846527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:43:20.093326 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:20.093286    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:43:20.392110 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:20.392031    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:43:29.693745 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:29.693712    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:43:44.014528 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:44.014493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:43:48.192896 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:43:48.192864    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:44:03.625218 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:03.625133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:03.724471 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:03.724437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:08.992360 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:08.992328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:44:10.441602 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:10.441576    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:44:10.449640 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:10.449615    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrgq2_8624d9fd-e95e-42ae-aa7d-722f62e77848/ovn-acl-logging/0.log"
Jul 15 21:44:11.882383 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:11.882347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:11.982805 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:11.982770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:25.297292 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:25.297257    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:44:32.425305 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:32.425258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:33.224304 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:33.224274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:46.100515 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:46.100480    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:44:50.545533 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:50.545472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:50.648619 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:50.648584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:53.493691 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:53.493654    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:44:53.588006 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:44:53.587942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:03.319119 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.319086    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"]
Jul 15 21:45:03.324729 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.323421    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx" podUID="3f12c68d-ddbf-4875-99d1-24a14eac6d3a" containerName="maas-api" containerID="cri-o://ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e" gracePeriod=30
Jul 15 21:45:03.350505 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.350474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:03.578786 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.578731    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:45:03.617589 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.617562    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lt7g\" (UniqueName: \"kubernetes.io/projected/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-kube-api-access-7lt7g\") pod \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") "
Jul 15 21:45:03.617737 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.617631    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls\") pod \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") "
Jul 15 21:45:03.617737 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.617674    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-openshift-service-ca\") pod \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\" (UID: \"3f12c68d-ddbf-4875-99d1-24a14eac6d3a\") "
Jul 15 21:45:03.618067 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.618046    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f12c68d-ddbf-4875-99d1-24a14eac6d3a" (UID: "3f12c68d-ddbf-4875-99d1-24a14eac6d3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:45:03.619522 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.619486    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-kube-api-access-7lt7g" (OuterVolumeSpecName: "kube-api-access-7lt7g") pod "3f12c68d-ddbf-4875-99d1-24a14eac6d3a" (UID: "3f12c68d-ddbf-4875-99d1-24a14eac6d3a"). InnerVolumeSpecName "kube-api-access-7lt7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:45:03.619745 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.619726    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f12c68d-ddbf-4875-99d1-24a14eac6d3a" (UID: "3f12c68d-ddbf-4875-99d1-24a14eac6d3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:45:03.719223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.719188    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-openshift-service-ca\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:03.719223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.719216    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lt7g\" (UniqueName: \"kubernetes.io/projected/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-kube-api-access-7lt7g\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:03.719223 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:03.719227    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f12c68d-ddbf-4875-99d1-24a14eac6d3a-maas-api-tls\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:04.058465 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.058432    2573 generic.go:356] "Generic (PLEG): container finished" podID="3f12c68d-ddbf-4875-99d1-24a14eac6d3a" containerID="ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e" exitCode=0
Jul 15 21:45:04.058680 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.058474    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"
Jul 15 21:45:04.058680 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.058518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx" event={"ID":"3f12c68d-ddbf-4875-99d1-24a14eac6d3a","Type":"ContainerDied","Data":"ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e"}
Jul 15 21:45:04.058680 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.058593    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx" event={"ID":"3f12c68d-ddbf-4875-99d1-24a14eac6d3a","Type":"ContainerDied","Data":"60c18edcb1022c843ba3e1a7c82cf697c36c3f14c64523aba2aea94e7769343c"}
Jul 15 21:45:04.058680 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.058624    2573 scope.go:117] "RemoveContainer" containerID="ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e"
Jul 15 21:45:04.067832 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.067813    2573 scope.go:117] "RemoveContainer" containerID="ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e"
Jul 15 21:45:04.068100 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:45:04.068080    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e\": container with ID starting with ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e not found: ID does not exist" containerID="ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e"
Jul 15 21:45:04.068140 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.068109    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e"} err="failed to get container status \"ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e\": rpc error: code = NotFound desc = could not find container \"ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e\": container with ID starting with ae9afbb591c77c1486bb67d22817769070d4dba969478cfe044985c04480650e not found: ID does not exist"
Jul 15 21:45:04.080832 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.080809    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"]
Jul 15 21:45:04.085171 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:04.085153    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-39670c-6457fd745-kggnx"]
Jul 15 21:45:05.574909 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:05.574876    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f12c68d-ddbf-4875-99d1-24a14eac6d3a" path="/var/lib/kubelet/pods/3f12c68d-ddbf-4875-99d1-24a14eac6d3a/volumes"
Jul 15 21:45:06.304362 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:06.304327    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:45:08.215233 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:08.215119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:08.499259 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:08.499167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:14.779598 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:14.779560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:14.946742 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:14.946701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:15.127385 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:15.127351    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"]
Jul 15 21:45:15.127589 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:15.127537    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy" containerID="cri-o://22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5" gracePeriod=30
Jul 15 21:45:15.130923 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:15.130889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:15.317989 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:15.317953    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:16.111313 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:16.111276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:16.211172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:16.211144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:18.457088 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:18.457049    2573 patch_prober.go:28] interesting pod/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 21:45:18.457527 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:18.457109    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:45:20.371959 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.371935    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:45:20.462409 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462341    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-data\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462409 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462369    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-certs\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-socket\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462471    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-token\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462508    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-podinfo\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462568    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj7x6\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-kube-api-access-fj7x6\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462626 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462608    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-credential-socket\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462651    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istiod-ca-cert\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462669    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.462865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462738    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-envoy\") pod \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\" (UID: \"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17\") "
Jul 15 21:45:20.462865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462761    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.462865 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462856    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.463124 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.462956    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:45:20.463124 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.463076    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-certs\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.463124 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.463093    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-workload-socket\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.463124 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.463104    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-credential-socket\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.463124 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.463117    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istiod-ca-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.463375 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.463353    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-data" (OuterVolumeSpecName: "istio-data") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.464856 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.464833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-token" (OuterVolumeSpecName: "istio-token") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:45:20.464958 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.464862    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.465100 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.465082    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-kube-api-access-fj7x6" (OuterVolumeSpecName: "kube-api-access-fj7x6") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "kube-api-access-fj7x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:45:20.465179 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.465158    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" (UID: "febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 21:45:20.564375 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.564348    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-envoy\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.564375 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.564370    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-data\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.564512 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.564381    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-token\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.564512 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.564393    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-istio-podinfo\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.564512 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:20.564404    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj7x6\" (UniqueName: \"kubernetes.io/projected/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17-kube-api-access-fj7x6\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.144607 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.144575    2573 generic.go:356] "Generic (PLEG): container finished" podID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerID="22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5" exitCode=0
Jul 15 21:45:21.144795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.144626    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"
Jul 15 21:45:21.144795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.144628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" event={"ID":"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17","Type":"ContainerDied","Data":"22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5"}
Jul 15 21:45:21.144795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.144742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8" event={"ID":"febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17","Type":"ContainerDied","Data":"1d012ec48d74d16e6904d0600860c4421e3b5f60cb96cb1177349cfa638b78a8"}
Jul 15 21:45:21.144795 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.144763    2573 scope.go:117] "RemoveContainer" containerID="22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5"
Jul 15 21:45:21.153833 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.153817    2573 scope.go:117] "RemoveContainer" containerID="d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f"
Jul 15 21:45:21.161332 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.161316    2573 scope.go:117] "RemoveContainer" containerID="22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5"
Jul 15 21:45:21.161614 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:45:21.161592    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5\": container with ID starting with 22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5 not found: ID does not exist" containerID="22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5"
Jul 15 21:45:21.161670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.161626    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5"} err="failed to get container status \"22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5\": rpc error: code = NotFound desc = could not find container \"22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5\": container with ID starting with 22b50def279ae376272f9e3b0c636bf75c27ae7cad4b96d06879d6af3b5a85e5 not found: ID does not exist"
Jul 15 21:45:21.161670 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.161648    2573 scope.go:117] "RemoveContainer" containerID="d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f"
Jul 15 21:45:21.161874 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:45:21.161853    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f\": container with ID starting with d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f not found: ID does not exist" containerID="d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f"
Jul 15 21:45:21.161917 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.161880    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f"} err="failed to get container status \"d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f\": rpc error: code = NotFound desc = could not find container \"d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f\": container with ID starting with d7885457c49f11e95988a45e91ebd3755930bd98a3caae9dac015ce28df5599f not found: ID does not exist"
Jul 15 21:45:21.167965 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.167944    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"]
Jul 15 21:45:21.175111 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.175092    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-39670c-openshift-default-6f9dc695b7-n74h8"]
Jul 15 21:45:21.574260 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:21.574167    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" path="/var/lib/kubelet/pods/febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17/volumes"
Jul 15 21:45:26.026825 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:26.026791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:29.006317 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:29.006278    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd8zx"]
Jul 15 21:45:30.557744 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:30.557708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:30.967247 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:30.967212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:37.204987 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:37.204957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:37.270454 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:37.270416    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:37.456839 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:37.456760    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"]
Jul 15 21:45:37.457044 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:37.457020    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy" containerID="cri-o://bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827" gracePeriod=30
Jul 15 21:45:37.474212 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:37.474181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:37.727613 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:37.727514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:39.558335 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:39.558300    2573 patch_prober.go:28] interesting pod/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 21:45:39.558803 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:39.558353    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:45:42.711491 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.711466    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:45:42.760083 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-podinfo\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760083 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760045    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-credential-socket\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-socket\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760118    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-certs\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760140    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-data\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760174    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-token\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760199    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0933179e-d92a-4370-bbf6-f6205eb516f5-istiod-ca-cert\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760228    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-envoy\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760287 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760281    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cftvq\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-kube-api-access-cftvq\") pod \"0933179e-d92a-4370-bbf6-f6205eb516f5\" (UID: \"0933179e-d92a-4370-bbf6-f6205eb516f5\") "
Jul 15 21:45:42.760664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760440    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:42.760664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760472    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:42.760664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760449    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:42.760664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760643    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-socket\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.760664 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760661    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-workload-certs\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.760916 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760675    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-credential-socket\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.760916 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.760846    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0933179e-d92a-4370-bbf6-f6205eb516f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:45:42.761078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.761059    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:42.762246 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.762219    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 21:45:42.762388 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.762366    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:45:42.762794 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.762773    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:42.762794 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.762786    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-kube-api-access-cftvq" (OuterVolumeSpecName: "kube-api-access-cftvq") pod "0933179e-d92a-4370-bbf6-f6205eb516f5" (UID: "0933179e-d92a-4370-bbf6-f6205eb516f5"). InnerVolumeSpecName "kube-api-access-cftvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:45:42.861941 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.861909    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-envoy\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.861941 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.861936    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cftvq\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-kube-api-access-cftvq\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.861941 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.861945    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-podinfo\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.862172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.861955    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-data\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.862172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.861962    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0933179e-d92a-4370-bbf6-f6205eb516f5-istio-token\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:42.862172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:42.861970    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0933179e-d92a-4370-bbf6-f6205eb516f5-istiod-ca-cert\") on node \"ip-10-0-135-15.ec2.internal\" DevicePath \"\""
Jul 15 21:45:43.268599 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.268566    2573 generic.go:356] "Generic (PLEG): container finished" podID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerID="bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827" exitCode=0
Jul 15 21:45:43.268789 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.268605    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"
Jul 15 21:45:43.268789 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.268642    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" event={"ID":"0933179e-d92a-4370-bbf6-f6205eb516f5","Type":"ContainerDied","Data":"bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827"}
Jul 15 21:45:43.268789 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.268701    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27" event={"ID":"0933179e-d92a-4370-bbf6-f6205eb516f5","Type":"ContainerDied","Data":"7e4ea899e8450138c019a709462b48b355612a009a115412cc0277ff04bcbaff"}
Jul 15 21:45:43.268789 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.268730    2573 scope.go:117] "RemoveContainer" containerID="bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827"
Jul 15 21:45:43.284067 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.284050    2573 scope.go:117] "RemoveContainer" containerID="315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5"
Jul 15 21:45:43.291711 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.291693    2573 scope.go:117] "RemoveContainer" containerID="bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827"
Jul 15 21:45:43.291939 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:45:43.291920    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827\": container with ID starting with bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827 not found: ID does not exist" containerID="bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827"
Jul 15 21:45:43.291999 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.291947    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827"} err="failed to get container status \"bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827\": rpc error: code = NotFound desc = could not find container \"bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827\": container with ID starting with bd1be8d23a5a10dd9bc1ba18c867a5a22541119a3d448208bb9bb461c94b9827 not found: ID does not exist"
Jul 15 21:45:43.291999 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.291961    2573 scope.go:117] "RemoveContainer" containerID="315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5"
Jul 15 21:45:43.292168 ip-10-0-135-15 kubenswrapper[2573]: E0715 21:45:43.292151    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5\": container with ID starting with 315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5 not found: ID does not exist" containerID="315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5"
Jul 15 21:45:43.292209 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.292173    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5"} err="failed to get container status \"315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5\": rpc error: code = NotFound desc = could not find container \"315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5\": container with ID starting with 315f90ba8c0abfb389703f4d6f33284b303878bb20327329b7a4ba3bb71f05c5 not found: ID does not exist"
Jul 15 21:45:43.295295 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.295276    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"]
Jul 15 21:45:43.301297 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.301280    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-feaa76-openshift-default-79b68f77f-cxr27"]
Jul 15 21:45:43.574497 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.574420    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" path="/var/lib/kubelet/pods/0933179e-d92a-4370-bbf6-f6205eb516f5/volumes"
Jul 15 21:45:43.919334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:43.919309    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w5vkx_3d33cf55-eecd-417c-bc0e-b0dc09220426/manager/0.log"
Jul 15 21:45:44.044006 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:44.043971    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ntjhc_637da003-2a84-4323-93c1-a409b8ffbcaa/manager/0.log"
Jul 15 21:45:44.404978 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:44.404931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sl25l_f2663829-3ae6-4f97-a24a-5db85e09e7b8/manager/0.log"
Jul 15 21:45:44.521121 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:44.521099    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-9pmkx_5b5fc402-f0a4-4087-a7f7-7bc952836dc3/copy-manifests/0.log"
Jul 15 21:45:44.527843 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:44.527824    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-9pmkx_5b5fc402-f0a4-4087-a7f7-7bc952836dc3/manager/0.log"
Jul 15 21:45:45.367482 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:45.367454    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735850-lsjq9_35319982-beaa-4aab-ab07-dcba7db6ed70/cleanup/0.log"
Jul 15 21:45:45.596943 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:45.596915    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-0b8f8143-2wscl_02fc875f-89dd-48da-9fc7-2d005fa9373d/revoke-keys/0.log"
Jul 15 21:45:45.704825 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:45.704743    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-f1c9c155-nvzcl_3b6bb050-192f-4b34-919b-64c3eb3862b1/revoke-keys/0.log"
Jul 15 21:45:46.045522 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:46.045441    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-ceeadc32-zbt9v_3a1f6056-c6f4-4ee3-9034-ffaac3b0ee0f/revoke-keys/0.log"
Jul 15 21:45:46.160994 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:46.160970    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-945d24-t949x_261b815a-3c7d-41b8-9d6d-0d4266afb997/revoke-keys/0.log"
Jul 15 21:45:46.274916 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:46.274890    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-6874e2-tpwln_f9e9bb1a-1bb5-46dc-afb0-3ede61725ab2/revoke-keys/0.log"
Jul 15 21:45:46.391231 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:46.391204    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-52019953-r9n5f_84f8946e-c7af-4753-9f19-cc8c13d53b82/revoke-keys/0.log"
Jul 15 21:45:46.503744 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:46.503723    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-372e1c00-x4tt8_43ced6a3-4519-4791-84f6-87ed646ba886/revoke-keys/0.log"
Jul 15 21:45:46.615387 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:46.615364    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-77f212fb-ddb9x_3ced7363-df98-44e6-9213-59b58c5853d6/revoke-keys/0.log"
Jul 15 21:45:48.354695 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:48.354664    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ddf4x_a67963d7-3bf6-4464-9c9d-6337e46a12aa/manager/0.log"
Jul 15 21:45:48.939616 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:48.939591    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wd8zx_31701a70-2b3b-4269-83ed-be51b3aee290/limitador/0.log"
Jul 15 21:45:49.060746 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:49.060713    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jzdwf_41e4f618-f546-4bab-a9a8-f6539dbf6e63/manager/0.log"
Jul 15 21:45:49.523599 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:49.523539    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mkrsl_eeacc1f8-dfe2-4d67-979c-13a28c845024/discovery/0.log"
Jul 15 21:45:49.634259 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:49.634225    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-gggjh_2451d1da-3306-4bab-abb4-71bfbcdd142d/kube-auth-proxy/0.log"
Jul 15 21:45:50.885364 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:50.885329    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd5xjf_74381800-b907-4131-8528-1285d18aacd2/main/0.log"
Jul 15 21:45:57.344172 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:57.344139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:45:57.439122 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:45:57.439085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log" limit=1024
Jul 15 21:46:00.469704 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:00.469645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sthd8_ebcc66aa-2faa-47f4-b31c-d270d90abacc/global-pull-secret-syncer/0.log"
Jul 15 21:46:00.583577 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:00.583533    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6kj6p_7b78d033-4ff4-4d8f-ab01-142182b25978/konnectivity-agent/0.log"
Jul 15 21:46:00.711368 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:00.711335    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-15.ec2.internal_00eb5a080a0134a434dc03cd5b8be74b/haproxy/0.log"
Jul 15 21:46:06.061057 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:06.061028    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ddf4x_a67963d7-3bf6-4464-9c9d-6337e46a12aa/manager/0.log"
Jul 15 21:46:06.455045 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:06.455016    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wd8zx_31701a70-2b3b-4269-83ed-be51b3aee290/limitador/0.log"
Jul 15 21:46:06.554910 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:06.554881    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jzdwf_41e4f618-f546-4bab-a9a8-f6539dbf6e63/manager/0.log"
Jul 15 21:46:08.831232 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:08.831189    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctnkg_1859de22-2453-415e-96f7-c98435679c58/node-exporter/0.log"
Jul 15 21:46:08.860991 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:08.860966    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctnkg_1859de22-2453-415e-96f7-c98435679c58/kube-rbac-proxy/0.log"
Jul 15 21:46:08.893364 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:08.893344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctnkg_1859de22-2453-415e-96f7-c98435679c58/init-textfile/0.log"
Jul 15 21:46:09.122829 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.122807    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75f336e8-ff20-4715-87d9-fef641f3f3e2/prometheus/0.log"
Jul 15 21:46:09.155024 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.155002    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75f336e8-ff20-4715-87d9-fef641f3f3e2/config-reloader/0.log"
Jul 15 21:46:09.185952 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.185931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75f336e8-ff20-4715-87d9-fef641f3f3e2/thanos-sidecar/0.log"
Jul 15 21:46:09.212593 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.212571    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75f336e8-ff20-4715-87d9-fef641f3f3e2/kube-rbac-proxy-web/0.log"
Jul 15 21:46:09.235143 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.235129    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75f336e8-ff20-4715-87d9-fef641f3f3e2/kube-rbac-proxy/0.log"
Jul 15 21:46:09.258645 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.258621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75f336e8-ff20-4715-87d9-fef641f3f3e2/kube-rbac-proxy-thanos/0.log"
Jul 15 21:46:09.281641 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.281621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75f336e8-ff20-4715-87d9-fef641f3f3e2/init-config-reloader/0.log"
Jul 15 21:46:09.332706 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.332683    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-69q9r_79c08b8c-00d5-4187-83eb-2b4d308b5ddf/prometheus-operator/0.log"
Jul 15 21:46:09.353722 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.353704    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-69q9r_79c08b8c-00d5-4187-83eb-2b4d308b5ddf/kube-rbac-proxy/0.log"
Jul 15 21:46:09.379494 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.379434    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-p87gx_a818e2c6-32cd-467b-acd1-5f6e2f924c7c/prometheus-operator-admission-webhook/0.log"
Jul 15 21:46:09.412784 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.412767    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cbccc55b8-ltzc9_2a697f4c-8e49-487c-b6ad-686913e10c5a/telemeter-client/0.log"
Jul 15 21:46:09.439565 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.439526    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cbccc55b8-ltzc9_2a697f4c-8e49-487c-b6ad-686913e10c5a/reload/0.log"
Jul 15 21:46:09.489174 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.489154    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cbccc55b8-ltzc9_2a697f4c-8e49-487c-b6ad-686913e10c5a/kube-rbac-proxy/0.log"
Jul 15 21:46:09.533339 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.533318    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc98fdbf-mg7zq_5d2e1241-c97c-4df1-aa83-789a4e2512f3/thanos-query/0.log"
Jul 15 21:46:09.558565 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.558523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc98fdbf-mg7zq_5d2e1241-c97c-4df1-aa83-789a4e2512f3/kube-rbac-proxy-web/0.log"
Jul 15 21:46:09.584093 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.584071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc98fdbf-mg7zq_5d2e1241-c97c-4df1-aa83-789a4e2512f3/kube-rbac-proxy/0.log"
Jul 15 21:46:09.606101 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.606082    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc98fdbf-mg7zq_5d2e1241-c97c-4df1-aa83-789a4e2512f3/prom-label-proxy/0.log"
Jul 15 21:46:09.627593 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.627577    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc98fdbf-mg7zq_5d2e1241-c97c-4df1-aa83-789a4e2512f3/kube-rbac-proxy-rules/0.log"
Jul 15 21:46:09.653345 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:09.653289    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc98fdbf-mg7zq_5d2e1241-c97c-4df1-aa83-789a4e2512f3/kube-rbac-proxy-metrics/0.log"
Jul 15 21:46:10.235872 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.235840    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"]
Jul 15 21:46:10.236404 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236384    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy"
Jul 15 21:46:10.236537 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236524    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy"
Jul 15 21:46:10.236635 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236619    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy"
Jul 15 21:46:10.236704 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236638    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy"
Jul 15 21:46:10.236704 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236648    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f12c68d-ddbf-4875-99d1-24a14eac6d3a" containerName="maas-api"
Jul 15 21:46:10.236704 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236656    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f12c68d-ddbf-4875-99d1-24a14eac6d3a" containerName="maas-api"
Jul 15 21:46:10.236851 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236765    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy"
Jul 15 21:46:10.236851 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236781    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f12c68d-ddbf-4875-99d1-24a14eac6d3a" containerName="maas-api"
Jul 15 21:46:10.236851 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236793    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="febbfdf1-e9ab-44c1-bcc5-e305ce0c5d17" containerName="istio-proxy"
Jul 15 21:46:10.236851 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236802    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy"
Jul 15 21:46:10.236851 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.236810    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0933179e-d92a-4370-bbf6-f6205eb516f5" containerName="istio-proxy"
Jul 15 21:46:10.241569 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.241534    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.244228 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.244175    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dprpk\"/\"kube-root-ca.crt\""
Jul 15 21:46:10.244334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.244297    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dprpk\"/\"openshift-service-ca.crt\""
Jul 15 21:46:10.244334 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.244304    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dprpk\"/\"default-dockercfg-tsvf8\""
Jul 15 21:46:10.251738 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.251710    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"]
Jul 15 21:46:10.389112 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.389084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-proc\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.389257 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.389126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-lib-modules\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.389257 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.389149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-sys\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.389329 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.389252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-podres\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.389329 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.389286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88szv\" (UniqueName: \"kubernetes.io/projected/1cd123fc-eb30-448c-bc53-35359257e7bf-kube-api-access-88szv\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490063 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.489998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-podres\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490063 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88szv\" (UniqueName: \"kubernetes.io/projected/1cd123fc-eb30-448c-bc53-35359257e7bf-kube-api-access-88szv\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490063 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-proc\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490369 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-lib-modules\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490369 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-sys\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490369 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-podres\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490369 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-proc\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490369 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490197    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-sys\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.490369 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.490275    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cd123fc-eb30-448c-bc53-35359257e7bf-lib-modules\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.500332 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.500310    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88szv\" (UniqueName: \"kubernetes.io/projected/1cd123fc-eb30-448c-bc53-35359257e7bf-kube-api-access-88szv\") pod \"perf-node-gather-daemonset-2fbf6\" (UID: \"1cd123fc-eb30-448c-bc53-35359257e7bf\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.552164 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.552142    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:10.676668 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.676633    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"]
Jul 15 21:46:10.680531 ip-10-0-135-15 kubenswrapper[2573]: W0715 21:46:10.680502    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1cd123fc_eb30_448c_bc53_35359257e7bf.slice/crio-a22bebe05b39905a06a30e71ca59d1d038f7313463c3f59e24ebd46b0920282c WatchSource:0}: Error finding container a22bebe05b39905a06a30e71ca59d1d038f7313463c3f59e24ebd46b0920282c: Status 404 returned error can't find the container with id a22bebe05b39905a06a30e71ca59d1d038f7313463c3f59e24ebd46b0920282c
Jul 15 21:46:10.886124 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:10.886098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-fjrn7_a44f82f6-c9f3-45e6-91b0-50b0267db25c/networking-console-plugin/0.log"
Jul 15 21:46:11.411078 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:11.411047    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6" event={"ID":"1cd123fc-eb30-448c-bc53-35359257e7bf","Type":"ContainerStarted","Data":"62cf67953c6410aa30ddcf6db5b54f8b047e92b8f7e4acdac13a8c9b4caa72bd"}
Jul 15 21:46:11.411458 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:11.411094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6" event={"ID":"1cd123fc-eb30-448c-bc53-35359257e7bf","Type":"ContainerStarted","Data":"a22bebe05b39905a06a30e71ca59d1d038f7313463c3f59e24ebd46b0920282c"}
Jul 15 21:46:11.411458 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:11.411124    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:11.434609 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:11.434559    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6" podStartSLOduration=1.434531819 podStartE2EDuration="1.434531819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:46:11.432740417 +0000 UTC m=+2822.586424938" watchObservedRunningTime="2026-07-15 21:46:11.434531819 +0000 UTC m=+2822.588216340"
Jul 15 21:46:11.956859 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:11.956829    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f946cccb9-6x25h_1ec4d126-6ac5-4d3c-8f50-d0eba7bf8b6b/console/0.log"
Jul 15 21:46:12.001767 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:12.001739    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-9gtmz_7e7cf03e-de3d-40c2-a2ea-78354bb982cc/download-server/0.log"
Jul 15 21:46:13.598138 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:13.598106    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gxdff_d9ac16ef-2a91-4991-a0dc-4fc923db5097/dns/0.log"
Jul 15 21:46:13.622049 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:13.622028    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gxdff_d9ac16ef-2a91-4991-a0dc-4fc923db5097/kube-rbac-proxy/0.log"
Jul 15 21:46:13.749251 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:13.749230    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kb88p_6aef2b0f-7b22-40a1-894a-74f378656ccc/dns-node-resolver/0.log"
Jul 15 21:46:14.362447 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:14.362418    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-669fcdf68-5jbmf_cf25fddf-b359-4a02-a3bc-bb1382f2e6de/registry/0.log"
Jul 15 21:46:14.415367 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:14.415337    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7pjv_70e5320c-a7cb-4073-bd12-6e92795c2ad4/node-ca/0.log"
Jul 15 21:46:15.614421 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:15.614388    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mkrsl_eeacc1f8-dfe2-4d67-979c-13a28c845024/discovery/0.log"
Jul 15 21:46:15.637080 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:15.637058    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-gggjh_2451d1da-3306-4bab-abb4-71bfbcdd142d/kube-auth-proxy/0.log"
Jul 15 21:46:16.609268 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:16.609242    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpkb2_97987fc5-dddf-4c40-ad72-043b5e16f9ea/serve-healthcheck-canary/0.log"
Jul 15 21:46:17.137306 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:17.137282    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrgh2_d44a1919-0277-4703-ae27-e5c2e027a5c5/kube-rbac-proxy/0.log"
Jul 15 21:46:17.163038 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:17.163007    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrgh2_d44a1919-0277-4703-ae27-e5c2e027a5c5/exporter/0.log"
Jul 15 21:46:17.188792 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:17.188767    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrgh2_d44a1919-0277-4703-ae27-e5c2e027a5c5/extractor/0.log"
Jul 15 21:46:17.425766 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:17.425688    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-2fbf6"
Jul 15 21:46:19.696397 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:19.696325    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w5vkx_3d33cf55-eecd-417c-bc0e-b0dc09220426/manager/0.log"
Jul 15 21:46:19.992749 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:19.992672    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ntjhc_637da003-2a84-4323-93c1-a409b8ffbcaa/manager/0.log"
Jul 15 21:46:20.388500 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:20.388471    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sl25l_f2663829-3ae6-4f97-a24a-5db85e09e7b8/manager/0.log"
Jul 15 21:46:20.418313 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:20.418290    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-9pmkx_5b5fc402-f0a4-4087-a7f7-7bc952836dc3/manager/0.log"
Jul 15 21:46:20.440588 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:20.440564    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-9pmkx_5b5fc402-f0a4-4087-a7f7-7bc952836dc3/copy-manifests/0.log"
Jul 15 21:46:20.765055 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:20.765028    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mkrsl_eeacc1f8-dfe2-4d67-979c-13a28c845024/discovery/0.log"
Jul 15 21:46:20.776000 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:20.775966    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-gggjh_2451d1da-3306-4bab-abb4-71bfbcdd142d/kube-auth-proxy/0.log"
Jul 15 21:46:22.399481 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:22.399453    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mkrsl_eeacc1f8-dfe2-4d67-979c-13a28c845024/discovery/0.log"
Jul 15 21:46:22.412272 ip-10-0-135-15 kubenswrapper[2573]: I0715 21:46:22.412246    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-gggjh_2451d1da-3306-4bab-abb4-71bfbcdd142d/kube-auth-proxy/0.log"