Jul 11 23:55:05.620827 ip-10-0-142-235 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 11 23:55:05.620839 ip-10-0-142-235 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 11 23:55:05.620846 ip-10-0-142-235 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 11 23:55:05.621063 ip-10-0-142-235 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 11 23:55:17.184303 ip-10-0-142-235 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 11 23:55:17.184318 ip-10-0-142-235 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5f343ffd3df8494ea8269bd900be6fba --
Jul 11 23:57:00.240196 ip-10-0-142-235 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.644756    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649061    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649073    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649078    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649081    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649084    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649086    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649089    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:57:00.684451 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649092    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649094    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649097    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649100    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649104    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649108    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649110    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649113    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649116    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649119    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649121    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649124    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649126    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649129    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649132    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649134    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649137    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649140    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649142    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:57:00.685781 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649145    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649148    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649152    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649156    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649159    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649163    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649165    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649168    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649180    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649185    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649188    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649191    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649194    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649197    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649201    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649204    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649207    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649210    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649213    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:57:00.687259 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649215    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649218    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649221    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649224    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649226    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649229    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649231    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649233    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649236    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649239    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649241    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649244    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649246    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649249    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649252    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649254    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649257    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649259    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649263    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649265    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:57:00.688163 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649268    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649271    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649273    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649276    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649279    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649281    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649284    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649286    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649289    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649291    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649295    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649298    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649301    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649303    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649306    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649310    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649312    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649315    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649317    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:57:00.689439 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649320    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649323    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649325    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649328    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649330    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649333    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649335    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649338    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649341    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649343    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649346    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649348    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649351    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649354    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.649357    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650059    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650065    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650068    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650071    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650074    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:57:00.690359 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650076    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650079    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650082    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650086    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650088    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650091    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650094    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650097    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650100    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650103    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650105    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650108    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650110    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650113    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650116    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650118    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650121    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650123    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650126    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650128    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:57:00.691700 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650131    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650133    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650136    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650139    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650141    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650144    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650147    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650149    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650152    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650154    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650158    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650161    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650163    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650166    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650168    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650171    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650173    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650176    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650178    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650181    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:57:00.692572 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650184    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650187    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650189    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650191    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650194    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650196    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650198    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650201    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650203    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650206    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650208    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650211    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650213    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650216    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650218    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650220    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650223    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650226    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650228    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650231    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:57:00.694100 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650234    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650236    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650238    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650241    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650243    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650246    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650248    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650250    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650253    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650256    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650258    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650261    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650263    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650266    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650269    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650272    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650274    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650277    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650279    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650283    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:57:00.694976 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650287    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650291    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650294    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650298    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650301    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650304    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650310    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650313    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650317    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650320    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650323    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650326    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650328    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650331    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650719    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650724    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650727    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650730    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650733    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:57:00.696267 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650736    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650739    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650742    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650745    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650747    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650772    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650775    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650778    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650781    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650783    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650786    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650789    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650791    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650794    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650797    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650799    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650802    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650804    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650807    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650811    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:57:00.697133 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650814    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650816    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650819    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650821    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650824    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650827    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650830    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650832    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650835    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650837    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650840    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650842    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650845    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650847    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650850    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650852    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650855    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650857    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650868    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650871    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:57:00.698047 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650874    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650876    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650879    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650881    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650884    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650886    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650889    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650891    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650893    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650896    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650898    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650902    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650905    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650908    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650910    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650913    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650917    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650921    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650924    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:57:00.698954 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650927    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650930    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650933    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650936    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650939    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650941    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650944    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650947    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650949    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650952    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650955    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650957    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650961    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650964    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650966    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650969    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650972    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650974    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650977    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650979    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:57:00.700079 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650981    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650984    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650987    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650989    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650993    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650995    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.650998    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651000    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651003    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651007    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651011    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651015    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651018    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651021    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651025    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651096    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651103    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651112    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651116    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651120    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 23:57:00.700995 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651124    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651128    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651133    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651136    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651139    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651144    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651148    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651151    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651154    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651156    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651159    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651162    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651165    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651170    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651173    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651176    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651180    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651184    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651187    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651190    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651193    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651197    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651200    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651203    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 23:57:00.702133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651206    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651209    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651212    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651216    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651219    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651222    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651225    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651227    2582 flags.go:64] FLAG: --enable-server="true"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651230    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651234    2582 flags.go:64] FLAG: --event-burst="100"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651237    2582 flags.go:64] FLAG: --event-qps="50"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651240    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651243    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651250    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651254    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651257    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651260    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651263    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651266    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651269    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651272    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651275    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651277    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651280    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651284    2582 flags.go:64] FLAG: --feature-gates=""
Jul 11 23:57:00.703246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651288    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651291    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651294    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651297    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651300    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651303    2582 flags.go:64] FLAG: --help="false"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651306    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-142-235.ec2.internal"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651309    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651311    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651314    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651317    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651321    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651323    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651326    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651329    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651332    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651335    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651338    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651341    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651344    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651348    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651351    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651354    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651357    2582 flags.go:64] FLAG: --lock-file=""
Jul 11 23:57:00.706730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651359    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651362    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651365    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651371    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651373    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651376    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651379    2582 flags.go:64] FLAG: --logging-format="text"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651383    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651386    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651389    2582 flags.go:64] FLAG: --manifest-url=""
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651392    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651396    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651399    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651403    2582 flags.go:64] FLAG: --max-pods="110"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651406    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651409    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651412    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651415    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651418    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651421    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651424    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651430    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651433    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651436    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 23:57:00.708041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651440    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651442    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651448    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651451    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651455    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651458    2582 flags.go:64] FLAG: --port="10250"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651461    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651465    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060187939d90b559a"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651468    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651471    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651474    2582 flags.go:64] FLAG: --register-node="true"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651477    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651480    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651483    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651486    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651488    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651493    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651496    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651499    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651502    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651505    2582 flags.go:64] FLAG: --runonce="false"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651508    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651511    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651513    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651516    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 23:57:00.709124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651519    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651522    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651525    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651528    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651531    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651534    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651536    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651539    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651542    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651545    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651548    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651554    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651557    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651560    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651564    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651573    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651576    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651579    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651582    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651585    2582 flags.go:64] FLAG: --v="2"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651589    2582 flags.go:64] FLAG: --version="false"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651593    2582 flags.go:64] FLAG: --vmodule=""
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651604    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.651609    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651749    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:57:00.710620 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651753    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651769    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651774    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651778    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651781    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651784    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651787    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651789    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651792    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651795    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651798    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651800    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651803    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651805    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651808    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651811    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651813    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651815    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651819    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:57:00.711704 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651822    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651825    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651827    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651830    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651833    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651836    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651838    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651841    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651844    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651846    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651849    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651853    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651856    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651858    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651861    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651863    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651866    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651868    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651871    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:57:00.712578 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651874    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651876    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651879    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651881    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651884    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651887    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651889    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651892    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651894    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651897    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651899    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651902    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651906    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651908    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651911    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651914    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651916    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651919    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651922    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651924    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:57:00.713669 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651927    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651930    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651933    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651937    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651941    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651944    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651947    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651950    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651953    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651955    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651958    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651961    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651964    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651967    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651970    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651973    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651976    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651979    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651982    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:57:00.714547 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651985    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651988    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651991    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651993    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651996    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.651999    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652002    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652004    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652007    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652009    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652012    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652014    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652018    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652020    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652023    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652025    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652028    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652032    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652035    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652037    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:57:00.715608 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.652041    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.652046    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.658853    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.658869    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.659623    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.659633    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659690    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659696    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659701    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659704    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659707    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659711    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659713    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659716    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659719    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:57:00.716467 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659721    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659724    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659727    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659729    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659732    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659736    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659741    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659745    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659751    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659754    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659775    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659778    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659781    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659784    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659787    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659790    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659793    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659795    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659798    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:57:00.717324 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659801    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659804    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659807    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659809    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659812    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659815    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659818    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659821    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659824    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659826    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659829    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659832    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659836    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659839    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659841    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659844    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659847    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659849    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659852    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659855    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:57:00.718241 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659857    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659861    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659864    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659867    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659869    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659872    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659875    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659877    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659880    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659882    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659885    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659888    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659890    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659893    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659896    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659898    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659901    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659904    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659906    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659909    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:57:00.719535 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659911    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659914    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659916    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659919    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659923    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659925    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659928    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659930    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659933    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659935    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659937    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659940    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659944    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659949    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659952    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659954    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659957    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659960    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659963    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659966    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:57:00.720412 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659969    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659971    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659974    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659977    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659979    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659982    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659984    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659987    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659990    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659993    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.659995    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.660000    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660112    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660117    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660120    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:57:00.721499 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660123    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:57:00.721287 ip-10-0-142-235 systemd[1]: Started Kubernetes Kubelet.
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660127    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660130    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660134    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660136    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660139    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660142    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660145    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660148    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660150    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660153    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660157    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660159    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660162    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660165    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660168    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660170    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660173    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660175    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660178    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:57:00.722371 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660181    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660183    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660186    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660189    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660191    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660194    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660197    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660199    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660202    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660206    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660209    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660212    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660215    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660219    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660221    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660224    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660226    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660229    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660231    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:57:00.723634 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660234    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660236    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660239    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660241    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660246    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660249    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660252    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660255    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660257    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660260    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660262    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660265    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660268    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660271    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660273    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660276    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660278    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660281    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660283    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660287    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:57:00.724495 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660290    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660294    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660297    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660300    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660303    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660306    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660310    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660313    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660316    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660319    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660322    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660325    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660328    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660331    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660334    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660337    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660342    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660344    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660347    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:57:00.726229 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660349    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660352    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660355    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660357    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660360    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660363    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660365    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660368    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660370    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660373    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660375    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660378    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660380    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660383    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660386    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660388    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660391    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:57:00.727306 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:00.660393    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.660398    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.660506    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.662487    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.663927    2582 server.go:1019] "Starting client certificate rotation"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.664022    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.664779    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.666633    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.669783    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.678652    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.680687    2582 log.go:25] "Validated CRI v1 image API"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.682929    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 23:57:00.728994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.686345    2582 fs.go:135] Filesystem UUIDs: map[1c681b93-9e9e-413f-a31a-8cad12a9e40b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 970ba1c1-0fca-4bca-ad56-e0eea5b79462:/dev/nvme0n1p3]
Jul 11 23:57:00.729651 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.686361    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.690824    2582 manager.go:216] Machine: {Timestamp:2026-07-11 23:57:00.689519085 +0000 UTC m=+0.318626585 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099483 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2800fa9b84a264d0a9740f77d277b7 SystemUUID:ec2800fa-9b84-a264-d0a9-740f77d277b7 BootID:5f343ffd-3df8-494e-a826-9bd900be6fba Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:f4:fa:50:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:f4:fa:50:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:23:50:f2:81:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.690923    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.691034    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.693849    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.693878    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.695067    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.695079    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 23:57:00.953952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.695087    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.695705    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.696476    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.699960    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.700065    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.700858    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.700873    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.700889    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.700899    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.700910    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.701212    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.701227    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.714328    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.715979    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716006    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716548    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716560    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716594    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716600    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716608    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716613    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716722    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716728    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716734    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716739    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716749    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.716770    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.717511    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.717519    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.719033    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.720634    2582 server.go:1268] "Started kubelet"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.720994    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.722552    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.723312    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.723344    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.724310    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.726898    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.727026    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.727176    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 23:57:00.975912 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.733149    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.733186    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.733375    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.733999    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxcbr"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.734048    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.734068    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.734407    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.734587    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.734595    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.734809    2582 factory.go:55] Registering systemd factory
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.734859    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.735982    2582 factory.go:153] Registering CRI-O factory
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.735997    2582 factory.go:223] Registration of the crio container factory successfully
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.736049    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.736072    2582 factory.go:103] Registering Raw factory
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.736088    2582 manager.go:1196] Started watching for new ooms in manager
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.736110    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.736518    2582 manager.go:349] Starting recovery of all containers
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.741545    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxcbr"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.743264    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.743302    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.743466    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-235.ec2.internal.18c161952b579e54  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-235.ec2.internal,UID:ip-10-0-142-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-235.ec2.internal,},FirstTimestamp:2026-07-11 23:57:00.7206109 +0000 UTC m=+0.349718405,LastTimestamp:2026-07-11 23:57:00.7206109 +0000 UTC m=+0.349718405,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-235.ec2.internal,}"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.746234    2582 manager.go:354] Recovery completed
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.751361    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.753430    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.753456    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.753468    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.753986    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.753994    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.754007    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.754058    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.754706    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:57:00.977622 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.754727    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.754737    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.755991    2582 policy_none.go:49] "None policy: Start"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.756013    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.756032    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.755748    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-235.ec2.internal.18c161952d4c9243  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-235.ec2.internal,UID:ip-10-0-142-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-235.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-235.ec2.internal,},FirstTimestamp:2026-07-11 23:57:00.753441347 +0000 UTC m=+0.382548847,LastTimestamp:2026-07-11 23:57:00.753441347 +0000 UTC m=+0.382548847,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-235.ec2.internal,}"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.757983    2582 policy_none.go:47] "Start"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.795340    2582 manager.go:337] "Starting Device Plugin manager"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.795506    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.795517    2582 server.go:87] "Starting device plugin registration server"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.795749    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.795778    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.796074    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.796145    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.796153    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.798286    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.798337    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.837116    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.838247    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.838278    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.838296    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.838324    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.840251    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.896141    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.897078    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.897104    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.897127    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.897150    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-235.ec2.internal"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.906965    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-235.ec2.internal"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.906983    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-235.ec2.internal\": node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.919927    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.939400    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal"]
Jul 11 23:57:00.979438 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.939480    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.940503    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.940532    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.940542    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.942716    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.942840    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.942866    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.943347    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.943374    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.943384    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.943352    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.943448    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.943464    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.945525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.945554    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.946402    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.946424    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:00.946434    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.972536    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-235.ec2.internal\" not found" node="ip-10-0-142-235.ec2.internal"
Jul 11 23:57:00.982552 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:00.976930    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-235.ec2.internal\" not found" node="ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.020804    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.035840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/86cbaaa3e1e3df5da4859be7e4292c8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal\" (UID: \"86cbaaa3e1e3df5da4859be7e4292c8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.035865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86cbaaa3e1e3df5da4859be7e4292c8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal\" (UID: \"86cbaaa3e1e3df5da4859be7e4292c8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.035884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b2e1ee019fd15bef55bf7af42a95521-config\") pod \"kube-apiserver-proxy-ip-10-0-142-235.ec2.internal\" (UID: \"2b2e1ee019fd15bef55bf7af42a95521\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.125860    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.137025    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/86cbaaa3e1e3df5da4859be7e4292c8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal\" (UID: \"86cbaaa3e1e3df5da4859be7e4292c8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.136979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/86cbaaa3e1e3df5da4859be7e4292c8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal\" (UID: \"86cbaaa3e1e3df5da4859be7e4292c8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.137090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86cbaaa3e1e3df5da4859be7e4292c8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal\" (UID: \"86cbaaa3e1e3df5da4859be7e4292c8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.137111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b2e1ee019fd15bef55bf7af42a95521-config\") pod \"kube-apiserver-proxy-ip-10-0-142-235.ec2.internal\" (UID: \"2b2e1ee019fd15bef55bf7af42a95521\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.137146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b2e1ee019fd15bef55bf7af42a95521-config\") pod \"kube-apiserver-proxy-ip-10-0-142-235.ec2.internal\" (UID: \"2b2e1ee019fd15bef55bf7af42a95521\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.210331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.137180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86cbaaa3e1e3df5da4859be7e4292c8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal\" (UID: \"86cbaaa3e1e3df5da4859be7e4292c8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.467491 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.226023    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.467491 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.276219    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.467491 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.279616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:01.467491 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.326799    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.467491 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.431084    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.714148 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.533706    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.714148 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.634255    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.714148 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.663229    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 23:57:01.714148 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.663369    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.735435    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.751873    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 23:52:01 +0000 UTC" deadline="2027-12-17 10:03:48.504006362 +0000 UTC"
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.751898    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12562h6m46.752111189s"
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.835839    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.927984    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:01.934645    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2e1ee019fd15bef55bf7af42a95521.slice/crio-597f1fcc470a8f720a43963214c084c47b604e45f8feffdd9f38e050020948c1 WatchSource:0}: Error finding container 597f1fcc470a8f720a43963214c084c47b604e45f8feffdd9f38e050020948c1: Status 404 returned error can't find the container with id 597f1fcc470a8f720a43963214c084c47b604e45f8feffdd9f38e050020948c1
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:01.936869    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-235.ec2.internal\" not found"
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.940459    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 23:57:01.954159 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:01.947711    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86cbaaa3e1e3df5da4859be7e4292c8f.slice/crio-aaa9895ed14cd77ffafb215ab58f6ee7e9c3f6b0d359eacc70ed77173ad9c8e6 WatchSource:0}: Error finding container aaa9895ed14cd77ffafb215ab58f6ee7e9c3f6b0d359eacc70ed77173ad9c8e6: Status 404 returned error can't find the container with id aaa9895ed14cd77ffafb215ab58f6ee7e9c3f6b0d359eacc70ed77173ad9c8e6
Jul 11 23:57:01.961457 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:01.959532    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:57:02.036624 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.036537    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:02.048352 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.048331    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 23:57:02.050210 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.050197    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal"
Jul 11 23:57:02.058907 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.058891    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 23:57:02.241130 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.241102    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:57:02.714095 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.714063    2582 apiserver.go:52] "Watching apiserver"
Jul 11 23:57:02.727651 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.727623    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:57:02.728290 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.728145    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 23:57:02.728914 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.728889    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv","openshift-dns/node-resolver-qlnjg","openshift-multus/multus-additional-cni-plugins-zksrc","openshift-multus/multus-dr5r4","openshift-multus/network-metrics-daemon-hc6sz","openshift-network-operator/iptables-alerter-cgbgz","kube-system/konnectivity-agent-ddv5c","openshift-cluster-node-tuning-operator/tuned-ldpcf","openshift-image-registry/node-ca-5g8rm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal","openshift-network-diagnostics/network-check-target-cncg9","openshift-ovn-kubernetes/ovnkube-node-nj7sw","kube-system/global-pull-secret-syncer-vf5b8"]
Jul 11 23:57:02.731831 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.731801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.734246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.734224    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 23:57:02.734519 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.734404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.734954 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.734938    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 23:57:02.735077 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.734942    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 23:57:02.735149 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.735138    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqlrj\""
Jul 11 23:57:02.735213 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.735063    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:02.736634 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.736582    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 23:57:02.737614 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.736746    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 23:57:02.737614 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.736918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.737614 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.737211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 23:57:02.737614 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.737408    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 23:57:02.737614 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.737483    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 23:57:02.738004 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.737991    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lz5t4\""
Jul 11 23:57:02.739053 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.739030    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 23:57:02.739577 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.739489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.739577 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.739564    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mkwd\""
Jul 11 23:57:02.739830 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.739815    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 23:57:02.740104 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.740086    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 23:57:02.742000 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.741978    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.742826 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.742594    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 23:57:02.742826 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.742640    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 23:57:02.742826 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.742691    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 23:57:02.742826 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.742708    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 23:57:02.742826 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.742691    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv9tn\""
Jul 11 23:57:02.743142 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.742865    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 23:57:02.744852 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.744450    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 23:57:02.744852 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.744613    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dv9nd\""
Jul 11 23:57:02.744852 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.744635    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:02.744852 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.744705    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:02.748122 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.747330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.748122 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.747924    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 23:57:02.748628 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-var-lib-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748711 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-log-socket\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748711 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-cni-bin\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748711 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748957 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/863f34e0-5c02-43b7-90fa-97e1e421686e-ovn-node-metrics-cert\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748957 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-systemd-units\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748957 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-ovnkube-script-lib\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748957 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8287\" (UniqueName: \"kubernetes.io/projected/7b83ba01-05cb-4bdb-9b20-58a26f39f174-kube-api-access-j8287\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.748957 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-etc-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.748957 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-cni-netd\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.749274 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.748867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-ovnkube-config\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.749373 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.749293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b83ba01-05cb-4bdb-9b20-58a26f39f174-host-slash\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.749515 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.749422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-kubelet\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750004 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.749722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-systemd\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750004 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.749762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-env-overrides\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750171 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750053    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:02.750171 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750074    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q7gl5\""
Jul 11 23:57:02.750295 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.749786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255afcde-e23e-42ef-8761-801ee1c5ce59-tmp-dir\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.750419 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750310    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 23:57:02.750419 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-node-log\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750419 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750419 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/255afcde-e23e-42ef-8761-801ee1c5ce59-hosts-file\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.750419 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-ovn\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750697 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-slash\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750697 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbcq\" (UniqueName: \"kubernetes.io/projected/863f34e0-5c02-43b7-90fa-97e1e421686e-kube-api-access-kpbcq\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750697 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750533    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6lpd\" (UniqueName: \"kubernetes.io/projected/255afcde-e23e-42ef-8761-801ee1c5ce59-kube-api-access-z6lpd\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.750697 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.750697 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b83ba01-05cb-4bdb-9b20-58a26f39f174-iptables-alerter-script\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.750697 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.750644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-run-netns\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.751818 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.751750    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.751923 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.751847    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:02.754585 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.754560    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.758024 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.756929    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 23:57:02.758024 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.757220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.758024 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.757677    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 23:57:02.758024 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.757734    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 23:57:02.758024 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.757944    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bcljm\""
Jul 11 23:57:02.759941 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.759919    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:02.760109 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.760086    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 23:57:02.760336 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.760293    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 23:57:02.760427 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.760353    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 23:57:02.760493 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.760431    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-crkvg\""
Jul 11 23:57:02.762504 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.762461    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 23:57:02.762504 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.762492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:02.762665 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.762568    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:02.762758 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.762738    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wm9tk\""
Jul 11 23:57:02.765651 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.765061    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 23:57:02.772073 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.772041    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-299fw"
Jul 11 23:57:02.777537 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.777517    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-299fw"
Jul 11 23:57:02.835665 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.835645    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 23:57:02.844374 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.844321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal" event={"ID":"86cbaaa3e1e3df5da4859be7e4292c8f","Type":"ContainerStarted","Data":"aaa9895ed14cd77ffafb215ab58f6ee7e9c3f6b0d359eacc70ed77173ad9c8e6"}
Jul 11 23:57:02.845854 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.845828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal" event={"ID":"2b2e1ee019fd15bef55bf7af42a95521","Type":"ContainerStarted","Data":"597f1fcc470a8f720a43963214c084c47b604e45f8feffdd9f38e050020948c1"}
Jul 11 23:57:02.851095 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-conf-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.851193 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-cni-bin\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851193 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdghb\" (UniqueName: \"kubernetes.io/projected/be27a7fc-8795-4c3c-a16c-0b26d71af511-kube-api-access-zdghb\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.851333 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-multus-certs\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.851333 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-cni-bin\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851333 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysconfig\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.851333 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.851333 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-systemd-units\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-ovnkube-script-lib\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64077adb-8560-4a1b-960b-1bf489fe70e7-agent-certs\") pod \"konnectivity-agent-ddv5c\" (UID: \"64077adb-8560-4a1b-960b-1bf489fe70e7\") " pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-daemon-config\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-modprobe-d\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-systemd-units\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-var-lib-kubelet\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-tmp\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.851549 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8287\" (UniqueName: \"kubernetes.io/projected/7b83ba01-05cb-4bdb-9b20-58a26f39f174-kube-api-access-j8287\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgjhq\" (UniqueName: \"kubernetes.io/projected/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-kube-api-access-lgjhq\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-systemd\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-env-overrides\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255afcde-e23e-42ef-8761-801ee1c5ce59-tmp-dir\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-system-cni-dir\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-k8s-cni-cncf-io\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-systemd\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-node-log\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e5d059f-a82f-42a4-8cac-4b9da4527629-host\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64077adb-8560-4a1b-960b-1bf489fe70e7-konnectivity-ca\") pod \"konnectivity-agent-ddv5c\" (UID: \"64077adb-8560-4a1b-960b-1bf489fe70e7\") " pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851920    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-node-log\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.851982 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-hostroot\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.851985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-ovn\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-ovn\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp85f\" (UniqueName: \"kubernetes.io/projected/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-kube-api-access-lp85f\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-slash\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852106    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-etc-kubernetes\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-sys\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-slash\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b83ba01-05cb-4bdb-9b20-58a26f39f174-iptables-alerter-script\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-kubernetes\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255afcde-e23e-42ef-8761-801ee1c5ce59-tmp-dir\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.852677 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-run\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852230    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-run-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-kubelet-config\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-run-netns\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-env-overrides\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-var-lib-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-log-socket\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-run-netns\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/863f34e0-5c02-43b7-90fa-97e1e421686e-ovn-node-metrics-cert\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852420    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-log-socket\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-cni-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-os-release\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysctl-conf\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.853319 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-var-lib-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-lib-modules\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-tuned\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-etc-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-cni-netd\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-etc-openvswitch\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-ovnkube-config\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e5d059f-a82f-42a4-8cac-4b9da4527629-serviceca\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-cnibin\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-cni-bin\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-ovnkube-script-lib\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysctl-d\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.853962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-cni-netd\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b83ba01-05cb-4bdb-9b20-58a26f39f174-host-slash\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852890    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b83ba01-05cb-4bdb-9b20-58a26f39f174-iptables-alerter-script\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-kubelet\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852972    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-os-release\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.852995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b83ba01-05cb-4bdb-9b20-58a26f39f174-host-slash\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-netns\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-kubelet\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmt8c\" (UniqueName: \"kubernetes.io/projected/0753b88d-a323-48d7-9527-45ce5b216f9f-kube-api-access-rmt8c\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-systemd\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.854631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/255afcde-e23e-42ef-8761-801ee1c5ce59-hosts-file\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863f34e0-5c02-43b7-90fa-97e1e421686e-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/255afcde-e23e-42ef-8761-801ee1c5ce59-hosts-file\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-device-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-cnibin\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89nzt\" (UniqueName: \"kubernetes.io/projected/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-kube-api-access-89nzt\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-socket-dir-parent\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-system-cni-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-cni-multus\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-host\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-dbus\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.855366 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbcq\" (UniqueName: \"kubernetes.io/projected/863f34e0-5c02-43b7-90fa-97e1e421686e-kube-api-access-kpbcq\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.856085 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6lpd\" (UniqueName: \"kubernetes.io/projected/255afcde-e23e-42ef-8761-801ee1c5ce59-kube-api-access-z6lpd\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.856085 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwhb\" (UniqueName: \"kubernetes.io/projected/8e5d059f-a82f-42a4-8cac-4b9da4527629-kube-api-access-sdwhb\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.856085 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0753b88d-a323-48d7-9527-45ce5b216f9f-cni-binary-copy\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.856085 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-kubelet\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.856085 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-cni-binary-copy\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.856085 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.853684    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/863f34e0-5c02-43b7-90fa-97e1e421686e-ovnkube-config\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.857250 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.857225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/863f34e0-5c02-43b7-90fa-97e1e421686e-ovn-node-metrics-cert\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.861188 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.861163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8287\" (UniqueName: \"kubernetes.io/projected/7b83ba01-05cb-4bdb-9b20-58a26f39f174-kube-api-access-j8287\") pod \"iptables-alerter-cgbgz\" (UID: \"7b83ba01-05cb-4bdb-9b20-58a26f39f174\") " pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:02.869199 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.869159    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbcq\" (UniqueName: \"kubernetes.io/projected/863f34e0-5c02-43b7-90fa-97e1e421686e-kube-api-access-kpbcq\") pod \"ovnkube-node-nj7sw\" (UID: \"863f34e0-5c02-43b7-90fa-97e1e421686e\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:02.870749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.870730    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6lpd\" (UniqueName: \"kubernetes.io/projected/255afcde-e23e-42ef-8761-801ee1c5ce59-kube-api-access-z6lpd\") pod \"node-resolver-qlnjg\" (UID: \"255afcde-e23e-42ef-8761-801ee1c5ce59\") " pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:02.954012 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.953979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-multus-certs\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.954012 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysconfig\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64077adb-8560-4a1b-960b-1bf489fe70e7-agent-certs\") pod \"konnectivity-agent-ddv5c\" (UID: \"64077adb-8560-4a1b-960b-1bf489fe70e7\") " pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-daemon-config\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-modprobe-d\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954107    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-var-lib-kubelet\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-tmp\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954155    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysconfig\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954233    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-multus-certs\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954272    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-var-lib-kubelet\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954291    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-modprobe-d\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954327 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.954322    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.954409    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret podName:cbc41fd4-ede0-4f04-8fdd-198613cee7a3 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:03.454382729 +0000 UTC m=+3.083490237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret") pod "global-pull-secret-syncer-vf5b8" (UID: "cbc41fd4-ede0-4f04-8fdd-198613cee7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgjhq\" (UniqueName: \"kubernetes.io/projected/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-kube-api-access-lgjhq\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-system-cni-dir\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-k8s-cni-cncf-io\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e5d059f-a82f-42a4-8cac-4b9da4527629-host\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64077adb-8560-4a1b-960b-1bf489fe70e7-konnectivity-ca\") pod \"konnectivity-agent-ddv5c\" (UID: \"64077adb-8560-4a1b-960b-1bf489fe70e7\") " pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-hostroot\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp85f\" (UniqueName: \"kubernetes.io/projected/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-kube-api-access-lp85f\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-etc-kubernetes\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-sys\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.954862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-daemon-config\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-kubernetes\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.954962    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-system-cni-dir\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-k8s-cni-cncf-io\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.954969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-run\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-hostroot\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-etc-kubernetes\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.955023    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs podName:77da7a05-68dd-4f37-a0ef-70bc4b3904dc nodeName:}" failed. No retries permitted until 2026-07-11 23:57:03.455004424 +0000 UTC m=+3.084111931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs") pod "network-metrics-daemon-hc6sz" (UID: "77da7a05-68dd-4f37-a0ef-70bc4b3904dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e5d059f-a82f-42a4-8cac-4b9da4527629-host\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-kubelet-config\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.955507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-sys\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-cni-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-os-release\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955141    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-kubelet-config\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysctl-conf\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-lib-modules\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-run\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-os-release\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-tuned\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-cni-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955320    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-lib-modules\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysctl-conf\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e5d059f-a82f-42a4-8cac-4b9da4527629-serviceca\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.956245 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-cnibin\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-cni-bin\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-cnibin\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysctl-d\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955461    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-kubernetes\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64077adb-8560-4a1b-960b-1bf489fe70e7-konnectivity-ca\") pod \"konnectivity-agent-ddv5c\" (UID: \"64077adb-8560-4a1b-960b-1bf489fe70e7\") " pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-os-release\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-netns\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmt8c\" (UniqueName: \"kubernetes.io/projected/0753b88d-a323-48d7-9527-45ce5b216f9f-kube-api-access-rmt8c\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-systemd\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-sysctl-d\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957031 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-device-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955649    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be27a7fc-8795-4c3c-a16c-0b26d71af511-os-release\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955510    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-cni-bin\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955707    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-systemd\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-cnibin\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955830    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-cnibin\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e5d059f-a82f-42a4-8cac-4b9da4527629-serviceca\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-run-netns\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89nzt\" (UniqueName: \"kubernetes.io/projected/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-kube-api-access-89nzt\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.957749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-device-dir\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.955999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-socket-dir-parent\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-system-cni-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-socket-dir-parent\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-cni-multus\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-system-cni-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-host\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-cni-multus\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-dbus\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdwhb\" (UniqueName: \"kubernetes.io/projected/8e5d059f-a82f-42a4-8cac-4b9da4527629-kube-api-access-sdwhb\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0753b88d-a323-48d7-9527-45ce5b216f9f-cni-binary-copy\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-kubelet\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-dbus\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956293    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-host\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.958558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-cni-binary-copy\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-conf-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdghb\" (UniqueName: \"kubernetes.io/projected/be27a7fc-8795-4c3c-a16c-0b26d71af511-kube-api-access-zdghb\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-multus-conf-dir\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956707    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0753b88d-a323-48d7-9527-45ce5b216f9f-host-var-lib-kubelet\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.956934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0753b88d-a323-48d7-9527-45ce5b216f9f-cni-binary-copy\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.957021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be27a7fc-8795-4c3c-a16c-0b26d71af511-cni-binary-copy\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.957157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-tmp\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.958071    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64077adb-8560-4a1b-960b-1bf489fe70e7-agent-certs\") pod \"konnectivity-agent-ddv5c\" (UID: \"64077adb-8560-4a1b-960b-1bf489fe70e7\") " pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:02.959337 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.958071    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-etc-tuned\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:02.961544 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.961516    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:02.961544 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.961537    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:02.961694 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.961552    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mj6nx for pod openshift-network-diagnostics/network-check-target-cncg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:02.961694 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:02.961626    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx podName:a4a97b28-ac43-48fb-8a1c-b668fd9371e4 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:03.461610976 +0000 UTC m=+3.090718496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mj6nx" (UniqueName: "kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx") pod "network-check-target-cncg9" (UID: "a4a97b28-ac43-48fb-8a1c-b668fd9371e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:02.963882 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.963854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp85f\" (UniqueName: \"kubernetes.io/projected/4ed74c35-70ef-403f-bf56-d34a4ed34bd8-kube-api-access-lp85f\") pod \"aws-ebs-csi-driver-node-znzpv\" (UID: \"4ed74c35-70ef-403f-bf56-d34a4ed34bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:02.965457 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.965300    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgjhq\" (UniqueName: \"kubernetes.io/projected/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-kube-api-access-lgjhq\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:02.965457 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.965369    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdwhb\" (UniqueName: \"kubernetes.io/projected/8e5d059f-a82f-42a4-8cac-4b9da4527629-kube-api-access-sdwhb\") pod \"node-ca-5g8rm\" (UID: \"8e5d059f-a82f-42a4-8cac-4b9da4527629\") " pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:02.965457 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.965426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdghb\" (UniqueName: \"kubernetes.io/projected/be27a7fc-8795-4c3c-a16c-0b26d71af511-kube-api-access-zdghb\") pod \"multus-additional-cni-plugins-zksrc\" (UID: \"be27a7fc-8795-4c3c-a16c-0b26d71af511\") " pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:02.966204 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.966182    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmt8c\" (UniqueName: \"kubernetes.io/projected/0753b88d-a323-48d7-9527-45ce5b216f9f-kube-api-access-rmt8c\") pod \"multus-dr5r4\" (UID: \"0753b88d-a323-48d7-9527-45ce5b216f9f\") " pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:02.966351 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:02.966330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89nzt\" (UniqueName: \"kubernetes.io/projected/af09fae1-ce03-4d4f-bfd9-f1a65e061c02-kube-api-access-89nzt\") pod \"tuned-ldpcf\" (UID: \"af09fae1-ce03-4d4f-bfd9-f1a65e061c02\") " pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:03.053880 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.053848    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgbgz"
Jul 11 23:57:03.062612 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.062590    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qlnjg"
Jul 11 23:57:03.071570 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.071547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:03.079519 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.079496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zksrc"
Jul 11 23:57:03.086442 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.086417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dr5r4"
Jul 11 23:57:03.095210 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.095192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ldpcf"
Jul 11 23:57:03.103019 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.103001    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv"
Jul 11 23:57:03.111662 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.111643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5g8rm"
Jul 11 23:57:03.116540 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.116516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:03.459858 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.459763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:03.459858 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.459843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:03.460069 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.459959    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:03.460069 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.460025    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs podName:77da7a05-68dd-4f37-a0ef-70bc4b3904dc nodeName:}" failed. No retries permitted until 2026-07-11 23:57:04.460007279 +0000 UTC m=+4.089114789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs") pod "network-metrics-daemon-hc6sz" (UID: "77da7a05-68dd-4f37-a0ef-70bc4b3904dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:03.460069 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.459959    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:03.460230 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.460116    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret podName:cbc41fd4-ede0-4f04-8fdd-198613cee7a3 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:04.460099061 +0000 UTC m=+4.089206571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret") pod "global-pull-secret-syncer-vf5b8" (UID: "cbc41fd4-ede0-4f04-8fdd-198613cee7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:03.560539 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.560501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:03.560717 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.560692    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:03.560717 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.560716    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:03.560863 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.560727    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mj6nx for pod openshift-network-diagnostics/network-check-target-cncg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:03.560863 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:03.560793    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx podName:a4a97b28-ac43-48fb-8a1c-b668fd9371e4 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:04.560775393 +0000 UTC m=+4.189882906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mj6nx" (UniqueName: "kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx") pod "network-check-target-cncg9" (UID: "a4a97b28-ac43-48fb-8a1c-b668fd9371e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:03.780553 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.780464    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 23:52:03 +0000 UTC" deadline="2028-03-05 06:19:09.746346323 +0000 UTC"
Jul 11 23:57:03.780553 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:03.780497    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14454h22m5.965854041s"
Jul 11 23:57:03.982478 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.982447    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5d059f_a82f_42a4_8cac_4b9da4527629.slice/crio-95c8c093812a1b7150ac5974a5aef64a65cae8109cde165c9a3c489dfbd2023a WatchSource:0}: Error finding container 95c8c093812a1b7150ac5974a5aef64a65cae8109cde165c9a3c489dfbd2023a: Status 404 returned error can't find the container with id 95c8c093812a1b7150ac5974a5aef64a65cae8109cde165c9a3c489dfbd2023a
Jul 11 23:57:03.990615 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.990292    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0753b88d_a323_48d7_9527_45ce5b216f9f.slice/crio-461378aac37ee6c8ddf471d92f380d70f14b2e83f5489ba8f6f400f5b5e58111 WatchSource:0}: Error finding container 461378aac37ee6c8ddf471d92f380d70f14b2e83f5489ba8f6f400f5b5e58111: Status 404 returned error can't find the container with id 461378aac37ee6c8ddf471d92f380d70f14b2e83f5489ba8f6f400f5b5e58111
Jul 11 23:57:03.990998 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.990974    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863f34e0_5c02_43b7_90fa_97e1e421686e.slice/crio-74d9ec77590441749f27c6ffdca463709e6f22ecbf64edd9a21fff27cbec8f62 WatchSource:0}: Error finding container 74d9ec77590441749f27c6ffdca463709e6f22ecbf64edd9a21fff27cbec8f62: Status 404 returned error can't find the container with id 74d9ec77590441749f27c6ffdca463709e6f22ecbf64edd9a21fff27cbec8f62
Jul 11 23:57:03.992421 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.992191    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf09fae1_ce03_4d4f_bfd9_f1a65e061c02.slice/crio-3ed8395b6bad1c3a2ba44b56747f946433d9cc2657f520f4c6b54c875cd8c1dc WatchSource:0}: Error finding container 3ed8395b6bad1c3a2ba44b56747f946433d9cc2657f520f4c6b54c875cd8c1dc: Status 404 returned error can't find the container with id 3ed8395b6bad1c3a2ba44b56747f946433d9cc2657f520f4c6b54c875cd8c1dc
Jul 11 23:57:03.992944 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.992899    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64077adb_8560_4a1b_960b_1bf489fe70e7.slice/crio-ed74a1cbcf21a0cca4ad404abacd222599dd8793c73be391245ef2c0204d6a54 WatchSource:0}: Error finding container ed74a1cbcf21a0cca4ad404abacd222599dd8793c73be391245ef2c0204d6a54: Status 404 returned error can't find the container with id ed74a1cbcf21a0cca4ad404abacd222599dd8793c73be391245ef2c0204d6a54
Jul 11 23:57:03.995182 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.995160    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed74c35_70ef_403f_bf56_d34a4ed34bd8.slice/crio-cc80bce67d9ae8ed815545015215863fd22b222c580f29bd6a02bd6ebb7e0f34 WatchSource:0}: Error finding container cc80bce67d9ae8ed815545015215863fd22b222c580f29bd6a02bd6ebb7e0f34: Status 404 returned error can't find the container with id cc80bce67d9ae8ed815545015215863fd22b222c580f29bd6a02bd6ebb7e0f34
Jul 11 23:57:03.995972 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.995939    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe27a7fc_8795_4c3c_a16c_0b26d71af511.slice/crio-ddb5a692e00f61917a0ef949096fcbc15cfb368f855f39ea73c6fdff18d8e543 WatchSource:0}: Error finding container ddb5a692e00f61917a0ef949096fcbc15cfb368f855f39ea73c6fdff18d8e543: Status 404 returned error can't find the container with id ddb5a692e00f61917a0ef949096fcbc15cfb368f855f39ea73c6fdff18d8e543
Jul 11 23:57:03.997016 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:03.996989    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b83ba01_05cb_4bdb_9b20_58a26f39f174.slice/crio-6ab79a5255586d550a938236e7f46215ee06ecfca4f6e14ae2a5eeeb936a098e WatchSource:0}: Error finding container 6ab79a5255586d550a938236e7f46215ee06ecfca4f6e14ae2a5eeeb936a098e: Status 404 returned error can't find the container with id 6ab79a5255586d550a938236e7f46215ee06ecfca4f6e14ae2a5eeeb936a098e
Jul 11 23:57:04.468591 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.468221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:04.468591 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.468574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:04.468823 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.468727    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:04.468823 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.468794    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs podName:77da7a05-68dd-4f37-a0ef-70bc4b3904dc nodeName:}" failed. No retries permitted until 2026-07-11 23:57:06.468773552 +0000 UTC m=+6.097881042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs") pod "network-metrics-daemon-hc6sz" (UID: "77da7a05-68dd-4f37-a0ef-70bc4b3904dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:04.469247 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.469226    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:04.469339 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.469284    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret podName:cbc41fd4-ede0-4f04-8fdd-198613cee7a3 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:06.469267899 +0000 UTC m=+6.098375392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret") pod "global-pull-secret-syncer-vf5b8" (UID: "cbc41fd4-ede0-4f04-8fdd-198613cee7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:04.570558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.569825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:04.570558 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.570076    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:04.570558 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.570098    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:04.570558 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.570112    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mj6nx for pod openshift-network-diagnostics/network-check-target-cncg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:04.570558 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.570177    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx podName:a4a97b28-ac43-48fb-8a1c-b668fd9371e4 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:06.570159634 +0000 UTC m=+6.199267144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mj6nx" (UniqueName: "kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx") pod "network-check-target-cncg9" (UID: "a4a97b28-ac43-48fb-8a1c-b668fd9371e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:04.782801 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.780922    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 23:52:03 +0000 UTC" deadline="2028-02-27 07:02:37.430017745 +0000 UTC"
Jul 11 23:57:04.782801 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.780984    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14287h5m32.649038224s"
Jul 11 23:57:04.840885 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.840295    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:04.840885 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.840348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:04.840885 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.840299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:04.840885 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.840472    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:04.840885 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.840546    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:04.840885 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:04.840627    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:04.858490 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.858456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal" event={"ID":"2b2e1ee019fd15bef55bf7af42a95521","Type":"ContainerStarted","Data":"177408bf14fcc031abfb9e851ed6b988e2d50bb8cb89cb5e4d1c9d83e2aa4b87"}
Jul 11 23:57:04.875730 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.875694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgbgz" event={"ID":"7b83ba01-05cb-4bdb-9b20-58a26f39f174","Type":"ContainerStarted","Data":"6ab79a5255586d550a938236e7f46215ee06ecfca4f6e14ae2a5eeeb936a098e"}
Jul 11 23:57:04.894099 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.894060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerStarted","Data":"ddb5a692e00f61917a0ef949096fcbc15cfb368f855f39ea73c6fdff18d8e543"}
Jul 11 23:57:04.903147 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.903075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ldpcf" event={"ID":"af09fae1-ce03-4d4f-bfd9-f1a65e061c02","Type":"ContainerStarted","Data":"3ed8395b6bad1c3a2ba44b56747f946433d9cc2657f520f4c6b54c875cd8c1dc"}
Jul 11 23:57:04.910084 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.910052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qlnjg" event={"ID":"255afcde-e23e-42ef-8761-801ee1c5ce59","Type":"ContainerStarted","Data":"16415cf533d2b2728b039c508ef49310627a921f82d620f7dcd09776f038d1d0"}
Jul 11 23:57:04.919627 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.919596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5g8rm" event={"ID":"8e5d059f-a82f-42a4-8cac-4b9da4527629","Type":"ContainerStarted","Data":"95c8c093812a1b7150ac5974a5aef64a65cae8109cde165c9a3c489dfbd2023a"}
Jul 11 23:57:04.928474 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.928447    2582 generic.go:356] "Generic (PLEG): container finished" podID="86cbaaa3e1e3df5da4859be7e4292c8f" containerID="e51e74998636ef894b8895a06286e26b81add11c2a46a65bac11403ca5ab47e2" exitCode=0
Jul 11 23:57:04.928743 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.928718    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal" event={"ID":"86cbaaa3e1e3df5da4859be7e4292c8f","Type":"ContainerDied","Data":"e51e74998636ef894b8895a06286e26b81add11c2a46a65bac11403ca5ab47e2"}
Jul 11 23:57:04.943331 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.943245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv" event={"ID":"4ed74c35-70ef-403f-bf56-d34a4ed34bd8","Type":"ContainerStarted","Data":"cc80bce67d9ae8ed815545015215863fd22b222c580f29bd6a02bd6ebb7e0f34"}
Jul 11 23:57:04.945706 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.945019    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-235.ec2.internal" podStartSLOduration=2.9450016740000002 podStartE2EDuration="2.945001674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:04.87307559 +0000 UTC m=+4.502183124" watchObservedRunningTime="2026-07-11 23:57:04.945001674 +0000 UTC m=+4.574109188"
Jul 11 23:57:04.958797 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.958764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ddv5c" event={"ID":"64077adb-8560-4a1b-960b-1bf489fe70e7","Type":"ContainerStarted","Data":"ed74a1cbcf21a0cca4ad404abacd222599dd8793c73be391245ef2c0204d6a54"}
Jul 11 23:57:04.967252 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.967223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"74d9ec77590441749f27c6ffdca463709e6f22ecbf64edd9a21fff27cbec8f62"}
Jul 11 23:57:04.977079 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:04.977013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dr5r4" event={"ID":"0753b88d-a323-48d7-9527-45ce5b216f9f","Type":"ContainerStarted","Data":"461378aac37ee6c8ddf471d92f380d70f14b2e83f5489ba8f6f400f5b5e58111"}
Jul 11 23:57:05.999999 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:05.999511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal" event={"ID":"86cbaaa3e1e3df5da4859be7e4292c8f","Type":"ContainerStarted","Data":"7a259d7618034930b7bda9dfa016a49eaceb7cb081803cfee0c303572740660e"}
Jul 11 23:57:06.486900 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:06.486797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:06.486900 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:06.486886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:06.487194 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.487041    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:06.487194 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.487111    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret podName:cbc41fd4-ede0-4f04-8fdd-198613cee7a3 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:10.487090766 +0000 UTC m=+10.116198260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret") pod "global-pull-secret-syncer-vf5b8" (UID: "cbc41fd4-ede0-4f04-8fdd-198613cee7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:06.487567 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.487544    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:06.487696 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.487604    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs podName:77da7a05-68dd-4f37-a0ef-70bc4b3904dc nodeName:}" failed. No retries permitted until 2026-07-11 23:57:10.487587574 +0000 UTC m=+10.116695069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs") pod "network-metrics-daemon-hc6sz" (UID: "77da7a05-68dd-4f37-a0ef-70bc4b3904dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:06.587558 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:06.587519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:06.587743 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.587725    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:06.587808 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.587752    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:06.587808 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.587766    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mj6nx for pod openshift-network-diagnostics/network-check-target-cncg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:06.587953 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.587851    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx podName:a4a97b28-ac43-48fb-8a1c-b668fd9371e4 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:10.587830251 +0000 UTC m=+10.216937759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mj6nx" (UniqueName: "kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx") pod "network-check-target-cncg9" (UID: "a4a97b28-ac43-48fb-8a1c-b668fd9371e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:06.840729 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:06.839947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:06.840729 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.840072    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:06.840729 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:06.840473    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:06.840729 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.840586    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:06.841370 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:06.841148    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:06.841370 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:06.841292    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:08.839714 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:08.839247    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:08.839714 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:08.839252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:08.839714 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:08.839360    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:08.839714 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:08.839422    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:08.839714 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:08.839532    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:08.839714 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:08.839605    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:10.522637 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:10.522593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:10.523142 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:10.522673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:10.523142 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.522810    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:10.523142 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.522826    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:10.523142 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.522886    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs podName:77da7a05-68dd-4f37-a0ef-70bc4b3904dc nodeName:}" failed. No retries permitted until 2026-07-11 23:57:18.522865481 +0000 UTC m=+18.151972987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs") pod "network-metrics-daemon-hc6sz" (UID: "77da7a05-68dd-4f37-a0ef-70bc4b3904dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:10.523142 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.522905    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret podName:cbc41fd4-ede0-4f04-8fdd-198613cee7a3 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:18.522895319 +0000 UTC m=+18.152002809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret") pod "global-pull-secret-syncer-vf5b8" (UID: "cbc41fd4-ede0-4f04-8fdd-198613cee7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:10.623727 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:10.623677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:10.623936 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.623907    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:10.623936 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.623932    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:10.624059 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.623946    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mj6nx for pod openshift-network-diagnostics/network-check-target-cncg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:10.624111 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.624056    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx podName:a4a97b28-ac43-48fb-8a1c-b668fd9371e4 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:18.624031197 +0000 UTC m=+18.253138704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mj6nx" (UniqueName: "kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx") pod "network-check-target-cncg9" (UID: "a4a97b28-ac43-48fb-8a1c-b668fd9371e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:10.839893 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:10.839791    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:10.840062 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.839939    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:10.840062 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:10.839962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:10.840062 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.840037    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:10.840233 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:10.840074    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:10.840233 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:10.840138    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:12.839427 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:12.839345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:12.839858 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:12.839345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:12.839858 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:12.839479    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:12.839858 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:12.839546    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:12.839858 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:12.839357    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:12.839858 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:12.839605    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:14.839427 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:14.839341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:14.839427 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:14.839353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:14.839989 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:14.839487    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:14.839989 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:14.839521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:14.839989 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:14.839604    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:14.839989 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:14.839665    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:16.839515 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:16.839467    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:16.839515 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:16.839489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:16.840032 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:16.839590    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:16.840032 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:16.839597    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:16.840032 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:16.839666    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:16.840032 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:16.839773    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:18.583039 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:18.583002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:18.583560 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:18.583064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:18.583560 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.583165    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:18.583560 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.583170    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:18.583560 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.583221    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret podName:cbc41fd4-ede0-4f04-8fdd-198613cee7a3 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:34.583204734 +0000 UTC m=+34.212312245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret") pod "global-pull-secret-syncer-vf5b8" (UID: "cbc41fd4-ede0-4f04-8fdd-198613cee7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:18.583560 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.583238    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs podName:77da7a05-68dd-4f37-a0ef-70bc4b3904dc nodeName:}" failed. No retries permitted until 2026-07-11 23:57:34.58322887 +0000 UTC m=+34.212336358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs") pod "network-metrics-daemon-hc6sz" (UID: "77da7a05-68dd-4f37-a0ef-70bc4b3904dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:18.684354 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:18.684320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:18.684534 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.684480    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:18.684534 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.684505    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:18.684534 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.684518    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mj6nx for pod openshift-network-diagnostics/network-check-target-cncg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:18.684702 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.684575    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx podName:a4a97b28-ac43-48fb-8a1c-b668fd9371e4 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:34.684556114 +0000 UTC m=+34.313663604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mj6nx" (UniqueName: "kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx") pod "network-check-target-cncg9" (UID: "a4a97b28-ac43-48fb-8a1c-b668fd9371e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:18.839454 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:18.839388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:18.839454 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:18.839406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:18.839604 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.839507    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:18.839604 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:18.839552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:18.839701 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.839613    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:18.839777 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:18.839710    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:20.839855 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:20.839822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:20.840298 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:20.839923    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:20.840298 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:20.840002    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:20.840523 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:20.840486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:20.840643 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:20.840622    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:20.840974 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:20.840940    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:22.839519 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:22.839490    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:22.840010 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:22.839490    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:22.840010 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:22.839588    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:22.840010 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:22.839490    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:22.840010 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:22.839677    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:22.840010 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:22.839753    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:24.038144 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.037751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"865336a365878edfc6cb4895a7fddd2190f13361a807d3cd3bb496bc99ab64a4"}
Jul 11 23:57:24.038956 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.038242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"dc3f7ed7a04554650d358bb45d505e94731304186816ab15b817bbb2db0f3520"}
Jul 11 23:57:24.038956 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.038288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"8c63a327b3678163b70681ce7c43f8e13567dfee12ba5d7a2461749b1e6d5d08"}
Jul 11 23:57:24.038956 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.038330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"5124c6b0edbcc0d3ca47a7d4f6690aecfc99369b976138d3f5c80937a5c1b3a1"}
Jul 11 23:57:24.038956 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.038366    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"6114bffe224a7229c2b077dc5b6adbba8dd400101deb9227d05c21a4be9315ce"}
Jul 11 23:57:24.038956 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.038411    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"d511a0b8ac98534784473446c82f0078f78d267d9cf1aaf3980e08782c2f1e05"}
Jul 11 23:57:24.039384 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.039356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dr5r4" event={"ID":"0753b88d-a323-48d7-9527-45ce5b216f9f","Type":"ContainerStarted","Data":"81c80b91a095dfc021330581154b6f991998ff523d583aaefa0336d347a44a86"}
Jul 11 23:57:24.041358 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.041331    2582 generic.go:356] "Generic (PLEG): container finished" podID="be27a7fc-8795-4c3c-a16c-0b26d71af511" containerID="fc42c49927371d43a94fffb0fa2b6359ccd9421c03c2c87e7280f367316769ec" exitCode=0
Jul 11 23:57:24.041446 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.041408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerDied","Data":"fc42c49927371d43a94fffb0fa2b6359ccd9421c03c2c87e7280f367316769ec"}
Jul 11 23:57:24.043093 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.042950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ldpcf" event={"ID":"af09fae1-ce03-4d4f-bfd9-f1a65e061c02","Type":"ContainerStarted","Data":"785f44d766f8da897b72e574896dc1251f4004b3016b8c349b434e9858535075"}
Jul 11 23:57:24.044391 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.044367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qlnjg" event={"ID":"255afcde-e23e-42ef-8761-801ee1c5ce59","Type":"ContainerStarted","Data":"90ffe08373f96426ba59278375603042863d74a27414d7db79a824af35f8e462"}
Jul 11 23:57:24.045729 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.045709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5g8rm" event={"ID":"8e5d059f-a82f-42a4-8cac-4b9da4527629","Type":"ContainerStarted","Data":"e0f6f063ff2eb40953d933a650e710c802ba62089aa8cd66bce9e6528e9a93f5"}
Jul 11 23:57:24.047053 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.047033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv" event={"ID":"4ed74c35-70ef-403f-bf56-d34a4ed34bd8","Type":"ContainerStarted","Data":"0da6763f741b896d16a8fee57497ac35632011af01738e35c34863cd0f3d07b4"}
Jul 11 23:57:24.048398 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.048381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ddv5c" event={"ID":"64077adb-8560-4a1b-960b-1bf489fe70e7","Type":"ContainerStarted","Data":"56c65c833ff6f8ff2656c320500c121e01206fb00eca789c2ca5c4e75117aa29"}
Jul 11 23:57:24.056004 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.055968    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dr5r4" podStartSLOduration=3.724017431 podStartE2EDuration="23.055958191s" totalImagesPullingTime="19.33194076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:24.055570276 +0000 UTC m=+23.684677787" watchObservedRunningTime="2026-07-11 23:57:24.055958191 +0000 UTC m=+23.685065701"
Jul 11 23:57:24.056229 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.056211    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-235.ec2.internal" podStartSLOduration=22.056208054 podStartE2EDuration="22.056208054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:06.017216405 +0000 UTC m=+5.646323921" watchObservedRunningTime="2026-07-11 23:57:24.056208054 +0000 UTC m=+23.685315565"
Jul 11 23:57:24.067820 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.067784    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qlnjg" podStartSLOduration=3.809746575 podStartE2EDuration="23.067743215s" totalImagesPullingTime="19.25799664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:24.067711354 +0000 UTC m=+23.696818864" watchObservedRunningTime="2026-07-11 23:57:24.067743215 +0000 UTC m=+23.696850729"
Jul 11 23:57:24.102052 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.102012    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ldpcf" podStartSLOduration=3.811314125 podStartE2EDuration="23.101999608s" totalImagesPullingTime="19.290685483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:24.101957338 +0000 UTC m=+23.731064845" watchObservedRunningTime="2026-07-11 23:57:24.101999608 +0000 UTC m=+23.731107118"
Jul 11 23:57:24.117678 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.117640    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5g8rm" podStartSLOduration=3.854708585 podStartE2EDuration="23.117628557s" totalImagesPullingTime="19.262919972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:24.117063057 +0000 UTC m=+23.746170566" watchObservedRunningTime="2026-07-11 23:57:24.117628557 +0000 UTC m=+23.746736434"
Jul 11 23:57:24.132712 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.132682    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ddv5c" podStartSLOduration=8.296853514 podStartE2EDuration="23.132672437s" totalImagesPullingTime="14.835818923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:24.132247779 +0000 UTC m=+23.761355291" watchObservedRunningTime="2026-07-11 23:57:24.132672437 +0000 UTC m=+23.761779947"
Jul 11 23:57:24.756445 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.756416    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 23:57:24.807776 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.807616    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T23:57:24.756439542Z","UUID":"20c20ae5-119f-41b1-9ebd-0c45a2f25673","Handler":null,"Name":"","Endpoint":""}
Jul 11 23:57:24.809658 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.809637    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 23:57:24.809812 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.809673    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 23:57:24.839423 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.839397    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:24.839423 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.839409    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:24.839626 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:24.839407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:24.839626 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:24.839523    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:24.839626 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:24.839574    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:24.839753 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:24.839684    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:25.052607 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:25.052572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgbgz" event={"ID":"7b83ba01-05cb-4bdb-9b20-58a26f39f174","Type":"ContainerStarted","Data":"0ecb630277809580001efd6e45cca0424e1c7c369d5b3d216a02d51672598ff6"}
Jul 11 23:57:25.054613 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:25.054584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv" event={"ID":"4ed74c35-70ef-403f-bf56-d34a4ed34bd8","Type":"ContainerStarted","Data":"39d680bd66659a37ffb80759d864c9717ea752d40c79961432f0263c6001569b"}
Jul 11 23:57:25.067307 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:25.067234    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cgbgz" podStartSLOduration=4.815370862 podStartE2EDuration="24.067219941s" totalImagesPullingTime="19.251849079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:25.067193508 +0000 UTC m=+24.696301224" watchObservedRunningTime="2026-07-11 23:57:25.067219941 +0000 UTC m=+24.696327441"
Jul 11 23:57:26.059068 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:26.059037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv" event={"ID":"4ed74c35-70ef-403f-bf56-d34a4ed34bd8","Type":"ContainerStarted","Data":"6bf975917be8ac39eeb5a636599a36f5f216dedd347a518638f0255030aae321"}
Jul 11 23:57:26.077158 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:26.077105    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzpv" podStartSLOduration=3.715631582 podStartE2EDuration="25.077084372s" totalImagesPullingTime="21.36145279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:26.076441915 +0000 UTC m=+25.705549449" watchObservedRunningTime="2026-07-11 23:57:26.077084372 +0000 UTC m=+25.706191884"
Jul 11 23:57:26.839348 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:26.839313    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:26.839348 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:26.839348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:26.839687 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:26.839318    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:26.839687 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:26.839432    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:26.839687 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:26.839518    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:26.839687 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:26.839626    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:26.894848 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:26.894817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:26.895465 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:26.895440    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:27.065285 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:27.065250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"ff1474f29941a789c2a7f69d4da193a22362d3ca41642909d983a07796b8662b"}
Jul 11 23:57:27.065734 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:27.065440    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:27.066000 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:27.065983    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ddv5c"
Jul 11 23:57:28.839163 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:28.838816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:28.839929 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:28.838816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:28.839929 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:28.839202    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:28.839929 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:28.838822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:28.839929 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:28.839257    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:28.839929 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:28.839314    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:29.073542 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.073504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" event={"ID":"863f34e0-5c02-43b7-90fa-97e1e421686e","Type":"ContainerStarted","Data":"1b01a250922be6940627b8accc518345bda534cd436c0176bdb70a941083e076"}
Jul 11 23:57:29.073786 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.073748    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:29.074069 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.073836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:29.075749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.075720    2582 generic.go:356] "Generic (PLEG): container finished" podID="be27a7fc-8795-4c3c-a16c-0b26d71af511" containerID="f90f7df2ea1c18f6c679ef6e0701bf64a76343b461771a5bbddbcf98c66b4241" exitCode=0
Jul 11 23:57:29.075860 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.075788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerDied","Data":"f90f7df2ea1c18f6c679ef6e0701bf64a76343b461771a5bbddbcf98c66b4241"}
Jul 11 23:57:29.089722 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.089653    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:29.101564 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.101528    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw" podStartSLOduration=8.773795917 podStartE2EDuration="28.101517003s" totalImagesPullingTime="19.327721086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:29.09973188 +0000 UTC m=+28.728839410" watchObservedRunningTime="2026-07-11 23:57:29.101517003 +0000 UTC m=+28.730624512"
Jul 11 23:57:29.202627 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.202597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:29.286630 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:29.286602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:30.078445 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.078408    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:30.092845 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.092809    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:57:30.415876 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.415803    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hc6sz"]
Jul 11 23:57:30.416028 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.415985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:30.416124 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:30.416102    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:30.417080 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.417059    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cncg9"]
Jul 11 23:57:30.417189 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.417147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:30.417234 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:30.417218    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:30.426190 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.426166    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vf5b8"]
Jul 11 23:57:30.426297 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:30.426269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:30.426412 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:30.426386    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:31.082385 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:31.082351    2582 generic.go:356] "Generic (PLEG): container finished" podID="be27a7fc-8795-4c3c-a16c-0b26d71af511" containerID="243b1599ea01db6302554a5d81b5c2c05de80e8c11f4d135d26d53e420150fa5" exitCode=0
Jul 11 23:57:31.082820 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:31.082435    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerDied","Data":"243b1599ea01db6302554a5d81b5c2c05de80e8c11f4d135d26d53e420150fa5"}
Jul 11 23:57:31.838973 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:31.838945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:31.839134 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:31.839040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:31.839134 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:31.839045    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:31.839134 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:31.839067    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:31.839248 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:31.839146    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:31.839294 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:31.839268    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:32.087606 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:32.087580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerStarted","Data":"a6f120b51d29502adc8a613cd23f543c31873e1c8814b3ee73149167ce270b38"}
Jul 11 23:57:33.091643 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:33.091467    2582 generic.go:356] "Generic (PLEG): container finished" podID="be27a7fc-8795-4c3c-a16c-0b26d71af511" containerID="a6f120b51d29502adc8a613cd23f543c31873e1c8814b3ee73149167ce270b38" exitCode=0
Jul 11 23:57:33.092029 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:33.091549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerDied","Data":"a6f120b51d29502adc8a613cd23f543c31873e1c8814b3ee73149167ce270b38"}
Jul 11 23:57:33.648510 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:33.648478    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:33.839383 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:33.839353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:33.839544 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:33.839356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:33.839544 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:33.839491    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:33.839544 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:33.839367    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:33.839705 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:33.839563    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:33.839755 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:33.839699    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:34.278199 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:34.278156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:34.327092 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:34.327014    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:34.602985 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:34.602953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:34.603153 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:34.603010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:34.603153 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.603120    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:34.603248 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.603162    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:34.603248 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.603195    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret podName:cbc41fd4-ede0-4f04-8fdd-198613cee7a3 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:06.603175657 +0000 UTC m=+66.232283151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret") pod "global-pull-secret-syncer-vf5b8" (UID: "cbc41fd4-ede0-4f04-8fdd-198613cee7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:34.603248 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.603224    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs podName:77da7a05-68dd-4f37-a0ef-70bc4b3904dc nodeName:}" failed. No retries permitted until 2026-07-11 23:58:06.603206811 +0000 UTC m=+66.232314311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs") pod "network-metrics-daemon-hc6sz" (UID: "77da7a05-68dd-4f37-a0ef-70bc4b3904dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:34.703601 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:34.703565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:34.703793 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.703730    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:34.703793 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.703749    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:34.703793 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.703778    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mj6nx for pod openshift-network-diagnostics/network-check-target-cncg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:34.703935 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:34.703831    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx podName:a4a97b28-ac43-48fb-8a1c-b668fd9371e4 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:06.703814283 +0000 UTC m=+66.332921790 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mj6nx" (UniqueName: "kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx") pod "network-check-target-cncg9" (UID: "a4a97b28-ac43-48fb-8a1c-b668fd9371e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:35.839365 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:35.839330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:35.839365 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:35.839367    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:35.839924 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:35.839448    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vf5b8" podUID="cbc41fd4-ede0-4f04-8fdd-198613cee7a3"
Jul 11 23:57:35.839924 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:35.839504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:35.839924 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:35.839602    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cncg9" podUID="a4a97b28-ac43-48fb-8a1c-b668fd9371e4"
Jul 11 23:57:35.839924 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:35.839688    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc6sz" podUID="77da7a05-68dd-4f37-a0ef-70bc4b3904dc"
Jul 11 23:57:36.130966 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.130888    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-235.ec2.internal" event="NodeReady"
Jul 11 23:57:36.131115 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.131021    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 23:57:36.175500 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.174918    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zlt2q"]
Jul 11 23:57:36.177581 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.177558    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9lrsp"]
Jul 11 23:57:36.177714 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.177695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.179355 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.179331    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f78bbf55d-drps6"]
Jul 11 23:57:36.179495 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.179480    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.180694 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.180503    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 23:57:36.180694 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.180555    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 23:57:36.180694 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.180589    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xw7sj\""
Jul 11 23:57:36.180694 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.180602    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 23:57:36.181023 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.181003    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.182297 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.182270    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 23:57:36.182297 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.182296    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 23:57:36.182446 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.182276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pcsfw\""
Jul 11 23:57:36.184018 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.183996    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 11 23:57:36.184102 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.184084    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 11 23:57:36.184102 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.184093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 11 23:57:36.184233 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.184107    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl224\""
Jul 11 23:57:36.188257 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.187680    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlt2q"]
Jul 11 23:57:36.190577 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.190557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9lrsp"]
Jul 11 23:57:36.191488 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.191469    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 11 23:57:36.208980 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.208957    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f78bbf55d-drps6"]
Jul 11 23:57:36.316801 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.316752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghgc\" (UniqueName: \"kubernetes.io/projected/45c77aa9-e858-416e-a02b-5296ec29c02e-kube-api-access-lghgc\") pod \"ingress-canary-zlt2q\" (UID: \"45c77aa9-e858-416e-a02b-5296ec29c02e\") " pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.316997 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.316826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b9eba7-3853-43e8-9253-74b0c1202e84-config-volume\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.316997 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.316855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.316997 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.316932    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhj4\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-kube-api-access-tlhj4\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.316997 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.316952    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:36.316997 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.316965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.316997 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.316990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-ca-trust-extracted\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.317301 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317014    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b9eba7-3853-43e8-9253-74b0c1202e84-tmp-dir\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.317301 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c77aa9-e858-416e-a02b-5296ec29c02e-cert\") pod \"ingress-canary-zlt2q\" (UID: \"45c77aa9-e858-416e-a02b-5296ec29c02e\") " pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.317301 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317160    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-image-registry-private-configuration\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.317301 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-bound-sa-token\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.317301 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-trusted-ca\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.317301 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-installation-pull-secrets\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.317593 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-certificates\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.317593 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.317361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45n7\" (UniqueName: \"kubernetes.io/projected/d3b9eba7-3853-43e8-9253-74b0c1202e84-kube-api-access-c45n7\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.417897 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.417793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhj4\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-kube-api-access-tlhj4\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.417897 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.417840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.417897 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.417868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-ca-trust-extracted\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.417897 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.417896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b9eba7-3853-43e8-9253-74b0c1202e84-tmp-dir\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.417941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c77aa9-e858-416e-a02b-5296ec29c02e-cert\") pod \"ingress-canary-zlt2q\" (UID: \"45c77aa9-e858-416e-a02b-5296ec29c02e\") " pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.417968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-image-registry-private-configuration\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.417987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-bound-sa-token\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.417999    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.418021    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f78bbf55d-drps6: secret "image-registry-tls" not found
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.418110    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls podName:2e501cf8-92d5-4ce8-90d2-2dbdff7d2148 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.918088259 +0000 UTC m=+36.547195766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls") pod "image-registry-6f78bbf55d-drps6" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148") : secret "image-registry-tls" not found
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-trusted-ca\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-installation-pull-secrets\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.418328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-certificates\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.418824 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418366    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45n7\" (UniqueName: \"kubernetes.io/projected/d3b9eba7-3853-43e8-9253-74b0c1202e84-kube-api-access-c45n7\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.418824 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghgc\" (UniqueName: \"kubernetes.io/projected/45c77aa9-e858-416e-a02b-5296ec29c02e-kube-api-access-lghgc\") pod \"ingress-canary-zlt2q\" (UID: \"45c77aa9-e858-416e-a02b-5296ec29c02e\") " pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.418824 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b9eba7-3853-43e8-9253-74b0c1202e84-config-volume\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.418824 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.418824 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.418509    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-ca-trust-extracted\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.418824 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.418595    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:36.418824 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.418640    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls podName:d3b9eba7-3853-43e8-9253-74b0c1202e84 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.918625523 +0000 UTC m=+36.547733038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls") pod "dns-default-9lrsp" (UID: "d3b9eba7-3853-43e8-9253-74b0c1202e84") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:36.419150 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.419006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-trusted-ca\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.419244 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.419216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b9eba7-3853-43e8-9253-74b0c1202e84-tmp-dir\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.419393 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.419294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-certificates\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.419393 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.419384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b9eba7-3853-43e8-9253-74b0c1202e84-config-volume\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.423055 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.423034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-installation-pull-secrets\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.423151 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.423062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c77aa9-e858-416e-a02b-5296ec29c02e-cert\") pod \"ingress-canary-zlt2q\" (UID: \"45c77aa9-e858-416e-a02b-5296ec29c02e\") " pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.423151 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.423034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-image-registry-private-configuration\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.432504 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.430362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-bound-sa-token\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.433423 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.433372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghgc\" (UniqueName: \"kubernetes.io/projected/45c77aa9-e858-416e-a02b-5296ec29c02e-kube-api-access-lghgc\") pod \"ingress-canary-zlt2q\" (UID: \"45c77aa9-e858-416e-a02b-5296ec29c02e\") " pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.433537 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.433450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhj4\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-kube-api-access-tlhj4\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.434753 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.434733    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45n7\" (UniqueName: \"kubernetes.io/projected/d3b9eba7-3853-43e8-9253-74b0c1202e84-kube-api-access-c45n7\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.492823 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.492787    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlt2q"
Jul 11 23:57:36.922430 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.922329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:36.923145 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:36.922446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:36.923145 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.922502    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:36.923145 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.922560    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f78bbf55d-drps6: secret "image-registry-tls" not found
Jul 11 23:57:36.923145 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.922567    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:36.923145 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.922629    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls podName:d3b9eba7-3853-43e8-9253-74b0c1202e84 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:37.92261166 +0000 UTC m=+37.551719170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls") pod "dns-default-9lrsp" (UID: "d3b9eba7-3853-43e8-9253-74b0c1202e84") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:36.923145 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:36.922650    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls podName:2e501cf8-92d5-4ce8-90d2-2dbdff7d2148 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:37.922641117 +0000 UTC m=+37.551748610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls") pod "image-registry-6f78bbf55d-drps6" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148") : secret "image-registry-tls" not found
Jul 11 23:57:37.231053 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.230871    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlt2q"]
Jul 11 23:57:37.232814 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:37.232790    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c77aa9_e858_416e_a02b_5296ec29c02e.slice/crio-4ed0da1bc7e381b13b0ea2aececa6d6340be6b19ca7a966f1d96558952159867 WatchSource:0}: Error finding container 4ed0da1bc7e381b13b0ea2aececa6d6340be6b19ca7a966f1d96558952159867: Status 404 returned error can't find the container with id 4ed0da1bc7e381b13b0ea2aececa6d6340be6b19ca7a966f1d96558952159867
Jul 11 23:57:37.838818 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.838786    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:57:37.838967 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.838787    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:57:37.839035 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.838786    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:57:37.843077 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.843038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 23:57:37.843206 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.843093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7t5sz\""
Jul 11 23:57:37.843206 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.843106    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbvsd\""
Jul 11 23:57:37.843206 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.843095    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 23:57:37.843363 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.843249    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 23:57:37.843418 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.843375    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 23:57:37.930907 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.930874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:37.931371 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:37.930938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:37.931371 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:37.931042    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:37.931371 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:37.931071    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:37.931371 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:37.931088    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f78bbf55d-drps6: secret "image-registry-tls" not found
Jul 11 23:57:37.931371 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:37.931121    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls podName:d3b9eba7-3853-43e8-9253-74b0c1202e84 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:39.931099739 +0000 UTC m=+39.560207248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls") pod "dns-default-9lrsp" (UID: "d3b9eba7-3853-43e8-9253-74b0c1202e84") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:37.931371 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:37.931142    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls podName:2e501cf8-92d5-4ce8-90d2-2dbdff7d2148 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:39.931132257 +0000 UTC m=+39.560239752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls") pod "image-registry-6f78bbf55d-drps6" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148") : secret "image-registry-tls" not found
Jul 11 23:57:38.105451 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.105372    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlt2q" event={"ID":"45c77aa9-e858-416e-a02b-5296ec29c02e","Type":"ContainerStarted","Data":"4ed0da1bc7e381b13b0ea2aececa6d6340be6b19ca7a966f1d96558952159867"}
Jul 11 23:57:38.108565 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.108521    2582 generic.go:356] "Generic (PLEG): container finished" podID="be27a7fc-8795-4c3c-a16c-0b26d71af511" containerID="e522f79eafad8db1e5397a5954ef0a855c04a04fc2d493eb862df664e87acf2b" exitCode=0
Jul 11 23:57:38.108693 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.108565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerDied","Data":"e522f79eafad8db1e5397a5954ef0a855c04a04fc2d493eb862df664e87acf2b"}
Jul 11 23:57:38.322354 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.322322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:38.423320 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.423236    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:38.680706 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.680613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:38.827270 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.827240    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9qtkg"]
Jul 11 23:57:38.830243 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.830220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:38.832773 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.832735    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 23:57:38.832920 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.832894    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 23:57:38.834030 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.834002    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 23:57:38.834132 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.834044    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 23:57:38.834132 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.834010    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f56l4\""
Jul 11 23:57:38.843005 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.842985    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9qtkg"]
Jul 11 23:57:38.858748 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.858713    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:38.939963 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.939880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:38.940480 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.939993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:38.940480 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.940032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzqlr\" (UniqueName: \"kubernetes.io/projected/49509128-9062-4300-ba3d-75ed41771c7d-kube-api-access-pzqlr\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:38.940480 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.940146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49509128-9062-4300-ba3d-75ed41771c7d-data-volume\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:38.940480 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:38.940199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49509128-9062-4300-ba3d-75ed41771c7d-crio-socket\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.041243 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.041206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49509128-9062-4300-ba3d-75ed41771c7d-crio-socket\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.041243 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.041255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.041443 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.041288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.041443 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.041314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzqlr\" (UniqueName: \"kubernetes.io/projected/49509128-9062-4300-ba3d-75ed41771c7d-kube-api-access-pzqlr\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.041443 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.041395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49509128-9062-4300-ba3d-75ed41771c7d-data-volume\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.041660 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.041459    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.041660 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.041517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49509128-9062-4300-ba3d-75ed41771c7d-crio-socket\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.041660 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.041537    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:39.54151527 +0000 UTC m=+39.170622761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.041660 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.041603    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:39.041660 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.041662    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:39.541644619 +0000 UTC m=+39.170752127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:39.041972 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.041752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49509128-9062-4300-ba3d-75ed41771c7d-data-volume\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.053715 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.053690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzqlr\" (UniqueName: \"kubernetes.io/projected/49509128-9062-4300-ba3d-75ed41771c7d-kube-api-access-pzqlr\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.114798 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.114692    2582 generic.go:356] "Generic (PLEG): container finished" podID="be27a7fc-8795-4c3c-a16c-0b26d71af511" containerID="5acc129bb8d31ef08dc1e189f67a8db6c1bc5aba04249911a036eb4bd58fc25e" exitCode=0
Jul 11 23:57:39.114798 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.114778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerDied","Data":"5acc129bb8d31ef08dc1e189f67a8db6c1bc5aba04249911a036eb4bd58fc25e"}
Jul 11 23:57:39.120444 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.120410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:39.175377 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.175338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:39.413779 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.413609    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:39.447840 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.447812    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"]
Jul 11 23:57:39.471775 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.471733    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"]
Jul 11 23:57:39.471883 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.471862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"
Jul 11 23:57:39.476095 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.476064    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cpp4j\""
Jul 11 23:57:39.476095 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.476081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:39.476226 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.476087    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 11 23:57:39.520523 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.520493    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:39.545988 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.545962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.546095 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.545999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:39.546095 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.546090    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:39.546161 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.546102    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.546161 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.546134    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:40.546122655 +0000 UTC m=+40.175230143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:39.546161 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.546147    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:40.546140733 +0000 UTC m=+40.175248220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.619112 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.619042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:39.647321 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.647295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck8wf\" (UniqueName: \"kubernetes.io/projected/77dde842-63a6-45e2-8af3-49ffbb7eb975-kube-api-access-ck8wf\") pod \"migrator-7f59b54f6c-vd5l7\" (UID: \"77dde842-63a6-45e2-8af3-49ffbb7eb975\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"
Jul 11 23:57:39.726390 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.726369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:39.748540 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.748522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck8wf\" (UniqueName: \"kubernetes.io/projected/77dde842-63a6-45e2-8af3-49ffbb7eb975-kube-api-access-ck8wf\") pod \"migrator-7f59b54f6c-vd5l7\" (UID: \"77dde842-63a6-45e2-8af3-49ffbb7eb975\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"
Jul 11 23:57:39.759231 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.759204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck8wf\" (UniqueName: \"kubernetes.io/projected/77dde842-63a6-45e2-8af3-49ffbb7eb975-kube-api-access-ck8wf\") pod \"migrator-7f59b54f6c-vd5l7\" (UID: \"77dde842-63a6-45e2-8af3-49ffbb7eb975\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"
Jul 11 23:57:39.801039 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.801018    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"
Jul 11 23:57:39.820403 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.820379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:39.950246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.950217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:39.950910 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.950377    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:39.950910 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.950391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:39.950910 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.950396    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f78bbf55d-drps6: secret "image-registry-tls" not found
Jul 11 23:57:39.950910 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.950446    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:39.950910 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.950474    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls podName:2e501cf8-92d5-4ce8-90d2-2dbdff7d2148 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:43.950458265 +0000 UTC m=+43.579565766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls") pod "image-registry-6f78bbf55d-drps6" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148") : secret "image-registry-tls" not found
Jul 11 23:57:39.950910 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:39.950492    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls podName:d3b9eba7-3853-43e8-9253-74b0c1202e84 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:43.950483921 +0000 UTC m=+43.579591408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls") pod "dns-default-9lrsp" (UID: "d3b9eba7-3853-43e8-9253-74b0c1202e84") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:39.954539 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:39.954501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7"]
Jul 11 23:57:39.958972 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:39.958948    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77dde842_63a6_45e2_8af3_49ffbb7eb975.slice/crio-d3254e4f3e86d3aec730780320c932e3a155e0af8467338398a3d50f5b6b78f3 WatchSource:0}: Error finding container d3254e4f3e86d3aec730780320c932e3a155e0af8467338398a3d50f5b6b78f3: Status 404 returned error can't find the container with id d3254e4f3e86d3aec730780320c932e3a155e0af8467338398a3d50f5b6b78f3
Jul 11 23:57:40.000924 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.000892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:40.054412 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.054382    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:40.118598 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.118565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlt2q" event={"ID":"45c77aa9-e858-416e-a02b-5296ec29c02e","Type":"ContainerStarted","Data":"74d902ba7387c6f1a273ff00c44d6112a461d156f16a8eeac283fc13ee884dc3"}
Jul 11 23:57:40.121949 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.121925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zksrc" event={"ID":"be27a7fc-8795-4c3c-a16c-0b26d71af511","Type":"ContainerStarted","Data":"a9c44ce863560a934d3b3aa76283991474e3112e808b7243761d90151f6470bb"}
Jul 11 23:57:40.122910 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.122891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7" event={"ID":"77dde842-63a6-45e2-8af3-49ffbb7eb975","Type":"ContainerStarted","Data":"d3254e4f3e86d3aec730780320c932e3a155e0af8467338398a3d50f5b6b78f3"}
Jul 11 23:57:40.152584 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.152510    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zlt2q" podStartSLOduration=1.668322834 podStartE2EDuration="4.152495456s" totalImagesPullingTime="2.484172622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:40.13312184 +0000 UTC m=+39.762229376" watchObservedRunningTime="2026-07-11 23:57:40.152495456 +0000 UTC m=+39.781602969"
Jul 11 23:57:40.152672 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.152642    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zksrc" podStartSLOduration=9.618976986 podStartE2EDuration="39.152636743s" totalImagesPullingTime="29.533659757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:40.152110245 +0000 UTC m=+39.781217772" watchObservedRunningTime="2026-07-11 23:57:40.152636743 +0000 UTC m=+39.781744252"
Jul 11 23:57:40.272275 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.272100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:40.372101 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.372070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:40.412942 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.412882    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qlnjg_255afcde-e23e-42ef-8761-801ee1c5ce59/dns-node-resolver/0.log"
Jul 11 23:57:40.554591 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.554554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:40.554751 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.554630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:40.554751 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:40.554686    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:40.554751 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:40.554741    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:40.554751 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:40.554755    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:42.554737862 +0000 UTC m=+42.183845361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:40.555003 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:40.554811    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:42.554793863 +0000 UTC m=+42.183901370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:40.633608 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.633574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:40.978967 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:40.978930    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-9v5dc"]
Jul 11 23:57:41.001082 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.001056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-9v5dc"]
Jul 11 23:57:41.001260 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.001151    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.003907 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.003878    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 11 23:57:41.004036 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.003942    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 11 23:57:41.005151 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.005083    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hjfb4\""
Jul 11 23:57:41.005381 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.005091    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 11 23:57:41.005381 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.005107    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 11 23:57:41.018275 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.018251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:41.068663 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.068633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:41.145390 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.145347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:41.159455 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.159432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa282d27-2b61-4e68-ab44-2bf5ed64b205-signing-key\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.159572 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.159561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa282d27-2b61-4e68-ab44-2bf5ed64b205-signing-cabundle\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.159621 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.159609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rswq4\" (UniqueName: \"kubernetes.io/projected/fa282d27-2b61-4e68-ab44-2bf5ed64b205-kube-api-access-rswq4\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.212774 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.212739    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5g8rm_8e5d059f-a82f-42a4-8cac-4b9da4527629/node-ca/0.log"
Jul 11 23:57:41.247859 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.247796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:41.260364 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.260338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa282d27-2b61-4e68-ab44-2bf5ed64b205-signing-cabundle\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.260811 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.260522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rswq4\" (UniqueName: \"kubernetes.io/projected/fa282d27-2b61-4e68-ab44-2bf5ed64b205-kube-api-access-rswq4\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.260811 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.260600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa282d27-2b61-4e68-ab44-2bf5ed64b205-signing-key\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.261042 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.261018    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa282d27-2b61-4e68-ab44-2bf5ed64b205-signing-cabundle\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.263697 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.263674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa282d27-2b61-4e68-ab44-2bf5ed64b205-signing-key\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.268855 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.268832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rswq4\" (UniqueName: \"kubernetes.io/projected/fa282d27-2b61-4e68-ab44-2bf5ed64b205-kube-api-access-rswq4\") pod \"service-ca-79f68b9f4f-9v5dc\" (UID: \"fa282d27-2b61-4e68-ab44-2bf5ed64b205\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.313335 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.313316    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc"
Jul 11 23:57:41.463669 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.463581    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-9v5dc"]
Jul 11 23:57:41.465738 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:41.465717    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa282d27_2b61_4e68_ab44_2bf5ed64b205.slice/crio-3a3961fa43183a1c2071acf43e5101146f96018ada778a9b0046f50fc5fe6b09 WatchSource:0}: Error finding container 3a3961fa43183a1c2071acf43e5101146f96018ada778a9b0046f50fc5fe6b09: Status 404 returned error can't find the container with id 3a3961fa43183a1c2071acf43e5101146f96018ada778a9b0046f50fc5fe6b09
Jul 11 23:57:41.679862 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:41.679814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:42.130439 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:42.130402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7" event={"ID":"77dde842-63a6-45e2-8af3-49ffbb7eb975","Type":"ContainerStarted","Data":"5cb8114647f6e5f8b4a6a8c7a5249612f0133732390a43fd206cbe49d36bc040"}
Jul 11 23:57:42.130897 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:42.130467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7" event={"ID":"77dde842-63a6-45e2-8af3-49ffbb7eb975","Type":"ContainerStarted","Data":"5ec93cf69ec05e561efad73b08e7c89c642aecce41db65925d641436ef868587"}
Jul 11 23:57:42.131605 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:42.131577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc" event={"ID":"fa282d27-2b61-4e68-ab44-2bf5ed64b205","Type":"ContainerStarted","Data":"3a3961fa43183a1c2071acf43e5101146f96018ada778a9b0046f50fc5fe6b09"}
Jul 11 23:57:42.146563 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:42.146506    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vd5l7" podStartSLOduration=1.828991059 podStartE2EDuration="3.14648927s" totalImagesPullingTime="1.317498211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:42.145511098 +0000 UTC m=+41.774618627" watchObservedRunningTime="2026-07-11 23:57:42.14648927 +0000 UTC m=+41.775596780"
Jul 11 23:57:42.213809 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:42.213775    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlt2q_45c77aa9-e858-416e-a02b-5296ec29c02e/serve-healthcheck-canary/0.log"
Jul 11 23:57:42.571835 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:42.571806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:42.571971 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:42.571847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:42.571971 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:42.571934    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:42.571971 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:42.571956    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:42.572074 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:42.571995    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:46.571980046 +0000 UTC m=+46.201087537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:42.572074 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:42.572009    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:46.572002634 +0000 UTC m=+46.201110121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:43.984310 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:43.984232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:43.984310 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:43.984278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:43.984722 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:43.984377    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:43.984722 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:43.984381    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:43.984722 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:43.984441    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls podName:d3b9eba7-3853-43e8-9253-74b0c1202e84 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:51.984426558 +0000 UTC m=+51.613534045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls") pod "dns-default-9lrsp" (UID: "d3b9eba7-3853-43e8-9253-74b0c1202e84") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:43.984722 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:43.984449    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f78bbf55d-drps6: secret "image-registry-tls" not found
Jul 11 23:57:43.984722 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:43.984506    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls podName:2e501cf8-92d5-4ce8-90d2-2dbdff7d2148 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:51.984487945 +0000 UTC m=+51.613595436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls") pod "image-registry-6f78bbf55d-drps6" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148") : secret "image-registry-tls" not found
Jul 11 23:57:44.137937 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:44.137905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc" event={"ID":"fa282d27-2b61-4e68-ab44-2bf5ed64b205","Type":"ContainerStarted","Data":"437e779b046bf3f943523a13643ea468a8d75b48678f2efeb5f4101fa6c1471c"}
Jul 11 23:57:44.171654 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:44.171490    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-9v5dc" podStartSLOduration=1.9335929250000001 podStartE2EDuration="4.171471252s" totalImagesPullingTime="2.237878327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:44.171213339 +0000 UTC m=+43.800320848" watchObservedRunningTime="2026-07-11 23:57:44.171471252 +0000 UTC m=+43.800578763"
Jul 11 23:57:44.175858 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:44.175827    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:44.664436 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:44.664387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:45.632014 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:45.631973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:45.732615 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:45.732565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:45.831922 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:45.831878    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:45.882809 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:45.882704    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:45.942841 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:45.942809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:46.606244 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:46.606213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:46.606508 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:46.606257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:46.606508 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:46.606393    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:46.606508 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:57:46.606496    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls podName:49509128-9062-4300-ba3d-75ed41771c7d nodeName:}" failed. No retries permitted until 2026-07-11 23:57:54.606475575 +0000 UTC m=+54.235583077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qtkg" (UID: "49509128-9062-4300-ba3d-75ed41771c7d") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:46.606776 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:46.606741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49509128-9062-4300-ba3d-75ed41771c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:46.727309 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:46.727272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:47.125625 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:47.125591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:47.332717 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:47.332679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:47.924820 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:47.924783    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:48.460262 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:48.460229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:48.562076 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:48.562027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:48.727184 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:48.727101    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:49.125735 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:49.125702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:49.325971 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:49.325943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:49.426911 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:49.426828    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:49.527682 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:49.527651    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:50.109994 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:50.109965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:50.329300 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:50.329262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:50.725276 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:50.725228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:50.930430 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:50.930391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:51.031704 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:51.031608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:51.135874 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:51.135838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:51.523236 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:51.523181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:52.039600 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.039562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:52.039829 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.039618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:52.041904 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.041881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b9eba7-3853-43e8-9253-74b0c1202e84-metrics-tls\") pod \"dns-default-9lrsp\" (UID: \"d3b9eba7-3853-43e8-9253-74b0c1202e84\") " pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:52.042015 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.041995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"image-registry-6f78bbf55d-drps6\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") " pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:52.099871 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.099844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:52.105330 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.105311    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:52.106354 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.106327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:52.208884 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.208830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:52.253588 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.253481    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9lrsp"]
Jul 11 23:57:52.267948 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:52.267920    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b9eba7_3853_43e8_9253_74b0c1202e84.slice/crio-94a8bb76c1342347999b9ed47633fef0e4fc88c53d5ef57b1a14d5c638b342ce WatchSource:0}: Error finding container 94a8bb76c1342347999b9ed47633fef0e4fc88c53d5ef57b1a14d5c638b342ce: Status 404 returned error can't find the container with id 94a8bb76c1342347999b9ed47633fef0e4fc88c53d5ef57b1a14d5c638b342ce
Jul 11 23:57:52.272485 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.272460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f78bbf55d-drps6"]
Jul 11 23:57:52.274959 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:52.274935    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e501cf8_92d5_4ce8_90d2_2dbdff7d2148.slice/crio-a413e205ee05e1ebc841d4b90e1f33745ef200efcae2bec7b921a7f7d23e1ee1 WatchSource:0}: Error finding container a413e205ee05e1ebc841d4b90e1f33745ef200efcae2bec7b921a7f7d23e1ee1: Status 404 returned error can't find the container with id a413e205ee05e1ebc841d4b90e1f33745ef200efcae2bec7b921a7f7d23e1ee1
Jul 11 23:57:52.326376 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.326339    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:52.524124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.524068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:52.724499 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:52.724409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:53.162484 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:53.162447    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6" event={"ID":"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148","Type":"ContainerStarted","Data":"a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902"}
Jul 11 23:57:53.162672 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:53.162499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6" event={"ID":"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148","Type":"ContainerStarted","Data":"a413e205ee05e1ebc841d4b90e1f33745ef200efcae2bec7b921a7f7d23e1ee1"}
Jul 11 23:57:53.162869 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:53.162851    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:57:53.163898 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:53.163870    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9lrsp" event={"ID":"d3b9eba7-3853-43e8-9253-74b0c1202e84","Type":"ContainerStarted","Data":"94a8bb76c1342347999b9ed47633fef0e4fc88c53d5ef57b1a14d5c638b342ce"}
Jul 11 23:57:53.180626 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:53.180577    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6" podStartSLOduration=52.180558569 podStartE2EDuration="52.180558569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:53.179384182 +0000 UTC m=+52.808491713" watchObservedRunningTime="2026-07-11 23:57:53.180558569 +0000 UTC m=+52.809666077"
Jul 11 23:57:53.526161 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:53.526064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:53.924545 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:53.924509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:54.325590 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:54.325530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:54.529876 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:54.529848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:54.657785 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:54.657745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:54.660244 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:54.660217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49509128-9062-4300-ba3d-75ed41771c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qtkg\" (UID: \"49509128-9062-4300-ba3d-75ed41771c7d\") " pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:54.741794 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:54.741746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9qtkg"
Jul 11 23:57:54.882122 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:54.882053    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9qtkg"]
Jul 11 23:57:54.885025 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:57:54.884997    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49509128_9062_4300_ba3d_75ed41771c7d.slice/crio-87f4c00d093c69df967b1d0710fc0091423ca9904bd15469c910953b5a23f2a6 WatchSource:0}: Error finding container 87f4c00d093c69df967b1d0710fc0091423ca9904bd15469c910953b5a23f2a6: Status 404 returned error can't find the container with id 87f4c00d093c69df967b1d0710fc0091423ca9904bd15469c910953b5a23f2a6
Jul 11 23:57:54.924668 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:54.924643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:55.025593 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.025569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:55.074196 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.074164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:55.171984 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.171909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9lrsp" event={"ID":"d3b9eba7-3853-43e8-9253-74b0c1202e84","Type":"ContainerStarted","Data":"3d7ff396c2d34fbb165378a037baebe7808bd4cdc2ab0e40c59d86588f28a1d8"}
Jul 11 23:57:55.171984 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.171961    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9lrsp" event={"ID":"d3b9eba7-3853-43e8-9253-74b0c1202e84","Type":"ContainerStarted","Data":"1c748629bbec7a8422fe4d64995d108be9d130f1ffa711e53ef652953b47fd33"}
Jul 11 23:57:55.172157 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.172023    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:57:55.173194 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.173176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qtkg" event={"ID":"49509128-9062-4300-ba3d-75ed41771c7d","Type":"ContainerStarted","Data":"87f4c00d093c69df967b1d0710fc0091423ca9904bd15469c910953b5a23f2a6"}
Jul 11 23:57:55.189006 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.188965    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9lrsp" podStartSLOduration=16.996928746000002 podStartE2EDuration="19.188949595s" totalImagesPullingTime="2.192020849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:55.187749907 +0000 UTC m=+54.816857421" watchObservedRunningTime="2026-07-11 23:57:55.188949595 +0000 UTC m=+54.818057106"
Jul 11 23:57:55.729053 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.729023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:55.925484 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:55.925445    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:56.126235 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:56.126201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:56.323516 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:56.323485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:56.896091 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:56.896035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:56.996399 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:56.996352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:57.048391 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:57.048356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:57.194040 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:57.193961    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:57.367411 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:57.367380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:57.423956 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:57.423923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:57.772469 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:57.772436    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:57.848219 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:57.848178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:58.573470 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:58.573439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:58.777721 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:58.777624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:58.825078 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:58.825033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:59.001244 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:59.001215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:59.101427 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:59.101396    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:57:59.191011 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:59.190983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qtkg" event={"ID":"49509128-9062-4300-ba3d-75ed41771c7d","Type":"ContainerStarted","Data":"226d646370f96a3f73c69b52a4807bbe575bc96e5b4246376996cc05fb1dfb72"}
Jul 11 23:57:59.191136 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:57:59.191054    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qtkg" event={"ID":"49509128-9062-4300-ba3d-75ed41771c7d","Type":"ContainerStarted","Data":"38da245b99760aa24b3f95c419e67e1b922420c7ec148eb43e30168c9faef382"}
Jul 11 23:58:00.172399 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.172363    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"]
Jul 11 23:58:00.174384 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.174366    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"]
Jul 11 23:58:00.174502 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.174484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.176479 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.176462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.177298 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.177278    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 11 23:58:00.177298 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.177281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 11 23:58:00.177469 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.177293    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nt6jj\""
Jul 11 23:58:00.177469 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.177369    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 11 23:58:00.177469 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.177285    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 11 23:58:00.179125 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.179109    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 11 23:58:00.179235 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.179124    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 11 23:58:00.179235 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.179110    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 11 23:58:00.179401 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.179387    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 11 23:58:00.187724 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.187705    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"]
Jul 11 23:58:00.188737 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.188696    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"]
Jul 11 23:58:00.199968 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.199946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-hub\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.200096 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.199980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b334891-bfab-4536-842c-94f28196c669-additional-service-ca\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.200096 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.200020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.200220 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.200151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc8fc123-243d-4946-9e3c-07affe2905eb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-969478964-kczfh\" (UID: \"dc8fc123-243d-4946-9e3c-07affe2905eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.200265 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.200246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtn77\" (UniqueName: \"kubernetes.io/projected/0b334891-bfab-4536-842c-94f28196c669-kube-api-access-xtn77\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.200316 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.200281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv59n\" (UniqueName: \"kubernetes.io/projected/dc8fc123-243d-4946-9e3c-07affe2905eb-kube-api-access-gv59n\") pod \"managed-serviceaccount-addon-agent-969478964-kczfh\" (UID: \"dc8fc123-243d-4946-9e3c-07affe2905eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.200360 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.200316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.200360 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.200341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-ca\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.229475 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.229432    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:00.243447 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.243425    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f78bbf55d-drps6"]
Jul 11 23:58:00.301458 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.301428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.301878 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.301855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc8fc123-243d-4946-9e3c-07affe2905eb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-969478964-kczfh\" (UID: \"dc8fc123-243d-4946-9e3c-07affe2905eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.301983 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.301903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtn77\" (UniqueName: \"kubernetes.io/projected/0b334891-bfab-4536-842c-94f28196c669-kube-api-access-xtn77\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.301983 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.301934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv59n\" (UniqueName: \"kubernetes.io/projected/dc8fc123-243d-4946-9e3c-07affe2905eb-kube-api-access-gv59n\") pod \"managed-serviceaccount-addon-agent-969478964-kczfh\" (UID: \"dc8fc123-243d-4946-9e3c-07affe2905eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.301983 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.301966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.302131 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.301991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-ca\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.302131 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.302037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-hub\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.302131 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.302081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b334891-bfab-4536-842c-94f28196c669-additional-service-ca\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.302834 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.302807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b334891-bfab-4536-842c-94f28196c669-additional-service-ca\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.304787 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.304713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.304885 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.304823    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.305212 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.305191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-ca\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.305326 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.305308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc8fc123-243d-4946-9e3c-07affe2905eb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-969478964-kczfh\" (UID: \"dc8fc123-243d-4946-9e3c-07affe2905eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.305741 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.305720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0b334891-bfab-4536-842c-94f28196c669-hub\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.317839 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.317818    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtn77\" (UniqueName: \"kubernetes.io/projected/0b334891-bfab-4536-842c-94f28196c669-kube-api-access-xtn77\") pod \"cluster-proxy-proxy-agent-656f84d9fd-rbktd\" (UID: \"0b334891-bfab-4536-842c-94f28196c669\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.318924 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.318893    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv59n\" (UniqueName: \"kubernetes.io/projected/dc8fc123-243d-4946-9e3c-07affe2905eb-kube-api-access-gv59n\") pod \"managed-serviceaccount-addon-agent-969478964-kczfh\" (UID: \"dc8fc123-243d-4946-9e3c-07affe2905eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.378632 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.378600    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b84f9b5d-8wkvg"]
Jul 11 23:58:00.381560 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.381479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:00.381990 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.381969    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.397244 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.397188    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b84f9b5d-8wkvg"]
Jul 11 23:58:00.402422 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs7dd\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-kube-api-access-gs7dd\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.402528 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02d3f939-72db-41ac-9dbe-b5a9de6723ad-image-registry-private-configuration\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.402582 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02d3f939-72db-41ac-9dbe-b5a9de6723ad-installation-pull-secrets\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.402635 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-bound-sa-token\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.402635 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02d3f939-72db-41ac-9dbe-b5a9de6723ad-ca-trust-extracted\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.402715 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02d3f939-72db-41ac-9dbe-b5a9de6723ad-registry-certificates\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.402715 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-registry-tls\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.402807 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.402723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02d3f939-72db-41ac-9dbe-b5a9de6723ad-trusted-ca\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.451505 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.451427    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:00.490294 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.490254    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"
Jul 11 23:58:00.497559 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.497534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"
Jul 11 23:58:00.503841 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.503818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02d3f939-72db-41ac-9dbe-b5a9de6723ad-image-registry-private-configuration\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.503971 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.503876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02d3f939-72db-41ac-9dbe-b5a9de6723ad-installation-pull-secrets\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.503971 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.503930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-bound-sa-token\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.504070 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.503981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02d3f939-72db-41ac-9dbe-b5a9de6723ad-ca-trust-extracted\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.504158 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.504134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02d3f939-72db-41ac-9dbe-b5a9de6723ad-registry-certificates\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.504240 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.504185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-registry-tls\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.504240 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.504223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02d3f939-72db-41ac-9dbe-b5a9de6723ad-trusted-ca\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.504345 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.504266    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs7dd\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-kube-api-access-gs7dd\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.504409 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.504361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02d3f939-72db-41ac-9dbe-b5a9de6723ad-ca-trust-extracted\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.505163 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.505138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02d3f939-72db-41ac-9dbe-b5a9de6723ad-registry-certificates\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.505293 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.505277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02d3f939-72db-41ac-9dbe-b5a9de6723ad-trusted-ca\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.506966 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.506943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02d3f939-72db-41ac-9dbe-b5a9de6723ad-installation-pull-secrets\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.507075 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.507037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-registry-tls\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.507141 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.507079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02d3f939-72db-41ac-9dbe-b5a9de6723ad-image-registry-private-configuration\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.512585 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.512528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-bound-sa-token\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.512973 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.512930    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs7dd\" (UniqueName: \"kubernetes.io/projected/02d3f939-72db-41ac-9dbe-b5a9de6723ad-kube-api-access-gs7dd\") pod \"image-registry-77b84f9b5d-8wkvg\" (UID: \"02d3f939-72db-41ac-9dbe-b5a9de6723ad\") " pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:00.552588 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.552510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:00.650393 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.650360    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:00.703119 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:00.703032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:01.532995 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:01.532962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:01.633600 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:01.633561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:01.676104 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:01.676077    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b84f9b5d-8wkvg"]
Jul 11 23:58:01.679153 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:58:01.679125    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d3f939_72db_41ac_9dbe_b5a9de6723ad.slice/crio-d8600d389c08ca27b7e557b17c5c26fdebda118dfa13c4d28789ce25a58b1221 WatchSource:0}: Error finding container d8600d389c08ca27b7e557b17c5c26fdebda118dfa13c4d28789ce25a58b1221: Status 404 returned error can't find the container with id d8600d389c08ca27b7e557b17c5c26fdebda118dfa13c4d28789ce25a58b1221
Jul 11 23:58:01.687157 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:01.687133    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh"]
Jul 11 23:58:01.690238 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:58:01.690211    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc8fc123_243d_4946_9e3c_07affe2905eb.slice/crio-3384924d8987c6761c2db5bc6ef700a312ea0dbba199c6a9bf66fa254bc76cfd WatchSource:0}: Error finding container 3384924d8987c6761c2db5bc6ef700a312ea0dbba199c6a9bf66fa254bc76cfd: Status 404 returned error can't find the container with id 3384924d8987c6761c2db5bc6ef700a312ea0dbba199c6a9bf66fa254bc76cfd
Jul 11 23:58:01.690711 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:01.690689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:01.707138 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:01.707119    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd"]
Jul 11 23:58:01.709543 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:58:01.709523    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b334891_bfab_4536_842c_94f28196c669.slice/crio-687eec6ef0fd9fb6bc2a1ade03cb4ccb88eb7f038d463224f8806e5dea230237 WatchSource:0}: Error finding container 687eec6ef0fd9fb6bc2a1ade03cb4ccb88eb7f038d463224f8806e5dea230237: Status 404 returned error can't find the container with id 687eec6ef0fd9fb6bc2a1ade03cb4ccb88eb7f038d463224f8806e5dea230237
Jul 11 23:58:02.101376 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.101347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj7sw"
Jul 11 23:58:02.202501 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.202471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qtkg" event={"ID":"49509128-9062-4300-ba3d-75ed41771c7d","Type":"ContainerStarted","Data":"31962b4ac40a395beb5be11b84f5d82e2b114bd9433459f2b736c4e5386ce21e"}
Jul 11 23:58:02.203688 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.203625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh" event={"ID":"dc8fc123-243d-4946-9e3c-07affe2905eb","Type":"ContainerStarted","Data":"3384924d8987c6761c2db5bc6ef700a312ea0dbba199c6a9bf66fa254bc76cfd"}
Jul 11 23:58:02.204725 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.204704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd" event={"ID":"0b334891-bfab-4536-842c-94f28196c669","Type":"ContainerStarted","Data":"687eec6ef0fd9fb6bc2a1ade03cb4ccb88eb7f038d463224f8806e5dea230237"}
Jul 11 23:58:02.205981 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.205962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg" event={"ID":"02d3f939-72db-41ac-9dbe-b5a9de6723ad","Type":"ContainerStarted","Data":"0c124fc69005a31df31fdef1764cbe0bdb042ceb351cbdbd29bc301594879b71"}
Jul 11 23:58:02.206067 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.205994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg" event={"ID":"02d3f939-72db-41ac-9dbe-b5a9de6723ad","Type":"ContainerStarted","Data":"d8600d389c08ca27b7e557b17c5c26fdebda118dfa13c4d28789ce25a58b1221"}
Jul 11 23:58:02.206137 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.206130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:02.235874 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.235823    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9qtkg" podStartSLOduration=17.262677651 podStartE2EDuration="24.235807567s" totalImagesPullingTime="6.973129916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:02.235382475 +0000 UTC m=+61.864490007" watchObservedRunningTime="2026-07-11 23:58:02.235807567 +0000 UTC m=+61.864915077"
Jul 11 23:58:02.258307 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.258265    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg" podStartSLOduration=2.258253066 podStartE2EDuration="2.258253066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:02.257990213 +0000 UTC m=+61.887097732" watchObservedRunningTime="2026-07-11 23:58:02.258253066 +0000 UTC m=+61.887360566"
Jul 11 23:58:02.393143 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.393110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:02.445057 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.444995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:02.793997 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.793963    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:02.850021 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:02.849921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:05.178538 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:05.178504    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9lrsp"
Jul 11 23:58:06.224482 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.224443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh" event={"ID":"dc8fc123-243d-4946-9e3c-07affe2905eb","Type":"ContainerStarted","Data":"debbe8c099a1e09d5660641d8f0f2bb1b59bce1390cbb6a902503ad792a8088f"}
Jul 11 23:58:06.226564 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.226537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd" event={"ID":"0b334891-bfab-4536-842c-94f28196c669","Type":"ContainerStarted","Data":"1d2ade93185030f949c2acd28a311b51a7efc7b78c9ca03f2f700827208642cd"}
Jul 11 23:58:06.226667 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.226574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd" event={"ID":"0b334891-bfab-4536-842c-94f28196c669","Type":"ContainerStarted","Data":"2eba7bf3b26e655d8de5c4affe67561e1fdf577b0cf947e65f1550d999430c24"}
Jul 11 23:58:06.226667 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.226587    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd" event={"ID":"0b334891-bfab-4536-842c-94f28196c669","Type":"ContainerStarted","Data":"9f38926351150fe86a9eeaf3a3a6b3151054914b0261753c03ec81f6834853ba"}
Jul 11 23:58:06.240586 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.240548    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-969478964-kczfh" podStartSLOduration=2.332143399 podStartE2EDuration="6.240534287s" totalImagesPullingTime="3.908390888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:06.240304728 +0000 UTC m=+65.869412239" watchObservedRunningTime="2026-07-11 23:58:06.240534287 +0000 UTC m=+65.869641796"
Jul 11 23:58:06.257195 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.257154    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-656f84d9fd-rbktd" podStartSLOduration=2.358435053 podStartE2EDuration="6.257138411s" totalImagesPullingTime="3.898703358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:06.256438354 +0000 UTC m=+65.885545863" watchObservedRunningTime="2026-07-11 23:58:06.257138411 +0000 UTC m=+65.886245921"
Jul 11 23:58:06.663288 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.663255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:58:06.663450 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.663339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:58:06.666330 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.666310    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 23:58:06.667306 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.667292    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 23:58:06.676378 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.676356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbc41fd4-ede0-4f04-8fdd-198613cee7a3-original-pull-secret\") pod \"global-pull-secret-syncer-vf5b8\" (UID: \"cbc41fd4-ede0-4f04-8fdd-198613cee7a3\") " pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:58:06.676465 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.676446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77da7a05-68dd-4f37-a0ef-70bc4b3904dc-metrics-certs\") pod \"network-metrics-daemon-hc6sz\" (UID: \"77da7a05-68dd-4f37-a0ef-70bc4b3904dc\") " pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:58:06.763843 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.763804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:58:06.766570 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.766552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 23:58:06.776900 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.776881    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 23:58:06.787400 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.787376    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj6nx\" (UniqueName: \"kubernetes.io/projected/a4a97b28-ac43-48fb-8a1c-b668fd9371e4-kube-api-access-mj6nx\") pod \"network-check-target-cncg9\" (UID: \"a4a97b28-ac43-48fb-8a1c-b668fd9371e4\") " pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:58:06.864129 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.864099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:06.953556 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.953495    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7t5sz\""
Jul 11 23:58:06.959824 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.959806    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbvsd\""
Jul 11 23:58:06.961724 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.961709    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:58:06.963537 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.963523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vf5b8"
Jul 11 23:58:06.967741 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.965025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:06.967885 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:06.967741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc6sz"
Jul 11 23:58:07.129153 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.129123    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hc6sz"]
Jul 11 23:58:07.132630 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:58:07.132599    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77da7a05_68dd_4f37_a0ef_70bc4b3904dc.slice/crio-922212d9964727bf89f9971eb6dd4502a57934c6309c39b210bb2abc2e9ead07 WatchSource:0}: Error finding container 922212d9964727bf89f9971eb6dd4502a57934c6309c39b210bb2abc2e9ead07: Status 404 returned error can't find the container with id 922212d9964727bf89f9971eb6dd4502a57934c6309c39b210bb2abc2e9ead07
Jul 11 23:58:07.145546 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.145519    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cncg9"]
Jul 11 23:58:07.148294 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:58:07.148269    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a97b28_ac43_48fb_8a1c_b668fd9371e4.slice/crio-647bd16d56da621e315db97606623ae3866cafede6a71baaa95d074c7d809a46 WatchSource:0}: Error finding container 647bd16d56da621e315db97606623ae3866cafede6a71baaa95d074c7d809a46: Status 404 returned error can't find the container with id 647bd16d56da621e315db97606623ae3866cafede6a71baaa95d074c7d809a46
Jul 11 23:58:07.165469 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.165446    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vf5b8"]
Jul 11 23:58:07.168413 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:58:07.168387    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc41fd4_ede0_4f04_8fdd_198613cee7a3.slice/crio-a06c5ce7a303b54e138817d0626dca4eddd6b43c0b1afbd7355a57065687bcc1 WatchSource:0}: Error finding container a06c5ce7a303b54e138817d0626dca4eddd6b43c0b1afbd7355a57065687bcc1: Status 404 returned error can't find the container with id a06c5ce7a303b54e138817d0626dca4eddd6b43c0b1afbd7355a57065687bcc1
Jul 11 23:58:07.231409 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.231336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vf5b8" event={"ID":"cbc41fd4-ede0-4f04-8fdd-198613cee7a3","Type":"ContainerStarted","Data":"a06c5ce7a303b54e138817d0626dca4eddd6b43c0b1afbd7355a57065687bcc1"}
Jul 11 23:58:07.232507 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.232486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hc6sz" event={"ID":"77da7a05-68dd-4f37-a0ef-70bc4b3904dc","Type":"ContainerStarted","Data":"922212d9964727bf89f9971eb6dd4502a57934c6309c39b210bb2abc2e9ead07"}
Jul 11 23:58:07.233442 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.233421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cncg9" event={"ID":"a4a97b28-ac43-48fb-8a1c-b668fd9371e4","Type":"ContainerStarted","Data":"647bd16d56da621e315db97606623ae3866cafede6a71baaa95d074c7d809a46"}
Jul 11 23:58:07.442502 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.442458    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:07.544841 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.544680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:07.643371 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.643259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:07.744287 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.744194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:07.794963 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:07.794883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:09.243729 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:09.243697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hc6sz" event={"ID":"77da7a05-68dd-4f37-a0ef-70bc4b3904dc","Type":"ContainerStarted","Data":"746b662c445eb9e9328e43466bb6e3a8a69648b2c0461dba46e7768261d7187d"}
Jul 11 23:58:09.244183 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:09.243774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hc6sz" event={"ID":"77da7a05-68dd-4f37-a0ef-70bc4b3904dc","Type":"ContainerStarted","Data":"ca412b3bdd5bd4262fe32f617b38e964de3918de517c1b712d856af49f658d4e"}
Jul 11 23:58:09.260396 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:09.260347    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hc6sz" podStartSLOduration=66.965844787 podStartE2EDuration="1m8.260327094s" totalImagesPullingTime="1.294482307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:09.259612153 +0000 UTC m=+68.888719687" watchObservedRunningTime="2026-07-11 23:58:09.260327094 +0000 UTC m=+68.889434607"
Jul 11 23:58:09.378967 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:09.378915    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:09.431703 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:09.431657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:10.001194 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:10.001163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:10.055254 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:10.055210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:10.250132 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:10.250101    2582 patch_prober.go:28] interesting pod/image-registry-6f78bbf55d-drps6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 11 23:58:10.250471 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:10.250157    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6" podUID="2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 23:58:12.167328 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.167285    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:12.261561 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.261514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cncg9" event={"ID":"a4a97b28-ac43-48fb-8a1c-b668fd9371e4","Type":"ContainerStarted","Data":"f1a31174cdda4077d0fe4b2d70c302da4ee37fb9e1647bac007bf6b4a301658d"}
Jul 11 23:58:12.261740 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.261626    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:58:12.263041 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.263005    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vf5b8" event={"ID":"cbc41fd4-ede0-4f04-8fdd-198613cee7a3","Type":"ContainerStarted","Data":"aeb2054905cbdc53645a949ad8596fae04a7ea2d39a90257cda783799701ce7c"}
Jul 11 23:58:12.278417 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.278352    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cncg9" podStartSLOduration=66.702752563 podStartE2EDuration="1m11.27833493s" totalImagesPullingTime="4.575582367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:12.278274321 +0000 UTC m=+71.907381859" watchObservedRunningTime="2026-07-11 23:58:12.27833493 +0000 UTC m=+71.907442441"
Jul 11 23:58:12.283793 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.282798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:12.292524 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.292483    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vf5b8" podStartSLOduration=66.733067766 podStartE2EDuration="1m11.292469705s" totalImagesPullingTime="4.559401939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:12.292113166 +0000 UTC m=+71.921220688" watchObservedRunningTime="2026-07-11 23:58:12.292469705 +0000 UTC m=+71.921577215"
Jul 11 23:58:12.456023 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.455938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:12.584652 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.584612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:12.684608 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:12.684575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:13.871562 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:13.871527    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:13.925449 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:13.925419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:14.006787 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:14.006749    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:14.107339 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:14.107313    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:14.294990 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:14.294950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:14.351170 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:14.351136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:15.006606 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:15.006571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:15.065389 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:15.065363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:15.225117 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:15.225060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:15.327934 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:15.327901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:15.386205 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:15.386170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:15.746186 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:15.746084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:17.398715 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:17.398675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:17.448699 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:17.448666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:17.622894 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:17.622852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:17.682391 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:17.682308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:18.787007 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:18.786965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:20.248290 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:20.248265    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:58:20.406506 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:20.406477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:21.007749 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.007715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:21.108540 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.108515    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:21.430943 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.430912    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:21.643959 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.643926    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:21.703079 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.702992    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sdspb"]
Jul 11 23:58:21.705631 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.705608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.708448 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.708425    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 23:58:21.708560 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.708488    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qbcvt\""
Jul 11 23:58:21.709591 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.709572    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 23:58:21.709680 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.709590    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 23:58:21.709745 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.709580    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 23:58:21.709745 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.709711    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 23:58:21.709956 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.709911    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 23:58:21.729828 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.729783    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:21.781745 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-tls\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.781954 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-root\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.781954 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.781954 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-wtmp\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.781954 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8mf8\" (UniqueName: \"kubernetes.io/projected/3a52c465-c9c5-43d5-8449-29dbc67c295b-kube-api-access-h8mf8\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.781954 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-textfile\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.781954 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a52c465-c9c5-43d5-8449-29dbc67c295b-metrics-client-ca\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.782253 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.781967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-sys\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.782253 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.782008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.809482 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.809449    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:21.883045 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883016    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-sys\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883183 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883183 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-sys\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883294 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-tls\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883294 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-root\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883294 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883445 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-wtmp\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883445 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8mf8\" (UniqueName: \"kubernetes.io/projected/3a52c465-c9c5-43d5-8449-29dbc67c295b-kube-api-access-h8mf8\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883445 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-root\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883445 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-textfile\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883445 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a52c465-c9c5-43d5-8449-29dbc67c295b-metrics-client-ca\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883698 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-wtmp\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883698 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883890 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-textfile\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.883987 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.883971    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a52c465-c9c5-43d5-8449-29dbc67c295b-metrics-client-ca\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.885678 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.885653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.885854 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.885750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a52c465-c9c5-43d5-8449-29dbc67c295b-node-exporter-tls\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.902947 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.902930    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8mf8\" (UniqueName: \"kubernetes.io/projected/3a52c465-c9c5-43d5-8449-29dbc67c295b-kube-api-access-h8mf8\") pod \"node-exporter-sdspb\" (UID: \"3a52c465-c9c5-43d5-8449-29dbc67c295b\") " pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:21.923241 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:21.923205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:22.017010 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.016941    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sdspb"
Jul 11 23:58:22.021909 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.021876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:22.028478 ip-10-0-142-235 kubenswrapper[2582]: W0711 23:58:22.028452    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a52c465_c9c5_43d5_8449_29dbc67c295b.slice/crio-38010c2aac02b01c01a7ff7da88505513dde21bc1dd31bf519775f5b0e54870c WatchSource:0}: Error finding container 38010c2aac02b01c01a7ff7da88505513dde21bc1dd31bf519775f5b0e54870c: Status 404 returned error can't find the container with id 38010c2aac02b01c01a7ff7da88505513dde21bc1dd31bf519775f5b0e54870c
Jul 11 23:58:22.127613 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.127577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:22.228653 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.228624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:22.297065 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.297035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdspb" event={"ID":"3a52c465-c9c5-43d5-8449-29dbc67c295b","Type":"ContainerStarted","Data":"38010c2aac02b01c01a7ff7da88505513dde21bc1dd31bf519775f5b0e54870c"}
Jul 11 23:58:22.652951 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.652856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:22.742487 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.742371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:22.865471 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:22.865437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:23.217282 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:23.217252    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77b84f9b5d-8wkvg"
Jul 11 23:58:23.301943 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:23.301916    2582 generic.go:356] "Generic (PLEG): container finished" podID="3a52c465-c9c5-43d5-8449-29dbc67c295b" containerID="faf246813ef7af703eaf22ce099ba62f6d52022bf4b0b5cdbbecf9b003dc70a2" exitCode=0
Jul 11 23:58:23.302119 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:23.301949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdspb" event={"ID":"3a52c465-c9c5-43d5-8449-29dbc67c295b","Type":"ContainerDied","Data":"faf246813ef7af703eaf22ce099ba62f6d52022bf4b0b5cdbbecf9b003dc70a2"}
Jul 11 23:58:23.348648 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:23.348620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:23.450251 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:23.450223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:23.550542 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:23.550506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:23.650869 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:23.650792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:24.295809 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.295754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:24.307435 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.307403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdspb" event={"ID":"3a52c465-c9c5-43d5-8449-29dbc67c295b","Type":"ContainerStarted","Data":"9a3358df7663550f3b5f155220acd6bae8c1c409d7a7f8622216004e5be3045b"}
Jul 11 23:58:24.307587 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.307491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdspb" event={"ID":"3a52c465-c9c5-43d5-8449-29dbc67c295b","Type":"ContainerStarted","Data":"907b383d19701af9c5984876971162eb48ddfddcfab10fdf9e371ca4c7ce7e13"}
Jul 11 23:58:24.329411 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.329366    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sdspb" podStartSLOduration=2.316516903 podStartE2EDuration="3.329352467s" totalImagesPullingTime="952.551178ms" totalInitContainerRuntime="60.284386ms" isStatefulPod=true podCreationTimestamp="2026-07-11 23:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:24.327587617 +0000 UTC m=+83.956695126" watchObservedRunningTime="2026-07-11 23:58:24.329352467 +0000 UTC m=+83.958459977"
Jul 11 23:58:24.396248 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.396220    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:24.635077 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.634974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:24.706026 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.705990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:24.843205 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.843167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:24.944652 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:24.944563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:25.045133 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.045095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:25.146446 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.146419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:25.268124 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.268040    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6" podUID="2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" containerName="registry" containerID="cri-o://a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902" gracePeriod=30
Jul 11 23:58:25.273951 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.273929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:25.507203 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.507179    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:58:25.612459 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612436    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-image-registry-private-configuration\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.612605 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612497    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-bound-sa-token\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.612605 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-ca-trust-extracted\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.612605 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612570    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-certificates\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.612605 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612603    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-installation-pull-secrets\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.612853 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612629    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-trusted-ca\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.612853 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612657    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlhj4\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-kube-api-access-tlhj4\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.612853 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.612691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") pod \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\" (UID: \"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148\") "
Jul 11 23:58:25.613246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.613220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 23:58:25.613246 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.613235    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 23:58:25.615125 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.615089    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 23:58:25.615279 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.615240    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-kube-api-access-tlhj4" (OuterVolumeSpecName: "kube-api-access-tlhj4") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "kube-api-access-tlhj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 23:58:25.615360 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.615276    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 23:58:25.615360 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.615344    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 23:58:25.615523 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.615495    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 23:58:25.621307 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.621280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" (UID: "2e501cf8-92d5-4ce8-90d2-2dbdff7d2148"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 23:58:25.713692 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713665    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-ca-trust-extracted\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:25.713692 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713688    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-certificates\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:25.713844 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713698    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-installation-pull-secrets\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:25.713844 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713707    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-trusted-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:25.713844 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713715    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlhj4\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-kube-api-access-tlhj4\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:25.713844 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713723    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-registry-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:25.713844 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713733    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-image-registry-private-configuration\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:25.713844 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:25.713741    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148-bound-sa-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 11 23:58:26.314952 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.314918    2582 generic.go:356] "Generic (PLEG): container finished" podID="2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" containerID="a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902" exitCode=0
Jul 11 23:58:26.315088 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.314976    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6"
Jul 11 23:58:26.315088 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.314994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6" event={"ID":"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148","Type":"ContainerDied","Data":"a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902"}
Jul 11 23:58:26.315088 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.315035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f78bbf55d-drps6" event={"ID":"2e501cf8-92d5-4ce8-90d2-2dbdff7d2148","Type":"ContainerDied","Data":"a413e205ee05e1ebc841d4b90e1f33745ef200efcae2bec7b921a7f7d23e1ee1"}
Jul 11 23:58:26.315088 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.315058    2582 scope.go:117] "RemoveContainer" containerID="a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902"
Jul 11 23:58:26.323706 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.323691    2582 scope.go:117] "RemoveContainer" containerID="a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902"
Jul 11 23:58:26.323956 ip-10-0-142-235 kubenswrapper[2582]: E0711 23:58:26.323938    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902\": container with ID starting with a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902 not found: ID does not exist" containerID="a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902"
Jul 11 23:58:26.324026 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.323961    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902"} err="failed to get container status \"a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902\": rpc error: code = NotFound desc = could not find container \"a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902\": container with ID starting with a624b41eef4373feca111a3e71ab33aa0b10b1d6b8a589a24ad3246a827a2902 not found: ID does not exist"
Jul 11 23:58:26.336521 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.336497    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f78bbf55d-drps6"]
Jul 11 23:58:26.339007 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.338983    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f78bbf55d-drps6"]
Jul 11 23:58:26.466360 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.466329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:26.560492 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.560461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:26.609151 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.609072    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:26.761573 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.761539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:26.817346 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.817315    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:26.842941 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:26.842915    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" path="/var/lib/kubelet/pods/2e501cf8-92d5-4ce8-90d2-2dbdff7d2148/volumes"
Jul 11 23:58:27.227526 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:27.227492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:27.285494 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:27.285465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:27.904452 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:27.904422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:31.533532 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:31.533497    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:36.108295 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:36.108251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:36.206606 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:36.206576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:37.875176 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:37.875124    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:37.926220 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:37.926188    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:37.979922 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:37.979898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:39.998294 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:39.998267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:40.047464 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:40.047432    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:40.541218 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:40.541186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:43.269748 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:43.269718    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cncg9"
Jul 11 23:58:55.004037 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:55.003995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:55.104590 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:55.104560    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:55.563691 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:55.563662    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:58:55.613741 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:58:55.613706    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:01.976698 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:01.976664    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:02.077123 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:02.077085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:02.190221 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:02.190183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:09.103303 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:09.103273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:09.155659 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:09.155624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:14.511204 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:14.511173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:14.610394 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:14.610366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:40.836836 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:40.836795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:40.936906 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:40.936873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:49.754893 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:49.754851    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:49.812263 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:49.812227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:49.910163 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:49.910133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:50.011355 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:50.011273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:50.507926 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:50.507891    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:50.608909 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:50.608878    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:56.035355 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:56.035268    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:56.084962 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:56.084923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:57.296108 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:57.296079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:57.397258 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:57.397219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:57.913534 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:57.913493    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 11 23:59:57.963195 ip-10-0-142-235 kubenswrapper[2582]: I0711 23:59:57.963158    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:08.062176 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:08.062135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:08.118356 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:08.118316    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:08.296588 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:08.296544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:25.014148 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:25.014111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:25.112922 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:25.112889    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:44.707679 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:44.707634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:44.759038 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:44.758999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:00:52.277670 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:00:52.277630    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:05.687402 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:05.687358    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:05.784292 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:05.784255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:25.890506 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:25.890429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:32.277559 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:32.277528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:33.092734 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:33.092695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:35.890376 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:35.890344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:35.955283 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:35.955245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:38.757809 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:38.757754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:38.862461 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:38.862427    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:38.990662 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:38.990625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:40.149034 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:40.149006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:40.249258 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:40.249222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:41.229295 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:41.229257    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:41.443564 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:41.443534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:42.485505 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:42.485474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:42.585962 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:42.585930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:48.441274 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:48.441241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:52.900531 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:52.900489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:53.000248 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:53.000214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:01:55.263416 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.263382    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"]
Jul 12 00:01:55.263796 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.263613    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" containerName="registry"
Jul 12 00:01:55.263796 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.263623    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" containerName="registry"
Jul 12 00:01:55.263796 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.263662    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e501cf8-92d5-4ce8-90d2-2dbdff7d2148" containerName="registry"
Jul 12 00:01:55.266296 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.266281    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.268777 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.268739    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 00:01:55.269801 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.269783    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 00:01:55.269892 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.269825    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b29nj\""
Jul 12 00:01:55.275332 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.275315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"]
Jul 12 00:01:55.328066 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.328039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef97d5f2-3dd6-40d4-b312-05df5f2c3d69-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dzscp\" (UID: \"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.328186 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.328073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlb6l\" (UniqueName: \"kubernetes.io/projected/ef97d5f2-3dd6-40d4-b312-05df5f2c3d69-kube-api-access-nlb6l\") pod \"openshift-lws-operator-fd8ccff4c-dzscp\" (UID: \"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.429416 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.429382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef97d5f2-3dd6-40d4-b312-05df5f2c3d69-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dzscp\" (UID: \"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.429416 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.429420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlb6l\" (UniqueName: \"kubernetes.io/projected/ef97d5f2-3dd6-40d4-b312-05df5f2c3d69-kube-api-access-nlb6l\") pod \"openshift-lws-operator-fd8ccff4c-dzscp\" (UID: \"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.429847 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.429821    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef97d5f2-3dd6-40d4-b312-05df5f2c3d69-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dzscp\" (UID: \"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.437651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.437630    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlb6l\" (UniqueName: \"kubernetes.io/projected/ef97d5f2-3dd6-40d4-b312-05df5f2c3d69-kube-api-access-nlb6l\") pod \"openshift-lws-operator-fd8ccff4c-dzscp\" (UID: \"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.575021 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.574990    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"
Jul 12 00:01:55.699801 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.699778    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp"]
Jul 12 00:01:55.702291 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:01:55.702266    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef97d5f2_3dd6_40d4_b312_05df5f2c3d69.slice/crio-812bb2c5b13877ae5a3d70450a09246462d015765c2ca6f85c3858256410d0c7 WatchSource:0}: Error finding container 812bb2c5b13877ae5a3d70450a09246462d015765c2ca6f85c3858256410d0c7: Status 404 returned error can't find the container with id 812bb2c5b13877ae5a3d70450a09246462d015765c2ca6f85c3858256410d0c7
Jul 12 00:01:55.975155 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:55.975073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp" event={"ID":"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69","Type":"ContainerStarted","Data":"812bb2c5b13877ae5a3d70450a09246462d015765c2ca6f85c3858256410d0c7"}
Jul 12 00:01:58.988104 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:58.988070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp" event={"ID":"ef97d5f2-3dd6-40d4-b312-05df5f2c3d69","Type":"ContainerStarted","Data":"fa31e01d02873395497bf9ad4711fa5c23f9db603796adbc79208bb0189f7019"}
Jul 12 00:01:59.003345 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:59.003245    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzscp" podStartSLOduration=1.18764285 podStartE2EDuration="4.003227127s" totalImagesPullingTime="2.815584277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:01:59.002829828 +0000 UTC m=+298.631937359" watchObservedRunningTime="2026-07-12 00:01:59.003227127 +0000 UTC m=+298.632334639"
Jul 12 00:01:59.803995 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:01:59.803962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:00.758501 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:00.758478    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 00:02:01.182544 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:01.182508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:01.984408 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:01.984375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:08.583371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:08.583325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:08.633880 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:08.633835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:13.715182 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:13.715143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:13.808639 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:13.808609    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:14.320468 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.320429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:14.537024 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.536984    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:14.641928 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.641848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:14.667416 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.667387    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"]
Jul 12 00:02:14.670571 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.670552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.673989 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.673967    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lrlqr\""
Jul 12 00:02:14.674108 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.673998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 00:02:14.674108 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.674038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 00:02:14.674260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.674245    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 00:02:14.674318 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.674287    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 00:02:14.687707 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.687682    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"]
Jul 12 00:02:14.781987 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.781958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a63c3543-0638-4660-a38c-18c339664ea4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.782315 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.782006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a63c3543-0638-4660-a38c-18c339664ea4-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.782315 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.782060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a63c3543-0638-4660-a38c-18c339664ea4-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.782315 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.782103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjg9\" (UniqueName: \"kubernetes.io/projected/a63c3543-0638-4660-a38c-18c339664ea4-kube-api-access-6qjg9\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.782315 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.782130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a63c3543-0638-4660-a38c-18c339664ea4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.788092 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.788065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:14.882683 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.882653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a63c3543-0638-4660-a38c-18c339664ea4-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.882874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.882688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a63c3543-0638-4660-a38c-18c339664ea4-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.882874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.882720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjg9\" (UniqueName: \"kubernetes.io/projected/a63c3543-0638-4660-a38c-18c339664ea4-kube-api-access-6qjg9\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.882874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.882749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a63c3543-0638-4660-a38c-18c339664ea4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.882874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.882807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a63c3543-0638-4660-a38c-18c339664ea4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.883118 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.883095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a63c3543-0638-4660-a38c-18c339664ea4-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.885044 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.885015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a63c3543-0638-4660-a38c-18c339664ea4-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.885252 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.885235    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a63c3543-0638-4660-a38c-18c339664ea4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.885319 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.885304    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a63c3543-0638-4660-a38c-18c339664ea4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.892534 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.892453    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjg9\" (UniqueName: \"kubernetes.io/projected/a63c3543-0638-4660-a38c-18c339664ea4-kube-api-access-6qjg9\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-hb25l\" (UID: \"a63c3543-0638-4660-a38c-18c339664ea4\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.892746 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.892722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:14.980950 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.980927    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:14.994318 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:14.994279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:15.097564 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:15.097525    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:15.112813 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:15.112787    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"]
Jul 12 00:02:15.116785 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:02:15.116747    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63c3543_0638_4660_a38c_18c339664ea4.slice/crio-ffbea3a68a8b54970355ec87fb36436d19c7c15bb0c903e48c5d0d87154ec6cd WatchSource:0}: Error finding container ffbea3a68a8b54970355ec87fb36436d19c7c15bb0c903e48c5d0d87154ec6cd: Status 404 returned error can't find the container with id ffbea3a68a8b54970355ec87fb36436d19c7c15bb0c903e48c5d0d87154ec6cd
Jul 12 00:02:15.118525 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:15.118510    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:02:15.193835 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:15.193735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:15.252897 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:15.252859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:15.354143 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:15.354110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:15.456042 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:15.455957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:16.046782 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:16.046731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l" event={"ID":"a63c3543-0638-4660-a38c-18c339664ea4","Type":"ContainerStarted","Data":"ffbea3a68a8b54970355ec87fb36436d19c7c15bb0c903e48c5d0d87154ec6cd"}
Jul 12 00:02:19.059932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:19.059900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l" event={"ID":"a63c3543-0638-4660-a38c-18c339664ea4","Type":"ContainerStarted","Data":"c927afa5215b166e14de72dcd55a1bc707d41424a09ef60f50fdd8d45552101b"}
Jul 12 00:02:20.065266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:20.065233    2582 generic.go:356] "Generic (PLEG): container finished" podID="a63c3543-0638-4660-a38c-18c339664ea4" containerID="c927afa5215b166e14de72dcd55a1bc707d41424a09ef60f50fdd8d45552101b" exitCode=0
Jul 12 00:02:20.065655 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:20.065326    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l" event={"ID":"a63c3543-0638-4660-a38c-18c339664ea4","Type":"ContainerDied","Data":"c927afa5215b166e14de72dcd55a1bc707d41424a09ef60f50fdd8d45552101b"}
Jul 12 00:02:20.211698 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:20.211661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:20.312292 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:20.312254    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:21.070068 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:21.070037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l" event={"ID":"a63c3543-0638-4660-a38c-18c339664ea4","Type":"ContainerStarted","Data":"1f9663fdf3de1bf4d3730b7aadbbb7d3f84397f110e9c6cdb2e6a055995239f0"}
Jul 12 00:02:21.070453 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:21.070186    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:21.114478 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:21.114430    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l" podStartSLOduration=2.466308699 podStartE2EDuration="7.114415584s" totalImagesPullingTime="3.560257907s" totalInitContainerRuntime="1.087848978s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:21.112588091 +0000 UTC m=+320.741695640" watchObservedRunningTime="2026-07-12 00:02:21.114415584 +0000 UTC m=+320.743523093"
Jul 12 00:02:25.452994 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:25.452954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:32.075983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:32.075951    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-hb25l"
Jul 12 00:02:34.202999 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.202962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:34.321248 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.321200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:34.569258 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.569227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:34.722598 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.722561    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"]
Jul 12 00:02:34.733110 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.733082    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.737079 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.737059    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 00:02:34.738052 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.738031    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 00:02:34.738159 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.738091    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5ncrc\""
Jul 12 00:02:34.738159 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.738096    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 00:02:34.738313 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.738292    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 00:02:34.743121 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.743101    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"]
Jul 12 00:02:34.817511 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.817481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pmkm\" (UniqueName: \"kubernetes.io/projected/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-kube-api-access-5pmkm\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.817678 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.817526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-tls-certs\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.817678 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.817544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-tmp\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.834597 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.834535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:34.918509 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.918465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pmkm\" (UniqueName: \"kubernetes.io/projected/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-kube-api-access-5pmkm\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.918673 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.918527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-tls-certs\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.918673 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.918544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-tmp\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.920727 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.920697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-tmp\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.920949 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.920932    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-tls-certs\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:34.937049 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:34.937026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pmkm\" (UniqueName: \"kubernetes.io/projected/19931f67-b44e-44f5-a72d-3a1dd05e7ad5-kube-api-access-5pmkm\") pod \"kube-auth-proxy-57d6f88c78-tbdbt\" (UID: \"19931f67-b44e-44f5-a72d-3a1dd05e7ad5\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:35.003607 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.003578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:35.042914 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.042888    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"
Jul 12 00:02:35.103230 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.103178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:35.168425 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.168403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt"]
Jul 12 00:02:35.170070 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:02:35.170047    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19931f67_b44e_44f5_a72d_3a1dd05e7ad5.slice/crio-f77d7a00f3f65d608f02a9d66f2fab90c0c82c6b5f75ac90ddacf00d4f008429 WatchSource:0}: Error finding container f77d7a00f3f65d608f02a9d66f2fab90c0c82c6b5f75ac90ddacf00d4f008429: Status 404 returned error can't find the container with id f77d7a00f3f65d608f02a9d66f2fab90c0c82c6b5f75ac90ddacf00d4f008429
Jul 12 00:02:35.171843 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.171593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:35.549522 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.549490    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:35.920754 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.920675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:35.990710 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:35.990640    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:36.070127 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:36.070087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:36.125640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:36.125603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt" event={"ID":"19931f67-b44e-44f5-a72d-3a1dd05e7ad5","Type":"ContainerStarted","Data":"f77d7a00f3f65d608f02a9d66f2fab90c0c82c6b5f75ac90ddacf00d4f008429"}
Jul 12 00:02:37.040036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:37.040004    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:38.133941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:38.133907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt" event={"ID":"19931f67-b44e-44f5-a72d-3a1dd05e7ad5","Type":"ContainerStarted","Data":"d13d10c3c8071e4de728d7789a1b0abdfd7b0eaa5afdbb2ce1df1b363c44ec2c"}
Jul 12 00:02:38.150629 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:38.150582    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-tbdbt" podStartSLOduration=1.331498909 podStartE2EDuration="4.15056711s" totalImagesPullingTime="2.819068201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:38.149083933 +0000 UTC m=+337.778191461" watchObservedRunningTime="2026-07-12 00:02:38.15056711 +0000 UTC m=+337.779674619"
Jul 12 00:02:41.918463 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.918427    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"]
Jul 12 00:02:41.920532 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.920514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:41.923381 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.923348    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 00:02:41.923381 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.923349    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 00:02:41.923533 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.923350    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 00:02:41.923533 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.923350    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 00:02:41.923533 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.923450    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gpbnt\""
Jul 12 00:02:41.934420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.934395    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"]
Jul 12 00:02:41.973325 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.973301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95925044-5bcf-4650-9c07-0aed31e06b9b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:41.973470 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.973335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:41.973470 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.973369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:41.973470 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.973444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:41.973591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.973478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:41.973591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.973505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:41.973591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:41.973532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4vd\" (UniqueName: \"kubernetes.io/projected/95925044-5bcf-4650-9c07-0aed31e06b9b-kube-api-access-pw4vd\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.074747 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.074708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.074941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.074754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.074941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.074803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.074941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.074833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.074941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.074867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4vd\" (UniqueName: \"kubernetes.io/projected/95925044-5bcf-4650-9c07-0aed31e06b9b-kube-api-access-pw4vd\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.074941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.074905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95925044-5bcf-4650-9c07-0aed31e06b9b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.074941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.074932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.075398 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.075360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.077229 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.077203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95925044-5bcf-4650-9c07-0aed31e06b9b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.077320 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.077265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.077359 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.077322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.077393 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.077363    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95925044-5bcf-4650-9c07-0aed31e06b9b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.085593 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.085572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4vd\" (UniqueName: \"kubernetes.io/projected/95925044-5bcf-4650-9c07-0aed31e06b9b-kube-api-access-pw4vd\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.085704 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.085604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95925044-5bcf-4650-9c07-0aed31e06b9b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-svb77\" (UID: \"95925044-5bcf-4650-9c07-0aed31e06b9b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.229271 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.229161    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:42.389885 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:42.389852    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"]
Jul 12 00:02:42.392881 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:02:42.392857    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95925044_5bcf_4650_9c07_0aed31e06b9b.slice/crio-01632587e85b89a684375a096805452892753e860decf450a8a809d0b22dc765 WatchSource:0}: Error finding container 01632587e85b89a684375a096805452892753e860decf450a8a809d0b22dc765: Status 404 returned error can't find the container with id 01632587e85b89a684375a096805452892753e860decf450a8a809d0b22dc765
Jul 12 00:02:43.154233 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:43.154202    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77" event={"ID":"95925044-5bcf-4650-9c07-0aed31e06b9b","Type":"ContainerStarted","Data":"01632587e85b89a684375a096805452892753e860decf450a8a809d0b22dc765"}
Jul 12 00:02:44.219266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:44.219162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:44.299482 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:44.299441    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:44.435006 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:44.434972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:44.628008 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:44.627963    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:02:44.628119 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:44.628048    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:02:45.094206 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.094172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:45.163515 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.163482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77" event={"ID":"95925044-5bcf-4650-9c07-0aed31e06b9b","Type":"ContainerStarted","Data":"a034b4ca2310134e905dd31f382396acb795eadc150bf7a0a6e431eeb71de78e"}
Jul 12 00:02:45.163721 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.163705    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:45.165438 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.165414    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-svb77 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 00:02:45.165549 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.165464    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77" podUID="95925044-5bcf-4650-9c07-0aed31e06b9b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 00:02:45.193973 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.193928    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77" podStartSLOduration=1.961047793 podStartE2EDuration="4.193913856s" totalImagesPullingTime="2.232866063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:45.192798339 +0000 UTC m=+344.821905850" watchObservedRunningTime="2026-07-12 00:02:45.193913856 +0000 UTC m=+344.823021355"
Jul 12 00:02:45.519571 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.519455    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:45.619902 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.619860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:45.694077 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.694024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:45.849301 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.849268    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:45.990251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:45.990214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:46.168734 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:46.168659    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-svb77"
Jul 12 00:02:46.197151 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:46.197116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:46.343057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:46.343024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:02:46.549923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:02:46.549879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:03:35.686750 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:03:35.686709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:03:35.787151 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:03:35.787123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:03:35.901362 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:03:35.901331    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:03:36.629968 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:03:36.629934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:03:36.833125 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:03:36.833092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:03:46.737084 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:03:46.737034    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:03.914587 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:03.914553    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:08.225266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.225228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:08.853523 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.853496    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"]
Jul 12 00:04:08.856493 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.856476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:08.859018 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.858998    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 00:04:08.859129 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.859046    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gtxcj\""
Jul 12 00:04:08.859129 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.859079    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 00:04:08.868611 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.868585    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"]
Jul 12 00:04:08.902835 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.902807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/798eacf1-9d43-487b-8abf-ec1050729ed5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:08.902940 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:08.902856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtzbq\" (UniqueName: \"kubernetes.io/projected/798eacf1-9d43-487b-8abf-ec1050729ed5-kube-api-access-qtzbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:09.003825 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.003791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtzbq\" (UniqueName: \"kubernetes.io/projected/798eacf1-9d43-487b-8abf-ec1050729ed5-kube-api-access-qtzbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:09.003962 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.003864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/798eacf1-9d43-487b-8abf-ec1050729ed5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:09.004197 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.004180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/798eacf1-9d43-487b-8abf-ec1050729ed5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:09.014134 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.014111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtzbq\" (UniqueName: \"kubernetes.io/projected/798eacf1-9d43-487b-8abf-ec1050729ed5-kube-api-access-qtzbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:09.165711 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.165632    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:09.303490 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.303460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"]
Jul 12 00:04:09.307108 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:04:09.307073    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798eacf1_9d43_487b_8abf_ec1050729ed5.slice/crio-e53cec5b21ec443d4b83bb558b2ce42372436206ccd8906c9ff411efe0260ea8 WatchSource:0}: Error finding container e53cec5b21ec443d4b83bb558b2ce42372436206ccd8906c9ff411efe0260ea8: Status 404 returned error can't find the container with id e53cec5b21ec443d4b83bb558b2ce42372436206ccd8906c9ff411efe0260ea8
Jul 12 00:04:09.458328 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.458248    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx" event={"ID":"798eacf1-9d43-487b-8abf-ec1050729ed5","Type":"ContainerStarted","Data":"e53cec5b21ec443d4b83bb558b2ce42372436206ccd8906c9ff411efe0260ea8"}
Jul 12 00:04:09.519979 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:09.519950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:11.106169 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:11.106130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:11.340789 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:11.340738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:11.514115 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:11.514008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:11.619590 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:11.619548    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:14.061954 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.061922    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"]
Jul 12 00:04:14.065477 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.065448    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"
Jul 12 00:04:14.068546 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.068525    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fkpvz\""
Jul 12 00:04:14.074452 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.074430    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"]
Jul 12 00:04:14.148625 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.148591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84dzd\" (UniqueName: \"kubernetes.io/projected/b29fb729-3862-46b0-b5c7-2dfa8196f627-kube-api-access-84dzd\") pod \"authorino-operator-75cc8d5cb7-2csdf\" (UID: \"b29fb729-3862-46b0-b5c7-2dfa8196f627\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"
Jul 12 00:04:14.249020 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.248985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84dzd\" (UniqueName: \"kubernetes.io/projected/b29fb729-3862-46b0-b5c7-2dfa8196f627-kube-api-access-84dzd\") pod \"authorino-operator-75cc8d5cb7-2csdf\" (UID: \"b29fb729-3862-46b0-b5c7-2dfa8196f627\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"
Jul 12 00:04:14.257688 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.257655    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84dzd\" (UniqueName: \"kubernetes.io/projected/b29fb729-3862-46b0-b5c7-2dfa8196f627-kube-api-access-84dzd\") pod \"authorino-operator-75cc8d5cb7-2csdf\" (UID: \"b29fb729-3862-46b0-b5c7-2dfa8196f627\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"
Jul 12 00:04:14.378804 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.378701    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"
Jul 12 00:04:14.551224 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.551188    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:14.724803 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.724727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:14.860844 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:14.860817    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"]
Jul 12 00:04:14.864122 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:04:14.864096    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29fb729_3862_46b0_b5c7_2dfa8196f627.slice/crio-cbeddc6ecb7a4737c5508e7beb2c78b70fcc86433813a6d5c817f30e1c293ab4 WatchSource:0}: Error finding container cbeddc6ecb7a4737c5508e7beb2c78b70fcc86433813a6d5c817f30e1c293ab4: Status 404 returned error can't find the container with id cbeddc6ecb7a4737c5508e7beb2c78b70fcc86433813a6d5c817f30e1c293ab4
Jul 12 00:04:15.484864 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:15.484753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx" event={"ID":"798eacf1-9d43-487b-8abf-ec1050729ed5","Type":"ContainerStarted","Data":"26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1"}
Jul 12 00:04:15.485294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:15.484898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:15.485950 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:15.485925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf" event={"ID":"b29fb729-3862-46b0-b5c7-2dfa8196f627","Type":"ContainerStarted","Data":"cbeddc6ecb7a4737c5508e7beb2c78b70fcc86433813a6d5c817f30e1c293ab4"}
Jul 12 00:04:15.511047 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:15.511006    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx" podStartSLOduration=2.041385876 podStartE2EDuration="7.510992694s" totalImagesPullingTime="5.469606818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:15.509492132 +0000 UTC m=+435.138599652" watchObservedRunningTime="2026-07-12 00:04:15.510992694 +0000 UTC m=+435.140100203"
Jul 12 00:04:17.387908 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:17.387879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:17.495970 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:17.495934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf" event={"ID":"b29fb729-3862-46b0-b5c7-2dfa8196f627","Type":"ContainerStarted","Data":"060ed0da9afad7c4fff0b95852ea802af21856748740b1be87cdf4261bd32e36"}
Jul 12 00:04:17.496128 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:17.496014    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"
Jul 12 00:04:17.521404 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:17.521350    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf" podStartSLOduration=1.054255799 podStartE2EDuration="3.521336793s" totalImagesPullingTime="2.467080994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:17.519367685 +0000 UTC m=+437.148475207" watchObservedRunningTime="2026-07-12 00:04:17.521336793 +0000 UTC m=+437.150444303"
Jul 12 00:04:17.855240 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:17.855202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:18.137560 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:18.137471    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:19.146177 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:19.146139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:19.200801 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:19.200740    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:26.493195 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:26.493119    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:26.740637 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:26.740599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:26.841282 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:26.841239    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:28.254876 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.254838    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"]
Jul 12 00:04:28.255334 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.255061    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" containerName="manager" containerID="cri-o://26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1" gracePeriod=2
Jul 12 00:04:28.274711 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:04:28.274679    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"798eacf1-9d43-487b-8abf-ec1050729ed5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-h94fx\": pods \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:28.276919 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.276897    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"]
Jul 12 00:04:28.285186 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.285147    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"]
Jul 12 00:04:28.285429 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.285417    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" containerName="manager"
Jul 12 00:04:28.285491 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.285431    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" containerName="manager"
Jul 12 00:04:28.285491 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.285481    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" containerName="manager"
Jul 12 00:04:28.288383 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.288356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.290656 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:04:28.290624    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" is forbidden: User \"system:node:ip-10-0-142-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-235.ec2.internal' and this object" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:28.302189 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.302164    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"]
Jul 12 00:04:28.362648 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.362620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/927f9360-779c-42f8-b6b9-d61b4e1838a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg85g\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.362789 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.362674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn5jg\" (UniqueName: \"kubernetes.io/projected/927f9360-779c-42f8-b6b9-d61b4e1838a2-kube-api-access-sn5jg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg85g\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.463223 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.463192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/927f9360-779c-42f8-b6b9-d61b4e1838a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg85g\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.463374 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.463257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5jg\" (UniqueName: \"kubernetes.io/projected/927f9360-779c-42f8-b6b9-d61b4e1838a2-kube-api-access-sn5jg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg85g\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.463592 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.463573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/927f9360-779c-42f8-b6b9-d61b4e1838a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg85g\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.476288 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.476263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5jg\" (UniqueName: \"kubernetes.io/projected/927f9360-779c-42f8-b6b9-d61b4e1838a2-kube-api-access-sn5jg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg85g\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.490927 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.490905    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:28.494011 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:04:28.493984    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" is forbidden: User \"system:node:ip-10-0-142-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-235.ec2.internal' and this object" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:28.502309 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.502290    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2csdf"
Jul 12 00:04:28.504615 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:04:28.504593    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" is forbidden: User \"system:node:ip-10-0-142-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-235.ec2.internal' and this object" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:28.539869 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.539843    2582 generic.go:356] "Generic (PLEG): container finished" podID="798eacf1-9d43-487b-8abf-ec1050729ed5" containerID="26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1" exitCode=0
Jul 12 00:04:28.539986 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.539887    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:28.539986 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.539912    2582 scope.go:117] "RemoveContainer" containerID="26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1"
Jul 12 00:04:28.542522 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:04:28.542497    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h94fx\" is forbidden: User \"system:node:ip-10-0-142-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-235.ec2.internal' and this object" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h94fx"
Jul 12 00:04:28.548141 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.548125    2582 scope.go:117] "RemoveContainer" containerID="26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1"
Jul 12 00:04:28.548418 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:04:28.548396    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1\": container with ID starting with 26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1 not found: ID does not exist" containerID="26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1"
Jul 12 00:04:28.548496 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.548425    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1"} err="failed to get container status \"26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1\": rpc error: code = NotFound desc = could not find container \"26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1\": container with ID starting with 26c4dcc33c971f28d78d48b38d7c58fb2ea6744cb800c27c51d1ee0d3cf44ac1 not found: ID does not exist"
Jul 12 00:04:28.563672 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.563652    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/798eacf1-9d43-487b-8abf-ec1050729ed5-extensions-socket-volume\") pod \"798eacf1-9d43-487b-8abf-ec1050729ed5\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") "
Jul 12 00:04:28.563795 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.563780    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtzbq\" (UniqueName: \"kubernetes.io/projected/798eacf1-9d43-487b-8abf-ec1050729ed5-kube-api-access-qtzbq\") pod \"798eacf1-9d43-487b-8abf-ec1050729ed5\" (UID: \"798eacf1-9d43-487b-8abf-ec1050729ed5\") "
Jul 12 00:04:28.564185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.564152    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/798eacf1-9d43-487b-8abf-ec1050729ed5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "798eacf1-9d43-487b-8abf-ec1050729ed5" (UID: "798eacf1-9d43-487b-8abf-ec1050729ed5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:04:28.565869 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.565844    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/798eacf1-9d43-487b-8abf-ec1050729ed5-kube-api-access-qtzbq" (OuterVolumeSpecName: "kube-api-access-qtzbq") pod "798eacf1-9d43-487b-8abf-ec1050729ed5" (UID: "798eacf1-9d43-487b-8abf-ec1050729ed5"). InnerVolumeSpecName "kube-api-access-qtzbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:04:28.638117 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.638089    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:28.664651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.664625    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtzbq\" (UniqueName: \"kubernetes.io/projected/798eacf1-9d43-487b-8abf-ec1050729ed5-kube-api-access-qtzbq\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:04:28.664651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.664651    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/798eacf1-9d43-487b-8abf-ec1050729ed5-extensions-socket-volume\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:04:28.763065 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.763042    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"]
Jul 12 00:04:28.765442 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:04:28.765418    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927f9360_779c_42f8_b6b9_d61b4e1838a2.slice/crio-0bcc287901a79c940c9f8e1f0982e18ac2deb2ac26401225019c1f68214cb592 WatchSource:0}: Error finding container 0bcc287901a79c940c9f8e1f0982e18ac2deb2ac26401225019c1f68214cb592: Status 404 returned error can't find the container with id 0bcc287901a79c940c9f8e1f0982e18ac2deb2ac26401225019c1f68214cb592
Jul 12 00:04:28.846936 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:28.846899    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="798eacf1-9d43-487b-8abf-ec1050729ed5" path="/var/lib/kubelet/pods/798eacf1-9d43-487b-8abf-ec1050729ed5/volumes"
Jul 12 00:04:29.546126 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:29.546091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g" event={"ID":"927f9360-779c-42f8-b6b9-d61b4e1838a2","Type":"ContainerStarted","Data":"5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6"}
Jul 12 00:04:29.546528 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:29.546142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g" event={"ID":"927f9360-779c-42f8-b6b9-d61b4e1838a2","Type":"ContainerStarted","Data":"0bcc287901a79c940c9f8e1f0982e18ac2deb2ac26401225019c1f68214cb592"}
Jul 12 00:04:29.546528 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:29.546249    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:29.570408 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:29.570354    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g" podStartSLOduration=1.5703364149999999 podStartE2EDuration="1.570336415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:29.568657732 +0000 UTC m=+449.197765262" watchObservedRunningTime="2026-07-12 00:04:29.570336415 +0000 UTC m=+449.199443925"
Jul 12 00:04:31.544798 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:31.544747    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:31.652251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:31.652215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:33.962069 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:33.962032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:34.017752 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:34.017714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:39.533308 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:39.533274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:39.585804 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:39.585775    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:40.552656 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:40.552628    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:44.357091 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.355353    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"]
Jul 12 00:04:44.357091 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.355662    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g" podUID="927f9360-779c-42f8-b6b9-d61b4e1838a2" containerName="manager" containerID="cri-o://5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6" gracePeriod=10
Jul 12 00:04:44.599503 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.599481    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:44.611235 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.611186    2582 generic.go:356] "Generic (PLEG): container finished" podID="927f9360-779c-42f8-b6b9-d61b4e1838a2" containerID="5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6" exitCode=0
Jul 12 00:04:44.611235 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.611221    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"
Jul 12 00:04:44.611400 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.611268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g" event={"ID":"927f9360-779c-42f8-b6b9-d61b4e1838a2","Type":"ContainerDied","Data":"5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6"}
Jul 12 00:04:44.611400 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.611329    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g" event={"ID":"927f9360-779c-42f8-b6b9-d61b4e1838a2","Type":"ContainerDied","Data":"0bcc287901a79c940c9f8e1f0982e18ac2deb2ac26401225019c1f68214cb592"}
Jul 12 00:04:44.611400 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.611359    2582 scope.go:117] "RemoveContainer" containerID="5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6"
Jul 12 00:04:44.615441 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.615421    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"]
Jul 12 00:04:44.615791 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.615752    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="927f9360-779c-42f8-b6b9-d61b4e1838a2" containerName="manager"
Jul 12 00:04:44.615882 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.615793    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="927f9360-779c-42f8-b6b9-d61b4e1838a2" containerName="manager"
Jul 12 00:04:44.615882 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.615870    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="927f9360-779c-42f8-b6b9-d61b4e1838a2" containerName="manager"
Jul 12 00:04:44.617835 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.617813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.619951 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.619936    2582 scope.go:117] "RemoveContainer" containerID="5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6"
Jul 12 00:04:44.620243 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:04:44.620225    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6\": container with ID starting with 5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6 not found: ID does not exist" containerID="5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6"
Jul 12 00:04:44.620299 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.620251    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6"} err="failed to get container status \"5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6\": rpc error: code = NotFound desc = could not find container \"5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6\": container with ID starting with 5fbb46a619268a43f1d4c756762d84035e7f7a05a2aadb95db0b72f88db991f6 not found: ID does not exist"
Jul 12 00:04:44.637059 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.637034    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"]
Jul 12 00:04:44.686930 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.686903    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn5jg\" (UniqueName: \"kubernetes.io/projected/927f9360-779c-42f8-b6b9-d61b4e1838a2-kube-api-access-sn5jg\") pod \"927f9360-779c-42f8-b6b9-d61b4e1838a2\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") "
Jul 12 00:04:44.687089 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.686950    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/927f9360-779c-42f8-b6b9-d61b4e1838a2-extensions-socket-volume\") pod \"927f9360-779c-42f8-b6b9-d61b4e1838a2\" (UID: \"927f9360-779c-42f8-b6b9-d61b4e1838a2\") "
Jul 12 00:04:44.687136 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.687104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd5b1a8e-fa62-440d-8e58-6fee1f498445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qd26m\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.687192 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.687162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvcq\" (UniqueName: \"kubernetes.io/projected/cd5b1a8e-fa62-440d-8e58-6fee1f498445-kube-api-access-xwvcq\") pod \"kuadrant-operator-controller-manager-86878c769f-qd26m\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.687377 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.687352    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/927f9360-779c-42f8-b6b9-d61b4e1838a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "927f9360-779c-42f8-b6b9-d61b4e1838a2" (UID: "927f9360-779c-42f8-b6b9-d61b4e1838a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:04:44.689021 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.688989    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/927f9360-779c-42f8-b6b9-d61b4e1838a2-kube-api-access-sn5jg" (OuterVolumeSpecName: "kube-api-access-sn5jg") pod "927f9360-779c-42f8-b6b9-d61b4e1838a2" (UID: "927f9360-779c-42f8-b6b9-d61b4e1838a2"). InnerVolumeSpecName "kube-api-access-sn5jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:04:44.787888 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.787855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd5b1a8e-fa62-440d-8e58-6fee1f498445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qd26m\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.788043 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.787899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvcq\" (UniqueName: \"kubernetes.io/projected/cd5b1a8e-fa62-440d-8e58-6fee1f498445-kube-api-access-xwvcq\") pod \"kuadrant-operator-controller-manager-86878c769f-qd26m\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.788043 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.787957    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn5jg\" (UniqueName: \"kubernetes.io/projected/927f9360-779c-42f8-b6b9-d61b4e1838a2-kube-api-access-sn5jg\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:04:44.788043 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.787968    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/927f9360-779c-42f8-b6b9-d61b4e1838a2-extensions-socket-volume\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:04:44.788229 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.788208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd5b1a8e-fa62-440d-8e58-6fee1f498445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qd26m\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.796721 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.796695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvcq\" (UniqueName: \"kubernetes.io/projected/cd5b1a8e-fa62-440d-8e58-6fee1f498445-kube-api-access-xwvcq\") pod \"kuadrant-operator-controller-manager-86878c769f-qd26m\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.926788 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.926700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:44.935563 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.935540    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"]
Jul 12 00:04:44.939147 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:44.939126    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg85g"]
Jul 12 00:04:45.051551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:45.051528    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"]
Jul 12 00:04:45.053544 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:04:45.053520    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5b1a8e_fa62_440d_8e58_6fee1f498445.slice/crio-6a8994a5a2b920748e491725f6d42943cde46166ca436a741ed61ade045ef653 WatchSource:0}: Error finding container 6a8994a5a2b920748e491725f6d42943cde46166ca436a741ed61ade045ef653: Status 404 returned error can't find the container with id 6a8994a5a2b920748e491725f6d42943cde46166ca436a741ed61ade045ef653
Jul 12 00:04:45.620371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:45.620336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m" event={"ID":"cd5b1a8e-fa62-440d-8e58-6fee1f498445","Type":"ContainerStarted","Data":"a55317af3a3d4d35b4c0853e69117939401e1a048bb5fc4e3651cac682243841"}
Jul 12 00:04:45.620806 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:45.620390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m" event={"ID":"cd5b1a8e-fa62-440d-8e58-6fee1f498445","Type":"ContainerStarted","Data":"6a8994a5a2b920748e491725f6d42943cde46166ca436a741ed61ade045ef653"}
Jul 12 00:04:45.620806 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:45.620452    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:45.644431 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:45.644378    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m" podStartSLOduration=1.6443615 podStartE2EDuration="1.6443615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:45.641971147 +0000 UTC m=+465.271078675" watchObservedRunningTime="2026-07-12 00:04:45.6443615 +0000 UTC m=+465.273469009"
Jul 12 00:04:46.344528 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:46.344492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:46.444912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:46.444880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:46.843679 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:46.843645    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="927f9360-779c-42f8-b6b9-d61b4e1838a2" path="/var/lib/kubelet/pods/927f9360-779c-42f8-b6b9-d61b4e1838a2/volumes"
Jul 12 00:04:50.662175 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:50.662139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:50.762987 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:50.762931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:50.862576 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:50.862535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:51.138664 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:51.138599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:51.245977 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:51.245935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:51.427671 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:51.427588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:51.493615 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:51.493580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:53.566195 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:53.566160    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:53.619094 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:53.619058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:56.626748 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:56.626715    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:04:59.336626 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:59.336588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:04:59.393389 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:04:59.393362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:00.818472 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:00.818431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:00.919085 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:00.919050    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:01.679716 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:01.679671    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:01.781113 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:01.781073    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:01.829229 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:01.829193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:07.133705 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:07.133660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:07.233723 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:07.233680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:11.546141 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:11.546103    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:11.645017 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:11.644985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:14.004004 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.003946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:14.104257 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.104214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:14.456596 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.456556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:14.568679 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.568651    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:14.622989 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.622958    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:14.762009 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.761927    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:05:14.766905 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.766883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:14.769397 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.769375    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-82w8r\""
Jul 12 00:05:14.769513 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.769401    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 12 00:05:14.773276 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.773246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:05:14.799683 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.799660    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:05:14.819369 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.819347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82sv5\" (UniqueName: \"kubernetes.io/projected/5153660f-3647-49b0-9327-084457e1e118-kube-api-access-82sv5\") pod \"limitador-limitador-54d6d988d5-dcrgg\" (UID: \"5153660f-3647-49b0-9327-084457e1e118\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:14.819449 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.819387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5153660f-3647-49b0-9327-084457e1e118-config-file\") pod \"limitador-limitador-54d6d988d5-dcrgg\" (UID: \"5153660f-3647-49b0-9327-084457e1e118\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:14.920229 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.920192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82sv5\" (UniqueName: \"kubernetes.io/projected/5153660f-3647-49b0-9327-084457e1e118-kube-api-access-82sv5\") pod \"limitador-limitador-54d6d988d5-dcrgg\" (UID: \"5153660f-3647-49b0-9327-084457e1e118\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:14.920383 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.920265    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5153660f-3647-49b0-9327-084457e1e118-config-file\") pod \"limitador-limitador-54d6d988d5-dcrgg\" (UID: \"5153660f-3647-49b0-9327-084457e1e118\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:14.920924 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.920906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5153660f-3647-49b0-9327-084457e1e118-config-file\") pod \"limitador-limitador-54d6d988d5-dcrgg\" (UID: \"5153660f-3647-49b0-9327-084457e1e118\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:14.928151 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:14.928125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82sv5\" (UniqueName: \"kubernetes.io/projected/5153660f-3647-49b0-9327-084457e1e118-kube-api-access-82sv5\") pod \"limitador-limitador-54d6d988d5-dcrgg\" (UID: \"5153660f-3647-49b0-9327-084457e1e118\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:15.078864 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:15.078830    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:15.202971 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:15.202949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:05:15.205434 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:05:15.205408    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5153660f_3647_49b0_9327_084457e1e118.slice/crio-f574d5e61a6c543cfdee5d207a7d5868d1d62c6b8a5f41839546dac95502b13f WatchSource:0}: Error finding container f574d5e61a6c543cfdee5d207a7d5868d1d62c6b8a5f41839546dac95502b13f: Status 404 returned error can't find the container with id f574d5e61a6c543cfdee5d207a7d5868d1d62c6b8a5f41839546dac95502b13f
Jul 12 00:05:15.264862 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:15.264825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:15.320639 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:15.320610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:15.741922 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:15.741834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg" event={"ID":"5153660f-3647-49b0-9327-084457e1e118","Type":"ContainerStarted","Data":"f574d5e61a6c543cfdee5d207a7d5868d1d62c6b8a5f41839546dac95502b13f"}
Jul 12 00:05:17.753032 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:17.753000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg" event={"ID":"5153660f-3647-49b0-9327-084457e1e118","Type":"ContainerStarted","Data":"7bcf55f6df1d820a13e8c089fe84aad7d86bde102a18228cc672be4b9ddfd3a5"}
Jul 12 00:05:17.753398 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:17.753068    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:17.769338 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:17.769295    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg" podStartSLOduration=1.401597675 podStartE2EDuration="3.769281064s" totalImagesPullingTime="2.367683389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:17.768789576 +0000 UTC m=+497.397897084" watchObservedRunningTime="2026-07-12 00:05:17.769281064 +0000 UTC m=+497.398388573"
Jul 12 00:05:27.520108 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:27.520064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:28.757671 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:28.757644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"
Jul 12 00:05:34.147567 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:34.147537    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:34.246375 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:34.246346    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:34.689544 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:34.689513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:46.998016 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:46.997979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:47.098433 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:47.098394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:53.595944 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:53.595857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:53.695787 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:53.695720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:53.765952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:53.765914    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:54.170457 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:54.170425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:57.021626 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:57.021591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:57.105547 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:57.105514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:59.355174 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:59.355135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:05:59.456075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:05:59.456043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:12.604110 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:12.604072    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:12.704420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:12.704381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:28.642512 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:28.642474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:28.742217 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:28.742181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:29.198148 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:29.198113    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:29.499521 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:29.499448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:29.599595 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:29.599562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:29.673251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:29.673213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:29.758972 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:29.758894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:06:39.927207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:39.927171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:06:40.026465 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:06:40.026430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:02.691218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:02.691176    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:03.078221 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:03.078190    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:07:11.360711 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:11.360675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:11.989443 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:11.989408    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:07:20.220502 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.220466    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"]
Jul 12 00:07:20.224041 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.224018    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.227553 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.227529    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 12 00:07:20.227697 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.227624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 00:07:20.227697 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.227624    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-czsp5\""
Jul 12 00:07:20.227819 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.227703    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 00:07:20.233833 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.233813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"]
Jul 12 00:07:20.251500 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.251442    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:20.278627 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.278603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.278740 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.278637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.278740 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.278662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.278874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.278785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.278874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.278826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22af979c-430a-461e-8796-e95bb7a320e8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.278874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.278862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sbfn\" (UniqueName: \"kubernetes.io/projected/22af979c-430a-461e-8796-e95bb7a320e8-kube-api-access-6sbfn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.379745 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.379711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sbfn\" (UniqueName: \"kubernetes.io/projected/22af979c-430a-461e-8796-e95bb7a320e8-kube-api-access-6sbfn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.379937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.379776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.379937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.379814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.379937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.379841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.379937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.379878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.379937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.379902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22af979c-430a-461e-8796-e95bb7a320e8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.380233 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.380212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.380299 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.380273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.380299 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.380288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.382218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.382196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22af979c-430a-461e-8796-e95bb7a320e8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.382455 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.382437    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22af979c-430a-461e-8796-e95bb7a320e8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.387497 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.387475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sbfn\" (UniqueName: \"kubernetes.io/projected/22af979c-430a-461e-8796-e95bb7a320e8-kube-api-access-6sbfn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7hjq\" (UID: \"22af979c-430a-461e-8796-e95bb7a320e8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.411416 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.411381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:20.467648 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.467619    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:20.534299 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.534209    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:20.663036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.663012    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"]
Jul 12 00:07:20.665170 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:07:20.665141    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22af979c_430a_461e_8796_e95bb7a320e8.slice/crio-f6c7a30ef00eff9e4a7ec253ea60c24665dcd0e919d079a0c852d45a64b11955 WatchSource:0}: Error finding container f6c7a30ef00eff9e4a7ec253ea60c24665dcd0e919d079a0c852d45a64b11955: Status 404 returned error can't find the container with id f6c7a30ef00eff9e4a7ec253ea60c24665dcd0e919d079a0c852d45a64b11955
Jul 12 00:07:20.666420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:20.666402    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:07:21.231788 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:21.231742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq" event={"ID":"22af979c-430a-461e-8796-e95bb7a320e8","Type":"ContainerStarted","Data":"f6c7a30ef00eff9e4a7ec253ea60c24665dcd0e919d079a0c852d45a64b11955"}
Jul 12 00:07:21.484688 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:21.484599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:07:23.241723 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:23.241690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq" event={"ID":"22af979c-430a-461e-8796-e95bb7a320e8","Type":"ContainerStarted","Data":"5592e3a5cfcc015547c0c9ad78cb53d37504993617fbb9cb7e105ed2649d15b4"}
Jul 12 00:07:23.258855 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:23.258812    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq" podStartSLOduration=0.883013575 podStartE2EDuration="3.25879591s" totalImagesPullingTime="2.375782335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:07:23.257840451 +0000 UTC m=+622.886947961" watchObservedRunningTime="2026-07-12 00:07:23.25879591 +0000 UTC m=+622.887903421"
Jul 12 00:07:30.534928 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:30.534894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:30.535374 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:30.534954    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:30.551736 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:30.551709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:31.284270 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:31.284235    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7hjq"
Jul 12 00:07:32.259717 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:32.259683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:33.784444 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:33.784411    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:07:36.051325 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:36.051282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:42.284510 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:42.284466    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:07:43.750404 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:43.750348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:07:51.390287 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:07:51.390243    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:08:12.084894 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:08:12.084855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:08:19.225251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:08:19.225214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:09:06.571949 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:09:06.571870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:09:06.671251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:09:06.671215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:09:07.735640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:09:07.735605    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:09:07.836568 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:09:07.836530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:09:42.283517 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:09:42.283484    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:09:52.301501 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:09:52.301467    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:10:02.790381 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:10:02.790347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:10:13.384091 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:10:13.384056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:10:23.589439 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:10:23.589362    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:10:26.154706 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:10:26.154668    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:10:28.173580 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:10:28.173549    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:10:52.084073 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:10:52.084043    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:11:03.881616 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:03.881583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:11:07.982533 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:07.982494    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:08.072539 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:08.072485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:08.195981 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:08.195948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:13.988912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:13.988866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:14.059699 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:14.059660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:14.131708 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:14.131675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:14.231472 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:14.231440    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:14.354808 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:14.354769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:19.913773 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:19.913734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:19.963243 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:19.963205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:11:36.189494 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:36.189456    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:11:46.391868 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:46.391834    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:11:57.085322 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:11:57.085242    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:12:03.076355 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:12:03.076316    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:12:14.479121 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:12:14.479075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:12:25.787049 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:12:25.787011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:12:36.487199 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:12:36.487165    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:12:46.179517 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:12:46.179486    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:13:09.386116 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:13:09.386082    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:13:18.580994 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:13:18.580961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:13:35.757140 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:13:35.757064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:13:41.598331 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:13:41.598295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:13:53.682853 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:13:53.682812    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:14:09.884508 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:14:09.884474    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:14:14.904319 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:14:14.904273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:14:15.004412 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:14:15.004380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:14:19.088351 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:14:19.088316    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:14:28.291046 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:14:28.291011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:14:37.683236 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:14:37.683201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:14:46.880917 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:14:46.880885    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:15:00.138941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:00.138854    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd"]
Jul 12 00:15:00.146155 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:00.146133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd"
Jul 12 00:15:00.148887 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:00.148859    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:15:00.154654 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:00.154631    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd"]
Jul 12 00:15:00.155888 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:00.155868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd"
Jul 12 00:15:00.282051 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:00.282026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd"]
Jul 12 00:15:00.284340 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:15:00.284314    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68508936_c38b_4bd6_b2ce_cf46e8d8c183.slice/crio-15df4682922dcc82185a1e7f90326b069f732017d3a3d8c294bcdef313e80b5b WatchSource:0}: Error finding container 15df4682922dcc82185a1e7f90326b069f732017d3a3d8c294bcdef313e80b5b: Status 404 returned error can't find the container with id 15df4682922dcc82185a1e7f90326b069f732017d3a3d8c294bcdef313e80b5b
Jul 12 00:15:00.286046 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:00.286029    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:15:01.068964 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:01.068927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd" event={"ID":"68508936-c38b-4bd6-b2ce-cf46e8d8c183","Type":"ContainerStarted","Data":"15df4682922dcc82185a1e7f90326b069f732017d3a3d8c294bcdef313e80b5b"}
Jul 12 00:15:03.080697 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:03.080665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd" event={"ID":"68508936-c38b-4bd6-b2ce-cf46e8d8c183","Type":"ContainerStarted","Data":"616d8c92fd194bd0234308adc68aac68df4d230356f3cb98c42a0e8d4f92d1d4"}
Jul 12 00:15:03.101982 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:03.101934    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd" podStartSLOduration=0.526386984 podStartE2EDuration="3.101919278s" totalImagesPullingTime="2.575532294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:15:03.094150366 +0000 UTC m=+1082.723257878" watchObservedRunningTime="2026-07-12 00:15:03.101919278 +0000 UTC m=+1082.731026787"
Jul 12 00:15:04.086431 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:04.086397    2582 generic.go:356] "Generic (PLEG): container finished" podID="68508936-c38b-4bd6-b2ce-cf46e8d8c183" containerID="616d8c92fd194bd0234308adc68aac68df4d230356f3cb98c42a0e8d4f92d1d4" exitCode=0
Jul 12 00:15:04.086801 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:04.086473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd" event={"ID":"68508936-c38b-4bd6-b2ce-cf46e8d8c183","Type":"ContainerDied","Data":"616d8c92fd194bd0234308adc68aac68df4d230356f3cb98c42a0e8d4f92d1d4"}
Jul 12 00:15:05.220034 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:05.220005    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd"
Jul 12 00:15:06.095578 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:06.095538    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd" event={"ID":"68508936-c38b-4bd6-b2ce-cf46e8d8c183","Type":"ContainerDied","Data":"15df4682922dcc82185a1e7f90326b069f732017d3a3d8c294bcdef313e80b5b"}
Jul 12 00:15:06.095791 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:06.095591    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15df4682922dcc82185a1e7f90326b069f732017d3a3d8c294bcdef313e80b5b"
Jul 12 00:15:06.095791 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:06.095545    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730255-wgrmd"
Jul 12 00:15:13.719444 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:13.719412    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"]
Jul 12 00:15:13.719863 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:13.719598    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m" podUID="cd5b1a8e-fa62-440d-8e58-6fee1f498445" containerName="manager" containerID="cri-o://a55317af3a3d4d35b4c0853e69117939401e1a048bb5fc4e3651cac682243841" gracePeriod=10
Jul 12 00:15:17.140929 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.140894    2582 generic.go:356] "Generic (PLEG): container finished" podID="cd5b1a8e-fa62-440d-8e58-6fee1f498445" containerID="a55317af3a3d4d35b4c0853e69117939401e1a048bb5fc4e3651cac682243841" exitCode=0
Jul 12 00:15:17.141292 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.140956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m" event={"ID":"cd5b1a8e-fa62-440d-8e58-6fee1f498445","Type":"ContainerDied","Data":"a55317af3a3d4d35b4c0853e69117939401e1a048bb5fc4e3651cac682243841"}
Jul 12 00:15:17.367829 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.367801    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:15:17.451518 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.451437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd5b1a8e-fa62-440d-8e58-6fee1f498445-extensions-socket-volume\") pod \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") "
Jul 12 00:15:17.451648 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.451542    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwvcq\" (UniqueName: \"kubernetes.io/projected/cd5b1a8e-fa62-440d-8e58-6fee1f498445-kube-api-access-xwvcq\") pod \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\" (UID: \"cd5b1a8e-fa62-440d-8e58-6fee1f498445\") "
Jul 12 00:15:17.451822 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.451798    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd5b1a8e-fa62-440d-8e58-6fee1f498445-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cd5b1a8e-fa62-440d-8e58-6fee1f498445" (UID: "cd5b1a8e-fa62-440d-8e58-6fee1f498445"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:15:17.453509 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.453491    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd5b1a8e-fa62-440d-8e58-6fee1f498445-kube-api-access-xwvcq" (OuterVolumeSpecName: "kube-api-access-xwvcq") pod "cd5b1a8e-fa62-440d-8e58-6fee1f498445" (UID: "cd5b1a8e-fa62-440d-8e58-6fee1f498445"). InnerVolumeSpecName "kube-api-access-xwvcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:15:17.552393 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.552348    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwvcq\" (UniqueName: \"kubernetes.io/projected/cd5b1a8e-fa62-440d-8e58-6fee1f498445-kube-api-access-xwvcq\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:15:17.552393 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:17.552387    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd5b1a8e-fa62-440d-8e58-6fee1f498445-extensions-socket-volume\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:15:18.145564 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:18.145528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m" event={"ID":"cd5b1a8e-fa62-440d-8e58-6fee1f498445","Type":"ContainerDied","Data":"6a8994a5a2b920748e491725f6d42943cde46166ca436a741ed61ade045ef653"}
Jul 12 00:15:18.146001 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:18.145586    2582 scope.go:117] "RemoveContainer" containerID="a55317af3a3d4d35b4c0853e69117939401e1a048bb5fc4e3651cac682243841"
Jul 12 00:15:18.146001 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:18.145537    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"
Jul 12 00:15:18.168340 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:18.168318    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"]
Jul 12 00:15:18.171207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:18.171187    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qd26m"]
Jul 12 00:15:18.844237 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:18.844201    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd5b1a8e-fa62-440d-8e58-6fee1f498445" path="/var/lib/kubelet/pods/cd5b1a8e-fa62-440d-8e58-6fee1f498445/volumes"
Jul 12 00:15:36.253296 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:36.253245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:15:36.353150 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:15:36.353116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:16:14.995915 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:14.995878    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"]
Jul 12 00:16:14.996323 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:14.996133    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68508936-c38b-4bd6-b2ce-cf46e8d8c183" containerName="cleanup"
Jul 12 00:16:14.996323 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:14.996154    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68508936-c38b-4bd6-b2ce-cf46e8d8c183" containerName="cleanup"
Jul 12 00:16:14.996323 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:14.996173    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5b1a8e-fa62-440d-8e58-6fee1f498445" containerName="manager"
Jul 12 00:16:14.996323 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:14.996178    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5b1a8e-fa62-440d-8e58-6fee1f498445" containerName="manager"
Jul 12 00:16:14.996323 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:14.996228    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68508936-c38b-4bd6-b2ce-cf46e8d8c183" containerName="cleanup"
Jul 12 00:16:14.996323 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:14.996236    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd5b1a8e-fa62-440d-8e58-6fee1f498445" containerName="manager"
Jul 12 00:16:15.000271 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.000252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.003056 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.003037    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gtxcj\""
Jul 12 00:16:15.010947 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.010927    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"]
Jul 12 00:16:15.096658 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.096620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-892sn\" (UniqueName: \"kubernetes.io/projected/abe48adc-0b6f-40cd-b383-9fddeb43b175-kube-api-access-892sn\") pod \"kuadrant-operator-controller-manager-86878c769f-ppjc7\" (UID: \"abe48adc-0b6f-40cd-b383-9fddeb43b175\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.096850 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.096740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe48adc-0b6f-40cd-b383-9fddeb43b175-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ppjc7\" (UID: \"abe48adc-0b6f-40cd-b383-9fddeb43b175\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.197546 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.197513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe48adc-0b6f-40cd-b383-9fddeb43b175-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ppjc7\" (UID: \"abe48adc-0b6f-40cd-b383-9fddeb43b175\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.197694 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.197557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-892sn\" (UniqueName: \"kubernetes.io/projected/abe48adc-0b6f-40cd-b383-9fddeb43b175-kube-api-access-892sn\") pod \"kuadrant-operator-controller-manager-86878c769f-ppjc7\" (UID: \"abe48adc-0b6f-40cd-b383-9fddeb43b175\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.197923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.197902    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe48adc-0b6f-40cd-b383-9fddeb43b175-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ppjc7\" (UID: \"abe48adc-0b6f-40cd-b383-9fddeb43b175\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.205953 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.205932    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-892sn\" (UniqueName: \"kubernetes.io/projected/abe48adc-0b6f-40cd-b383-9fddeb43b175-kube-api-access-892sn\") pod \"kuadrant-operator-controller-manager-86878c769f-ppjc7\" (UID: \"abe48adc-0b6f-40cd-b383-9fddeb43b175\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.310203 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.310177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:15.456251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:15.456229    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"]
Jul 12 00:16:15.458446 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:16:15.458418    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe48adc_0b6f_40cd_b383_9fddeb43b175.slice/crio-7449b293e705a9476745e07fe0ebf4436c349dcad0501d1b1bfcd76b20848fb8 WatchSource:0}: Error finding container 7449b293e705a9476745e07fe0ebf4436c349dcad0501d1b1bfcd76b20848fb8: Status 404 returned error can't find the container with id 7449b293e705a9476745e07fe0ebf4436c349dcad0501d1b1bfcd76b20848fb8
Jul 12 00:16:16.384951 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:16.384913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7" event={"ID":"abe48adc-0b6f-40cd-b383-9fddeb43b175","Type":"ContainerStarted","Data":"60afe099959f1623c3b19c42e178bdc5958e77f73297d1a147e3a6b3edab1a49"}
Jul 12 00:16:16.385331 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:16.384996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7" event={"ID":"abe48adc-0b6f-40cd-b383-9fddeb43b175","Type":"ContainerStarted","Data":"7449b293e705a9476745e07fe0ebf4436c349dcad0501d1b1bfcd76b20848fb8"}
Jul 12 00:16:16.385331 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:16.385042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:16.406123 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:16.406073    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7" podStartSLOduration=2.406056827 podStartE2EDuration="2.406056827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:16:16.403706405 +0000 UTC m=+1156.032813939" watchObservedRunningTime="2026-07-12 00:16:16.406056827 +0000 UTC m=+1156.035164404"
Jul 12 00:16:27.391485 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:27.391411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ppjc7"
Jul 12 00:16:36.580087 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:36.580052    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:16:45.587504 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:45.587465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:16:58.581113 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:16:58.581079    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:17:09.888037 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:17:09.888001    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:17:20.584715 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:17:20.584679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:17:30.683647 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:17:30.683611    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:17:40.991350 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:17:40.991315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:17:51.379425 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:17:51.379393    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:18:02.579179 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:18:02.579104    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:18:11.578964 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:18:11.578927    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:18:22.281684 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:18:22.281648    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:18:46.688950 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:18:46.688911    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:18:54.378424 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:18:54.378389    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:19:03.990804 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:19:03.990768    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:19:13.776524 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:19:13.776493    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:19:32.380817 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:19:32.380714    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:19:41.683530 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:19:41.683495    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:19:51.688871 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:19:51.688840    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:20:01.997248 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:20:01.997215    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:20:17.482552 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:20:17.482514    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:20:25.478935 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:20:25.478892    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:20:34.485649 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:20:34.485616    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:20:43.980604 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:20:43.980571    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:20:53.187550 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:20:53.187466    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:21:03.678128 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:21:03.678094    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:21:15.780870 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:21:15.780831    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:21:25.884646 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:21:25.884610    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:21:37.782207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:21:37.782172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:21:41.850220 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:21:41.850176    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:21:49.390658 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:21:49.390619    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:21:58.577417 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:21:58.577384    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:22:01.231344 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:01.231301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:08.834072 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:08.834033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:12.083316 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:12.083280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:22:17.129152 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:17.129109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:21.588652 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:21.588613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:22:22.290681 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:22.290652    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:25.495014 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:25.494977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:25.588865 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:25.588830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:25.968589 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:25.968554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:31.477167 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:31.477130    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:22:31.779745 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:31.779656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:31.845510 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:31.845477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:31.992118 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:31.992085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:32.051822 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:32.051788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:33.087860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.087824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:33.183918 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.183882    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"]
Jul 12 00:22:33.185344 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.185314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:33.187414 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.187396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.190332 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.190312    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:22:33.190471 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.190315    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cb79ec53-serving-cert\""
Jul 12 00:22:33.191435 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.191416    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 00:22:33.191560 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.191440    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\""
Jul 12 00:22:33.196590 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.196567    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"]
Jul 12 00:22:33.249745 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.249711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:33.263812 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.263783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5fb\" (UniqueName: \"kubernetes.io/projected/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-kube-api-access-vn5fb\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.263952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.263821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.263952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.263905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-openshift-service-ca\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.365056 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.364958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-openshift-service-ca\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.365056 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.365024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5fb\" (UniqueName: \"kubernetes.io/projected/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-kube-api-access-vn5fb\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.365056 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.365050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.365332 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:22:33.365179    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-serving-cert: secret "maas-api-e2e-ait-cb79ec53-serving-cert" not found
Jul 12 00:22:33.365332 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:22:33.365256    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls podName:b58b4cb1-cdd6-43b5-94bd-14dc23e98db1 nodeName:}" failed. No retries permitted until 2026-07-12 00:22:33.865235221 +0000 UTC m=+1533.494342713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls") pod "maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw" (UID: "b58b4cb1-cdd6-43b5-94bd-14dc23e98db1") : secret "maas-api-e2e-ait-cb79ec53-serving-cert" not found
Jul 12 00:22:33.365685 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.365662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-openshift-service-ca\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.373629 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.373603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5fb\" (UniqueName: \"kubernetes.io/projected/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-kube-api-access-vn5fb\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.536962 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.536925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:33.636944 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.636854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:33.737694 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.737660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:33.869331 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.869298    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:33.871640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:33.871623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls\") pod \"maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:34.099447 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:34.099405    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:34.232428 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:34.232403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"]
Jul 12 00:22:34.234773 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:22:34.234728    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58b4cb1_cdd6_43b5_94bd_14dc23e98db1.slice/crio-ff8ded8964230168921a32471b62314ea5f2cf52a46f49e44e5fc7d53d7ac926 WatchSource:0}: Error finding container ff8ded8964230168921a32471b62314ea5f2cf52a46f49e44e5fc7d53d7ac926: Status 404 returned error can't find the container with id ff8ded8964230168921a32471b62314ea5f2cf52a46f49e44e5fc7d53d7ac926
Jul 12 00:22:34.236131 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:34.236110    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:22:34.922339 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:34.922296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw" event={"ID":"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1","Type":"ContainerStarted","Data":"ff8ded8964230168921a32471b62314ea5f2cf52a46f49e44e5fc7d53d7ac926"}
Jul 12 00:22:35.630486 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:35.630409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:22:36.934379 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:36.934293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw" event={"ID":"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1","Type":"ContainerStarted","Data":"8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358"}
Jul 12 00:22:36.934805 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:36.934419    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:36.952911 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:36.952862    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw" podStartSLOduration=1.536099674 podStartE2EDuration="3.952842161s" totalImagesPullingTime="2.416742487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:22:36.950658704 +0000 UTC m=+1536.579766216" watchObservedRunningTime="2026-07-12 00:22:36.952842161 +0000 UTC m=+1536.581949649"
Jul 12 00:22:38.245721 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.245682    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"]
Jul 12 00:22:38.249117 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.249097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"
Jul 12 00:22:38.251583 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.251568    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:22:38.254751 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.254726    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"]
Jul 12 00:22:38.412279 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.412243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a5a58a-f884-406d-a8a6-7b47d321da5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l\" (UID: \"a1a5a58a-f884-406d-a8a6-7b47d321da5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"
Jul 12 00:22:38.513805 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.513694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a5a58a-f884-406d-a8a6-7b47d321da5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l\" (UID: \"a1a5a58a-f884-406d-a8a6-7b47d321da5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"
Jul 12 00:22:38.514377 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.514353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a5a58a-f884-406d-a8a6-7b47d321da5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l\" (UID: \"a1a5a58a-f884-406d-a8a6-7b47d321da5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"
Jul 12 00:22:38.560173 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.560132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"
Jul 12 00:22:38.688553 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.688518    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"]
Jul 12 00:22:38.691447 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:22:38.691418    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a5a58a_f884_406d_a8a6_7b47d321da5a.slice/crio-b1ebae062cbf238e2639e02f30fee89981a68b26587689e7494834a21f9274bc WatchSource:0}: Error finding container b1ebae062cbf238e2639e02f30fee89981a68b26587689e7494834a21f9274bc: Status 404 returned error can't find the container with id b1ebae062cbf238e2639e02f30fee89981a68b26587689e7494834a21f9274bc
Jul 12 00:22:38.944732 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:38.944696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l" event={"ID":"a1a5a58a-f884-406d-a8a6-7b47d321da5a","Type":"ContainerStarted","Data":"b1ebae062cbf238e2639e02f30fee89981a68b26587689e7494834a21f9274bc"}
Jul 12 00:22:39.950589 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:39.950553    2582 generic.go:356] "Generic (PLEG): container finished" podID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerID="1176f73ff6410aa464f3c59480f71224e35ec61bbf43f3ff8a556b55fe45e7be" exitCode=7
Jul 12 00:22:39.950992 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:39.950625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l" event={"ID":"a1a5a58a-f884-406d-a8a6-7b47d321da5a","Type":"ContainerDied","Data":"1176f73ff6410aa464f3c59480f71224e35ec61bbf43f3ff8a556b55fe45e7be"}
Jul 12 00:22:39.950992 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:39.950855    2582 scope.go:117] "RemoveContainer" containerID="1176f73ff6410aa464f3c59480f71224e35ec61bbf43f3ff8a556b55fe45e7be"
Jul 12 00:22:40.956554 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:40.956461    2582 generic.go:356] "Generic (PLEG): container finished" podID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerID="e20b0684e84c889c27d9fb0a0606e6bfa6a4c4ecea1f53619f526d05c789fd8a" exitCode=7
Jul 12 00:22:40.956959 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:40.956543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l" event={"ID":"a1a5a58a-f884-406d-a8a6-7b47d321da5a","Type":"ContainerDied","Data":"e20b0684e84c889c27d9fb0a0606e6bfa6a4c4ecea1f53619f526d05c789fd8a"}
Jul 12 00:22:40.956959 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:40.956604    2582 scope.go:117] "RemoveContainer" containerID="1176f73ff6410aa464f3c59480f71224e35ec61bbf43f3ff8a556b55fe45e7be"
Jul 12 00:22:40.956959 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:40.956822    2582 scope.go:117] "RemoveContainer" containerID="e20b0684e84c889c27d9fb0a0606e6bfa6a4c4ecea1f53619f526d05c789fd8a"
Jul 12 00:22:40.957079 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:22:40.957040    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l_odh-ai-gateway-infra(a1a5a58a-f884-406d-a8a6-7b47d321da5a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a"
Jul 12 00:22:41.962190 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:41.962166    2582 scope.go:117] "RemoveContainer" containerID="e20b0684e84c889c27d9fb0a0606e6bfa6a4c4ecea1f53619f526d05c789fd8a"
Jul 12 00:22:41.962529 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:22:41.962356    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l_odh-ai-gateway-infra(a1a5a58a-f884-406d-a8a6-7b47d321da5a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a"
Jul 12 00:22:42.944405 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:42.944374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:22:43.391336 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:43.391295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:22:54.839457 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:54.839421    2582 scope.go:117] "RemoveContainer" containerID="e20b0684e84c889c27d9fb0a0606e6bfa6a4c4ecea1f53619f526d05c789fd8a"
Jul 12 00:22:56.022194 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:56.022160    2582 generic.go:356] "Generic (PLEG): container finished" podID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerID="364cfa5031f8f50a606626af8860a41c4aaa461fae0dbaf4dd5544a1c29ece46" exitCode=0
Jul 12 00:22:56.022576 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:56.022235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l" event={"ID":"a1a5a58a-f884-406d-a8a6-7b47d321da5a","Type":"ContainerDied","Data":"364cfa5031f8f50a606626af8860a41c4aaa461fae0dbaf4dd5544a1c29ece46"}
Jul 12 00:22:56.022576 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:56.022295    2582 scope.go:117] "RemoveContainer" containerID="e20b0684e84c889c27d9fb0a0606e6bfa6a4c4ecea1f53619f526d05c789fd8a"
Jul 12 00:22:57.051856 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:57.049943    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"]
Jul 12 00:22:57.156385 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:57.156357    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"
Jul 12 00:22:57.265405 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:57.265368    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a5a58a-f884-406d-a8a6-7b47d321da5a-maas-api-service-ca\") pod \"a1a5a58a-f884-406d-a8a6-7b47d321da5a\" (UID: \"a1a5a58a-f884-406d-a8a6-7b47d321da5a\") "
Jul 12 00:22:57.265710 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:57.265686    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1a5a58a-f884-406d-a8a6-7b47d321da5a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1a5a58a-f884-406d-a8a6-7b47d321da5a" (UID: "a1a5a58a-f884-406d-a8a6-7b47d321da5a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:22:57.366819 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:57.366756    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a5a58a-f884-406d-a8a6-7b47d321da5a-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:22:58.032515 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:58.032482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l" event={"ID":"a1a5a58a-f884-406d-a8a6-7b47d321da5a","Type":"ContainerDied","Data":"b1ebae062cbf238e2639e02f30fee89981a68b26587689e7494834a21f9274bc"}
Jul 12 00:22:58.032515 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:58.032510    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"
Jul 12 00:22:58.032713 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:58.032529    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1ebae062cbf238e2639e02f30fee89981a68b26587689e7494834a21f9274bc"
Jul 12 00:22:58.060362 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:58.060333    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"]
Jul 12 00:22:58.063823 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:58.063803    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-jrk5l"]
Jul 12 00:22:58.843950 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:22:58.843912    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" path="/var/lib/kubelet/pods/a1a5a58a-f884-406d-a8a6-7b47d321da5a/volumes"
Jul 12 00:23:01.618121 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:01.618085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:01.718583 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:01.718550    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:21.954420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:21.954384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:28.283235 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283197    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"]
Jul 12 00:23:28.283689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283483    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:28.283689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283493    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:28.283689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283506    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:28.283689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283511    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:28.283689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283585    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:28.283689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283594    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:28.283689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.283602    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:28.290030 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.290007    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"
Jul 12 00:23:28.292857 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.292830    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:23:28.292996 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.292860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"]
Jul 12 00:23:28.412273 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.412237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6612057b-e5f6-4f99-92cc-37fedcd326f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt\" (UID: \"6612057b-e5f6-4f99-92cc-37fedcd326f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"
Jul 12 00:23:28.513505 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.513463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6612057b-e5f6-4f99-92cc-37fedcd326f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt\" (UID: \"6612057b-e5f6-4f99-92cc-37fedcd326f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"
Jul 12 00:23:28.514166 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.514138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6612057b-e5f6-4f99-92cc-37fedcd326f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt\" (UID: \"6612057b-e5f6-4f99-92cc-37fedcd326f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"
Jul 12 00:23:28.601520 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.601481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"
Jul 12 00:23:28.725179 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:28.725144    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"]
Jul 12 00:23:28.728051 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:23:28.728022    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6612057b_e5f6_4f99_92cc_37fedcd326f3.slice/crio-26b0d7dfc9d4f89eeb3ed0e3aeec0335bd944fd51eabe8c055afd1606a7d138f WatchSource:0}: Error finding container 26b0d7dfc9d4f89eeb3ed0e3aeec0335bd944fd51eabe8c055afd1606a7d138f: Status 404 returned error can't find the container with id 26b0d7dfc9d4f89eeb3ed0e3aeec0335bd944fd51eabe8c055afd1606a7d138f
Jul 12 00:23:29.159408 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:29.159373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt" event={"ID":"6612057b-e5f6-4f99-92cc-37fedcd326f3","Type":"ContainerStarted","Data":"cc530a3558112b79c678e15760967b8f16038e6a69d230cad8177e20e5e37ebb"}
Jul 12 00:23:29.159571 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:29.159423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt" event={"ID":"6612057b-e5f6-4f99-92cc-37fedcd326f3","Type":"ContainerStarted","Data":"26b0d7dfc9d4f89eeb3ed0e3aeec0335bd944fd51eabe8c055afd1606a7d138f"}
Jul 12 00:23:29.176023 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:29.175979    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt" podStartSLOduration=1.175965605 podStartE2EDuration="1.175965605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:23:29.174962199 +0000 UTC m=+1588.804069710" watchObservedRunningTime="2026-07-12 00:23:29.175965605 +0000 UTC m=+1588.805073114"
Jul 12 00:23:30.165535 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:30.165503    2582 generic.go:356] "Generic (PLEG): container finished" podID="6612057b-e5f6-4f99-92cc-37fedcd326f3" containerID="cc530a3558112b79c678e15760967b8f16038e6a69d230cad8177e20e5e37ebb" exitCode=0
Jul 12 00:23:30.165912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:30.165549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt" event={"ID":"6612057b-e5f6-4f99-92cc-37fedcd326f3","Type":"ContainerDied","Data":"cc530a3558112b79c678e15760967b8f16038e6a69d230cad8177e20e5e37ebb"}
Jul 12 00:23:31.296406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:31.296383    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"
Jul 12 00:23:31.437240 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:31.437162    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6612057b-e5f6-4f99-92cc-37fedcd326f3-maas-api-service-ca\") pod \"6612057b-e5f6-4f99-92cc-37fedcd326f3\" (UID: \"6612057b-e5f6-4f99-92cc-37fedcd326f3\") "
Jul 12 00:23:31.437521 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:31.437499    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6612057b-e5f6-4f99-92cc-37fedcd326f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6612057b-e5f6-4f99-92cc-37fedcd326f3" (UID: "6612057b-e5f6-4f99-92cc-37fedcd326f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:23:31.538086 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:31.538053    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6612057b-e5f6-4f99-92cc-37fedcd326f3-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:23:32.174117 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:32.174075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt" event={"ID":"6612057b-e5f6-4f99-92cc-37fedcd326f3","Type":"ContainerDied","Data":"26b0d7dfc9d4f89eeb3ed0e3aeec0335bd944fd51eabe8c055afd1606a7d138f"}
Jul 12 00:23:32.174309 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:32.174131    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26b0d7dfc9d4f89eeb3ed0e3aeec0335bd944fd51eabe8c055afd1606a7d138f"
Jul 12 00:23:32.174309 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:32.174095    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt"
Jul 12 00:23:38.595323 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:38.595288    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"]
Jul 12 00:23:38.595833 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:38.595590    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw" podUID="b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" containerName="maas-api" containerID="cri-o://8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358" gracePeriod=30
Jul 12 00:23:38.619826 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:38.619798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:38.846931 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:38.846875    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:23:39.005076 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.005040    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-openshift-service-ca\") pod \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") "
Jul 12 00:23:39.005076 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.005082    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn5fb\" (UniqueName: \"kubernetes.io/projected/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-kube-api-access-vn5fb\") pod \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") "
Jul 12 00:23:39.005320 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.005159    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls\") pod \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\" (UID: \"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1\") "
Jul 12 00:23:39.005453 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.005428    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" (UID: "b58b4cb1-cdd6-43b5-94bd-14dc23e98db1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:23:39.007284 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.007253    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" (UID: "b58b4cb1-cdd6-43b5-94bd-14dc23e98db1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:23:39.007284 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.007256    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-kube-api-access-vn5fb" (OuterVolumeSpecName: "kube-api-access-vn5fb") pod "b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" (UID: "b58b4cb1-cdd6-43b5-94bd-14dc23e98db1"). InnerVolumeSpecName "kube-api-access-vn5fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:23:39.106016 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.105944    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:23:39.106016 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.105968    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:23:39.106016 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.105978    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn5fb\" (UniqueName: \"kubernetes.io/projected/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1-kube-api-access-vn5fb\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:23:39.209415 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.209384    2582 generic.go:356] "Generic (PLEG): container finished" podID="b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" containerID="8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358" exitCode=0
Jul 12 00:23:39.209556 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.209423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw" event={"ID":"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1","Type":"ContainerDied","Data":"8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358"}
Jul 12 00:23:39.209556 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.209431    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"
Jul 12 00:23:39.209556 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.209477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw" event={"ID":"b58b4cb1-cdd6-43b5-94bd-14dc23e98db1","Type":"ContainerDied","Data":"ff8ded8964230168921a32471b62314ea5f2cf52a46f49e44e5fc7d53d7ac926"}
Jul 12 00:23:39.209556 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.209499    2582 scope.go:117] "RemoveContainer" containerID="8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358"
Jul 12 00:23:39.218115 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.218095    2582 scope.go:117] "RemoveContainer" containerID="8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358"
Jul 12 00:23:39.218389 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:23:39.218367    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358\": container with ID starting with 8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358 not found: ID does not exist" containerID="8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358"
Jul 12 00:23:39.218451 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.218396    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358"} err="failed to get container status \"8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358\": rpc error: code = NotFound desc = could not find container \"8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358\": container with ID starting with 8f4f52f3b62bfee245113777c5e7230e987078ad1476812a6f96015f5d8eb358 not found: ID does not exist"
Jul 12 00:23:39.233004 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.232982    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"]
Jul 12 00:23:39.235425 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:39.235402    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb79ec53-649cc7b8d-fz9qw"]
Jul 12 00:23:40.844607 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:40.844575    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" path="/var/lib/kubelet/pods/b58b4cb1-cdd6-43b5-94bd-14dc23e98db1/volumes"
Jul 12 00:23:41.481401 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:41.481365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:23:43.354509 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:43.354477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:49.240928 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:49.240894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:49.312454 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:49.312413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:53.548951 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:53.548873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:53.919575 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:53.919480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:54.010538 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.010499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:54.087183 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087151    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"]
Jul 12 00:23:54.087551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087526    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" containerName="maas-api"
Jul 12 00:23:54.087551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087549    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" containerName="maas-api"
Jul 12 00:23:54.087772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087578    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:54.087772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087586    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a5a58a-f884-406d-a8a6-7b47d321da5a" containerName="revoke-keys"
Jul 12 00:23:54.087772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087605    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6612057b-e5f6-4f99-92cc-37fedcd326f3" containerName="revoke-keys"
Jul 12 00:23:54.087772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087613    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6612057b-e5f6-4f99-92cc-37fedcd326f3" containerName="revoke-keys"
Jul 12 00:23:54.087772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087685    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58b4cb1-cdd6-43b5-94bd-14dc23e98db1" containerName="maas-api"
Jul 12 00:23:54.087772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.087698    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6612057b-e5f6-4f99-92cc-37fedcd326f3" containerName="revoke-keys"
Jul 12 00:23:54.092071 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.092049    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.094677 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.094658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-beef7709-gw-openshift-default-dockercfg-kc5dr\""
Jul 12 00:23:54.102078 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.102056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"]
Jul 12 00:23:54.122192 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.122167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:54.131526 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7zk8\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-kube-api-access-r7zk8\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131630 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-token\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131630 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-certs\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131630 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-credential-socket\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-envoy\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-socket\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-podinfo\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istiod-ca-cert\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.131994 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.131839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-data\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.232970 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.232827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-podinfo\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.232970 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.232947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istiod-ca-cert\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.232986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-data\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7zk8\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-kube-api-access-r7zk8\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-token\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-certs\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-credential-socket\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-envoy\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-socket\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233472 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-data\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233558 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-certs\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233785 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istiod-ca-cert\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233913 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-credential-socket\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.233913 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.233829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-socket\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.235516 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.235488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-envoy\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.235733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.235718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-podinfo\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.241067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.241036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-token\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.241638 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.241620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7zk8\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-kube-api-access-r7zk8\") pod \"e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") " pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.403500 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.403465    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:54.535839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:54.535723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"]
Jul 12 00:23:54.538307 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:23:54.538281    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9aa726_cc16_4f93_89fd_a6e21bdf5fea.slice/crio-ebc2420c384a90594a8bdff14f4c7a04d520b7e510b70e143483c2ec2d4e532f WatchSource:0}: Error finding container ebc2420c384a90594a8bdff14f4c7a04d520b7e510b70e143483c2ec2d4e532f: Status 404 returned error can't find the container with id ebc2420c384a90594a8bdff14f4c7a04d520b7e510b70e143483c2ec2d4e532f
Jul 12 00:23:55.280411 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.280373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" event={"ID":"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea","Type":"ContainerStarted","Data":"ebc2420c384a90594a8bdff14f4c7a04d520b7e510b70e143483c2ec2d4e532f"}
Jul 12 00:23:55.342546 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.342470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:55.415003 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.414969    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"]
Jul 12 00:23:55.418666 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.418640    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.421640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.421614    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:23:55.421863 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.421828    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-beef7709-serving-cert\""
Jul 12 00:23:55.421978 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.421864    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 00:23:55.422840 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.422810    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\""
Jul 12 00:23:55.427103 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.427042    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"]
Jul 12 00:23:55.442966 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.442888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.442966 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.442949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjlt8\" (UniqueName: \"kubernetes.io/projected/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-kube-api-access-qjlt8\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.443158 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.442980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-openshift-service-ca\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.445589 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.445557    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:55.544543 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.544510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.544738 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.544562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjlt8\" (UniqueName: \"kubernetes.io/projected/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-kube-api-access-qjlt8\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.544738 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.544594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-openshift-service-ca\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.544891 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:23:55.544732    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-serving-cert: secret "maas-api-e2e-migrate-beef7709-serving-cert" not found
Jul 12 00:23:55.544891 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:23:55.544831    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls podName:3cdd7b06-2d47-4391-8a4b-539a13d4d1e1 nodeName:}" failed. No retries permitted until 2026-07-12 00:23:56.044809076 +0000 UTC m=+1615.673916566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls") pod "maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" (UID: "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1") : secret "maas-api-e2e-migrate-beef7709-serving-cert" not found
Jul 12 00:23:55.545393 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.545375    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-openshift-service-ca\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.557496 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.557467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjlt8\" (UniqueName: \"kubernetes.io/projected/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-kube-api-access-qjlt8\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:55.901577 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:55.901485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:56.005290 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:56.005227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:56.048670 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:56.048634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:56.052214 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:56.052187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls\") pod \"maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:56.057142 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:56.057111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:23:56.337799 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:56.337739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:57.241228 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:57.241192    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:23:57.241351 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:57.241277    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:23:57.241351 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:57.241323    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:23:57.301373 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:57.301347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"]
Jul 12 00:23:57.303255 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:23:57.303232    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdd7b06_2d47_4391_8a4b_539a13d4d1e1.slice/crio-482fd98e2b0d71e69372355c22aa87cd97734a1709383c8c1e723e94f1cf6a87 WatchSource:0}: Error finding container 482fd98e2b0d71e69372355c22aa87cd97734a1709383c8c1e723e94f1cf6a87: Status 404 returned error can't find the container with id 482fd98e2b0d71e69372355c22aa87cd97734a1709383c8c1e723e94f1cf6a87
Jul 12 00:23:58.295848 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.295811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" event={"ID":"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1","Type":"ContainerStarted","Data":"6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f"}
Jul 12 00:23:58.296278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.295877    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:23:58.296278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.295904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" event={"ID":"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1","Type":"ContainerStarted","Data":"482fd98e2b0d71e69372355c22aa87cd97734a1709383c8c1e723e94f1cf6a87"}
Jul 12 00:23:58.297225 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.297200    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" event={"ID":"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea","Type":"ContainerStarted","Data":"7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be"}
Jul 12 00:23:58.313346 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.313305    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" podStartSLOduration=2.872391033 podStartE2EDuration="3.313291642s" totalImagesPullingTime="440.900609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:23:58.31135777 +0000 UTC m=+1617.940465280" watchObservedRunningTime="2026-07-12 00:23:58.313291642 +0000 UTC m=+1617.942399130"
Jul 12 00:23:58.331834 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.331794    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" podStartSLOduration=1.631091563 podStartE2EDuration="4.331781054s" totalImagesPullingTime="2.700689491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:23:58.33033971 +0000 UTC m=+1617.959447241" watchObservedRunningTime="2026-07-12 00:23:58.331781054 +0000 UTC m=+1617.960888629"
Jul 12 00:23:58.403899 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.403870    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:58.408581 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:58.408559    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:59.301721 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:59.301678    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:59.302377 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:59.302361    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:23:59.882190 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:59.878141    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"]
Jul 12 00:23:59.882814 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:59.882778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"
Jul 12 00:23:59.885933 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:59.885911    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:23:59.888130 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:59.888108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"]
Jul 12 00:23:59.986204 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:23:59.986169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd61895-1f4b-42b8-b7f1-feaa82dd9675-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf\" (UID: \"cbd61895-1f4b-42b8-b7f1-feaa82dd9675\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"
Jul 12 00:24:00.087544 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:00.087499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd61895-1f4b-42b8-b7f1-feaa82dd9675-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf\" (UID: \"cbd61895-1f4b-42b8-b7f1-feaa82dd9675\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"
Jul 12 00:24:00.088317 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:00.088296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd61895-1f4b-42b8-b7f1-feaa82dd9675-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf\" (UID: \"cbd61895-1f4b-42b8-b7f1-feaa82dd9675\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"
Jul 12 00:24:00.127569 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:00.127527    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:24:00.185911 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:00.185835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:24:00.193787 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:00.193753    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"
Jul 12 00:24:00.324797 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:00.324775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"]
Jul 12 00:24:00.326871 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:24:00.326842    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd61895_1f4b_42b8_b7f1_feaa82dd9675.slice/crio-cbe44632ce145dfbf14ff821b99e35e4031eb6df9ec94f3b3b35aae914444a9e WatchSource:0}: Error finding container cbe44632ce145dfbf14ff821b99e35e4031eb6df9ec94f3b3b35aae914444a9e: Status 404 returned error can't find the container with id cbe44632ce145dfbf14ff821b99e35e4031eb6df9ec94f3b3b35aae914444a9e
Jul 12 00:24:01.312287 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:01.312253    2582 generic.go:356] "Generic (PLEG): container finished" podID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerID="2528f52408f6ab3ee66305538d9ac6a8e4c6edb93ba2d3644796443164437dbb" exitCode=7
Jul 12 00:24:01.312475 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:01.312346    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" event={"ID":"cbd61895-1f4b-42b8-b7f1-feaa82dd9675","Type":"ContainerDied","Data":"2528f52408f6ab3ee66305538d9ac6a8e4c6edb93ba2d3644796443164437dbb"}
Jul 12 00:24:01.312475 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:01.312414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" event={"ID":"cbd61895-1f4b-42b8-b7f1-feaa82dd9675","Type":"ContainerStarted","Data":"cbe44632ce145dfbf14ff821b99e35e4031eb6df9ec94f3b3b35aae914444a9e"}
Jul 12 00:24:01.312582 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:01.312536    2582 scope.go:117] "RemoveContainer" containerID="2528f52408f6ab3ee66305538d9ac6a8e4c6edb93ba2d3644796443164437dbb"
Jul 12 00:24:02.318968 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:02.318932    2582 generic.go:356] "Generic (PLEG): container finished" podID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerID="7e6dfe0eeb1b56985163d483ac0b5925c57a414d3b4fd7bd3b1e5c8d09a12fb5" exitCode=7
Jul 12 00:24:02.319430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:02.319015    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" event={"ID":"cbd61895-1f4b-42b8-b7f1-feaa82dd9675","Type":"ContainerDied","Data":"7e6dfe0eeb1b56985163d483ac0b5925c57a414d3b4fd7bd3b1e5c8d09a12fb5"}
Jul 12 00:24:02.319430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:02.319064    2582 scope.go:117] "RemoveContainer" containerID="2528f52408f6ab3ee66305538d9ac6a8e4c6edb93ba2d3644796443164437dbb"
Jul 12 00:24:02.319430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:02.319304    2582 scope.go:117] "RemoveContainer" containerID="7e6dfe0eeb1b56985163d483ac0b5925c57a414d3b4fd7bd3b1e5c8d09a12fb5"
Jul 12 00:24:02.319591 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:24:02.319536    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf_odh-ai-gateway-infra(cbd61895-1f4b-42b8-b7f1-feaa82dd9675)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675"
Jul 12 00:24:02.879484 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:02.879451    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:24:03.330432 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:03.330406    2582 scope.go:117] "RemoveContainer" containerID="7e6dfe0eeb1b56985163d483ac0b5925c57a414d3b4fd7bd3b1e5c8d09a12fb5"
Jul 12 00:24:03.330835 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:24:03.330579    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf_odh-ai-gateway-infra(cbd61895-1f4b-42b8-b7f1-feaa82dd9675)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675"
Jul 12 00:24:03.775921 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:03.775869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:24:04.306855 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:04.306823    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:24:11.374829 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:11.374795    2582 generic.go:356] "Generic (PLEG): container finished" podID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerID="7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be" exitCode=0
Jul 12 00:24:11.375238 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:11.374848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" event={"ID":"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea","Type":"ContainerDied","Data":"7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be"}
Jul 12 00:24:11.375238 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:11.375226    2582 scope.go:117] "RemoveContainer" containerID="7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be"
Jul 12 00:24:11.376217 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:11.376188    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:24:11.376265 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:11.376257    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:24:11.376298 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:11.376286    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:24:12.381394 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:12.381359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" event={"ID":"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea","Type":"ContainerStarted","Data":"2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb"}
Jul 12 00:24:12.404389 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:12.404353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:24:12.405505 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:12.405475    2582 patch_prober.go:28] interesting pod/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 12 00:24:12.405617 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:12.405519    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 12 00:24:13.404514 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:13.404482    2582 patch_prober.go:28] interesting pod/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 12 00:24:13.404901 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:13.404532    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 12 00:24:14.302446 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:14.302392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:24:14.403777 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:14.403738    2582 patch_prober.go:28] interesting pod/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 12 00:24:14.403961 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:14.403811    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 12 00:24:15.404739 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:15.404705    2582 patch_prober.go:28] interesting pod/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 12 00:24:15.405146 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:15.404781    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 12 00:24:16.407910 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:16.407880    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:24:16.409088 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:16.409067    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:24:16.839555 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:16.839516    2582 scope.go:117] "RemoveContainer" containerID="7e6dfe0eeb1b56985163d483ac0b5925c57a414d3b4fd7bd3b1e5c8d09a12fb5"
Jul 12 00:24:17.405497 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:17.405410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" event={"ID":"cbd61895-1f4b-42b8-b7f1-feaa82dd9675","Type":"ContainerStarted","Data":"90c04dbf31f590a24aa7dfe25fc3eced744d6af866e705cdb22ceb4eaf8fb1a3"}
Jul 12 00:24:17.420287 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:17.420240    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" podStartSLOduration=18.420224971 podStartE2EDuration="18.420224971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:24:17.419724926 +0000 UTC m=+1637.048832435" watchObservedRunningTime="2026-07-12 00:24:17.420224971 +0000 UTC m=+1637.049332524"
Jul 12 00:24:18.411986 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:18.411956    2582 generic.go:356] "Generic (PLEG): container finished" podID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerID="90c04dbf31f590a24aa7dfe25fc3eced744d6af866e705cdb22ceb4eaf8fb1a3" exitCode=0
Jul 12 00:24:18.412207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:18.412015    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" event={"ID":"cbd61895-1f4b-42b8-b7f1-feaa82dd9675","Type":"ContainerDied","Data":"90c04dbf31f590a24aa7dfe25fc3eced744d6af866e705cdb22ceb4eaf8fb1a3"}
Jul 12 00:24:18.412207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:18.412073    2582 scope.go:117] "RemoveContainer" containerID="7e6dfe0eeb1b56985163d483ac0b5925c57a414d3b4fd7bd3b1e5c8d09a12fb5"
Jul 12 00:24:18.428255 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:18.428232    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"]
Jul 12 00:24:19.546736 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:19.546712    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"
Jul 12 00:24:19.657421 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:19.657394    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd61895-1f4b-42b8-b7f1-feaa82dd9675-maas-api-service-ca\") pod \"cbd61895-1f4b-42b8-b7f1-feaa82dd9675\" (UID: \"cbd61895-1f4b-42b8-b7f1-feaa82dd9675\") "
Jul 12 00:24:19.657737 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:19.657715    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd61895-1f4b-42b8-b7f1-feaa82dd9675-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cbd61895-1f4b-42b8-b7f1-feaa82dd9675" (UID: "cbd61895-1f4b-42b8-b7f1-feaa82dd9675"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:24:19.758042 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:19.757971    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd61895-1f4b-42b8-b7f1-feaa82dd9675-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:24:20.423645 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:20.423609    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"
Jul 12 00:24:20.423929 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:20.423614    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf" event={"ID":"cbd61895-1f4b-42b8-b7f1-feaa82dd9675","Type":"ContainerDied","Data":"cbe44632ce145dfbf14ff821b99e35e4031eb6df9ec94f3b3b35aae914444a9e"}
Jul 12 00:24:20.423929 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:20.423738    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbe44632ce145dfbf14ff821b99e35e4031eb6df9ec94f3b3b35aae914444a9e"
Jul 12 00:24:20.454957 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:20.454928    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"]
Jul 12 00:24:20.457114 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:20.457094    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-nsjtf"]
Jul 12 00:24:20.844343 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:20.844313    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" path="/var/lib/kubelet/pods/cbd61895-1f4b-42b8-b7f1-feaa82dd9675/volumes"
Jul 12 00:24:59.916803 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.916754    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"]
Jul 12 00:24:59.917260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.917080    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:24:59.917260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.917093    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:24:59.917260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.917103    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:24:59.917260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.917112    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:24:59.917260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.917172    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:24:59.917260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.917184    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:24:59.917260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.917192    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:24:59.920226 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.920207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"
Jul 12 00:24:59.922817 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.922801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:24:59.926707 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.926686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"]
Jul 12 00:24:59.986591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.986559    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58760f3c-fd01-4f18-a131-3798c440d6f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg\" (UID: \"58760f3c-fd01-4f18-a131-3798c440d6f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"
Jul 12 00:24:59.999421 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.999390    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"]
Jul 12 00:24:59.999610 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:24:59.999587    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy" containerID="cri-o://2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb" gracePeriod=30
Jul 12 00:25:00.025824 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:00.025754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:00.087584 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:00.087550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58760f3c-fd01-4f18-a131-3798c440d6f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg\" (UID: \"58760f3c-fd01-4f18-a131-3798c440d6f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"
Jul 12 00:25:00.088137 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:00.088110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58760f3c-fd01-4f18-a131-3798c440d6f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg\" (UID: \"58760f3c-fd01-4f18-a131-3798c440d6f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"
Jul 12 00:25:00.124025 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:00.123983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:00.231362 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:00.231292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"
Jul 12 00:25:00.563997 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:00.563967    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"]
Jul 12 00:25:00.567293 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:25:00.567267    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58760f3c_fd01_4f18_a131_3798c440d6f2.slice/crio-6d2702b4e8c47a066fc161d9dc2779993639e96767f70773a42034230c72f53e WatchSource:0}: Error finding container 6d2702b4e8c47a066fc161d9dc2779993639e96767f70773a42034230c72f53e: Status 404 returned error can't find the container with id 6d2702b4e8c47a066fc161d9dc2779993639e96767f70773a42034230c72f53e
Jul 12 00:25:00.597703 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:00.597674    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg" event={"ID":"58760f3c-fd01-4f18-a131-3798c440d6f2","Type":"ContainerStarted","Data":"6d2702b4e8c47a066fc161d9dc2779993639e96767f70773a42034230c72f53e"}
Jul 12 00:25:01.410100 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:01.410061    2582 patch_prober.go:28] interesting pod/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 00:25:01.410464 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:01.410116    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 00:25:01.603461 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:01.603428    2582 generic.go:356] "Generic (PLEG): container finished" podID="58760f3c-fd01-4f18-a131-3798c440d6f2" containerID="bea2fd46c2f4888652a83a7ab2b07e419ffd300c07a28068abb14c01cbc8b28c" exitCode=0
Jul 12 00:25:01.603461 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:01.603465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg" event={"ID":"58760f3c-fd01-4f18-a131-3798c440d6f2","Type":"ContainerDied","Data":"bea2fd46c2f4888652a83a7ab2b07e419ffd300c07a28068abb14c01cbc8b28c"}
Jul 12 00:25:02.737168 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:02.737139    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"
Jul 12 00:25:02.788425 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:02.788391    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:25:02.810200 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:02.810175    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58760f3c-fd01-4f18-a131-3798c440d6f2-maas-api-service-ca\") pod \"58760f3c-fd01-4f18-a131-3798c440d6f2\" (UID: \"58760f3c-fd01-4f18-a131-3798c440d6f2\") "
Jul 12 00:25:02.810532 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:02.810508    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58760f3c-fd01-4f18-a131-3798c440d6f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58760f3c-fd01-4f18-a131-3798c440d6f2" (UID: "58760f3c-fd01-4f18-a131-3798c440d6f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:25:02.911648 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:02.911573    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58760f3c-fd01-4f18-a131-3798c440d6f2-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:03.612905 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:03.612876    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg"
Jul 12 00:25:03.613056 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:03.612877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg" event={"ID":"58760f3c-fd01-4f18-a131-3798c440d6f2","Type":"ContainerDied","Data":"6d2702b4e8c47a066fc161d9dc2779993639e96767f70773a42034230c72f53e"}
Jul 12 00:25:03.613056 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:03.613003    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d2702b4e8c47a066fc161d9dc2779993639e96767f70773a42034230c72f53e"
Jul 12 00:25:05.252824 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.252801    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:25:05.334416 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334390    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-token\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334574 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334432    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-envoy\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334574 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334466    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-podinfo\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334574 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334489    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istiod-ca-cert\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334574 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334511    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-data\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334574 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334544    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7zk8\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-kube-api-access-r7zk8\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334574 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334583    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-socket\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334901 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334616    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-certs\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.334901 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.334667    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-credential-socket\") pod \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\" (UID: \"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea\") "
Jul 12 00:25:05.335160 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.335134    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:25:05.335525 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.335502    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:25:05.335635 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.335606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:25:05.335769 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.335522    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:25:05.335922 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.335894    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:25:05.337402 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.337350    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:25:05.337790 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.337594    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 00:25:05.337943 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.337914    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:25:05.338161 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.338135    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-kube-api-access-r7zk8" (OuterVolumeSpecName: "kube-api-access-r7zk8") pod "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" (UID: "ac9aa726-cc16-4f93-89fd-a6e21bdf5fea"). InnerVolumeSpecName "kube-api-access-r7zk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:25:05.435675 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435637    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435675 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435669    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-workload-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435675 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435678    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-credential-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435688    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435697    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-envoy\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435704    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-podinfo\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435711    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istiod-ca-cert\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435719    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-istio-data\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.435923 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.435727    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7zk8\" (UniqueName: \"kubernetes.io/projected/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea-kube-api-access-r7zk8\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:05.622581 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.622496    2582 generic.go:356] "Generic (PLEG): container finished" podID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerID="2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb" exitCode=0
Jul 12 00:25:05.622581 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.622541    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"
Jul 12 00:25:05.622581 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.622555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" event={"ID":"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea","Type":"ContainerDied","Data":"2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb"}
Jul 12 00:25:05.622839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.622606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm" event={"ID":"ac9aa726-cc16-4f93-89fd-a6e21bdf5fea","Type":"ContainerDied","Data":"ebc2420c384a90594a8bdff14f4c7a04d520b7e510b70e143483c2ec2d4e532f"}
Jul 12 00:25:05.622839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.622630    2582 scope.go:117] "RemoveContainer" containerID="2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb"
Jul 12 00:25:05.631656 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.631636    2582 scope.go:117] "RemoveContainer" containerID="7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be"
Jul 12 00:25:05.642352 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.642329    2582 scope.go:117] "RemoveContainer" containerID="2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb"
Jul 12 00:25:05.642953 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:05.642810    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb\": container with ID starting with 2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb not found: ID does not exist" containerID="2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb"
Jul 12 00:25:05.642953 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.642847    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb"} err="failed to get container status \"2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb\": rpc error: code = NotFound desc = could not find container \"2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb\": container with ID starting with 2294fe2cb2c4712b497f89ccce39254593c8b5070b24bfe11570537f226a0bfb not found: ID does not exist"
Jul 12 00:25:05.642953 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.642870    2582 scope.go:117] "RemoveContainer" containerID="7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be"
Jul 12 00:25:05.643195 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:05.643166    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be\": container with ID starting with 7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be not found: ID does not exist" containerID="7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be"
Jul 12 00:25:05.643293 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.643201    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be"} err="failed to get container status \"7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be\": rpc error: code = NotFound desc = could not find container \"7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be\": container with ID starting with 7cc59bb0b735bd2cd61adee27275c96fa4e1841e45d4fb00d8c181847d1b67be not found: ID does not exist"
Jul 12 00:25:05.644260 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.644242    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"]
Jul 12 00:25:05.650099 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.650078    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-beef7709-gw-openshift-default-678b8895c9-8zbsm"]
Jul 12 00:25:05.930200 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.930105    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"]
Jul 12 00:25:05.939747 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:05.939715    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-serving-cert: secret "maas-api-e2e-migrate-beef7709-serving-cert" not found
Jul 12 00:25:05.939926 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:05.939827    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls podName:3cdd7b06-2d47-4391-8a4b-539a13d4d1e1 nodeName:}" failed. No retries permitted until 2026-07-12 00:25:06.439805116 +0000 UTC m=+1686.068912604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls") pod "maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" (UID: "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1") : secret "maas-api-e2e-migrate-beef7709-serving-cert" not found
Jul 12 00:25:05.952876 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:05.952851    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:06.097485 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.097450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:06.403627 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.403596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:06.446011 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:06.445976    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-serving-cert: secret "maas-api-e2e-migrate-beef7709-serving-cert" not found
Jul 12 00:25:06.446187 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:06.446076    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls podName:3cdd7b06-2d47-4391-8a4b-539a13d4d1e1 nodeName:}" failed. No retries permitted until 2026-07-12 00:25:07.446053875 +0000 UTC m=+1687.075161388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls") pod "maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" (UID: "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1") : secret "maas-api-e2e-migrate-beef7709-serving-cert" not found
Jul 12 00:25:06.627334 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.627300    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" podUID="3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" containerName="maas-api" containerID="cri-o://6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f" gracePeriod=30
Jul 12 00:25:06.844869 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.844839    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" path="/var/lib/kubelet/pods/ac9aa726-cc16-4f93-89fd-a6e21bdf5fea/volumes"
Jul 12 00:25:06.868192 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.868168    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:25:06.951361 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.951285    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjlt8\" (UniqueName: \"kubernetes.io/projected/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-kube-api-access-qjlt8\") pod \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") "
Jul 12 00:25:06.951361 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.951338    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls\") pod \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") "
Jul 12 00:25:06.951566 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.951367    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-openshift-service-ca\") pod \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\" (UID: \"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1\") "
Jul 12 00:25:06.951754 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.951730    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" (UID: "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:25:06.953364 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.953343    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-kube-api-access-qjlt8" (OuterVolumeSpecName: "kube-api-access-qjlt8") pod "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" (UID: "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1"). InnerVolumeSpecName "kube-api-access-qjlt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:25:06.953418 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:06.953379    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" (UID: "3cdd7b06-2d47-4391-8a4b-539a13d4d1e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:25:07.051884 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.051851    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjlt8\" (UniqueName: \"kubernetes.io/projected/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-kube-api-access-qjlt8\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:07.051884 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.051878    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:07.051884 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.051888    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:07.632573 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.632542    2582 generic.go:356] "Generic (PLEG): container finished" podID="3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" containerID="6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f" exitCode=0
Jul 12 00:25:07.633027 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.632589    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"
Jul 12 00:25:07.633027 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.632599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" event={"ID":"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1","Type":"ContainerDied","Data":"6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f"}
Jul 12 00:25:07.633027 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.632642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn" event={"ID":"3cdd7b06-2d47-4391-8a4b-539a13d4d1e1","Type":"ContainerDied","Data":"482fd98e2b0d71e69372355c22aa87cd97734a1709383c8c1e723e94f1cf6a87"}
Jul 12 00:25:07.633027 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.632664    2582 scope.go:117] "RemoveContainer" containerID="6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f"
Jul 12 00:25:07.641189 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.641172    2582 scope.go:117] "RemoveContainer" containerID="6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f"
Jul 12 00:25:07.641434 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:07.641416    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f\": container with ID starting with 6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f not found: ID does not exist" containerID="6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f"
Jul 12 00:25:07.641475 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.641445    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f"} err="failed to get container status \"6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f\": rpc error: code = NotFound desc = could not find container \"6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f\": container with ID starting with 6eed0b293ea175a40890eaae746cee25b64a7bcb730adf87eb9a11c65e5e7d7f not found: ID does not exist"
Jul 12 00:25:07.653420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.653393    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"]
Jul 12 00:25:07.655103 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:07.655082    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-beef7709-b87bb74f5-7kwrn"]
Jul 12 00:25:08.844207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:08.844176    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" path="/var/lib/kubelet/pods/3cdd7b06-2d47-4391-8a4b-539a13d4d1e1/volumes"
Jul 12 00:25:11.543396 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.543365    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:11.646927 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.646897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:11.725578 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.725542    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"]
Jul 12 00:25:11.726068 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726044    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy"
Jul 12 00:25:11.726249 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726230    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy"
Jul 12 00:25:11.726371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726266    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" containerName="maas-api"
Jul 12 00:25:11.726371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726275    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" containerName="maas-api"
Jul 12 00:25:11.726371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726285    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58760f3c-fd01-4f18-a131-3798c440d6f2" containerName="revoke-keys"
Jul 12 00:25:11.726371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726294    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="58760f3c-fd01-4f18-a131-3798c440d6f2" containerName="revoke-keys"
Jul 12 00:25:11.726371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726356    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:25:11.726371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726367    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd61895-1f4b-42b8-b7f1-feaa82dd9675" containerName="revoke-keys"
Jul 12 00:25:11.726640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726445    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdd7b06-2d47-4391-8a4b-539a13d4d1e1" containerName="maas-api"
Jul 12 00:25:11.726640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726477    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="58760f3c-fd01-4f18-a131-3798c440d6f2" containerName="revoke-keys"
Jul 12 00:25:11.726640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726488    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy"
Jul 12 00:25:11.726640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.726497    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy"
Jul 12 00:25:11.731015 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.730994    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.734814 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.734346    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-16b55c03-openshift-default-dockercfg-kg92d\""
Jul 12 00:25:11.741268 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.741208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"]
Jul 12 00:25:11.757979 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.757951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:11.789287 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-certs\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-envoy\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-socket\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-data\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-token\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789568 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4cjg\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-kube-api-access-x4cjg\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789568 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-podinfo\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789568 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-credential-socket\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.789706 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.789572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istiod-ca-cert\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.858270 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.858131    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:11.890300 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4cjg\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-kube-api-access-x4cjg\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890427 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-podinfo\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890427 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-credential-socket\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890427 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istiod-ca-cert\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890554 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-certs\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890554 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-envoy\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890633 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-socket\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890633 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-data\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890731 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-token\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890815 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-credential-socket\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890872 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-certs\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.890983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.890961    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-socket\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.891064 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.891043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-data\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.891135 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.891113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istiod-ca-cert\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.892754 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.892738    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-envoy\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.892857 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.892842    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-podinfo\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.898001 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.897980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-token\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:11.898325 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:11.898303    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4cjg\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-kube-api-access-x4cjg\") pod \"e2e-ait-16b55c03-openshift-default-6df55c585-kcc95\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") " pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:12.045549 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.045514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:12.201338 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.201315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"]
Jul 12 00:25:12.203471 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:25:12.203442    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f73ade_0f2d_4df2_8e27_92cc4e84a0a0.slice/crio-c20230fa1bb804c6fc247cc17805571b93d0cf781bd60a351ceb62be93dc0487 WatchSource:0}: Error finding container c20230fa1bb804c6fc247cc17805571b93d0cf781bd60a351ceb62be93dc0487: Status 404 returned error can't find the container with id c20230fa1bb804c6fc247cc17805571b93d0cf781bd60a351ceb62be93dc0487
Jul 12 00:25:12.206149 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.206120    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:25:12.206213 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.206196    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:25:12.206254 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.206224    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:25:12.657062 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.657024    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" event={"ID":"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0","Type":"ContainerStarted","Data":"042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468"}
Jul 12 00:25:12.657457 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.657103    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" event={"ID":"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0","Type":"ContainerStarted","Data":"c20230fa1bb804c6fc247cc17805571b93d0cf781bd60a351ceb62be93dc0487"}
Jul 12 00:25:12.677804 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.677738    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" podStartSLOduration=1.6777233150000002 podStartE2EDuration="1.677723315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:25:12.676229563 +0000 UTC m=+1692.305337070" watchObservedRunningTime="2026-07-12 00:25:12.677723315 +0000 UTC m=+1692.306830829"
Jul 12 00:25:12.857652 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.857619    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:12.933198 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.933105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:12.999436 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:12.999404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:13.046273 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:13.046232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:13.053378 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:13.053352    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:13.171907 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:13.171880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:13.377542 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:13.377465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:13.478023 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:13.477990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:13.661167 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:13.661068    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:13.662159 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:13.662142    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:15.468021 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:15.467982    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:18.011067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.011032    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"]
Jul 12 00:25:18.011421 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.011369    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy"
Jul 12 00:25:18.011421 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.011380    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac9aa726-cc16-4f93-89fd-a6e21bdf5fea" containerName="istio-proxy"
Jul 12 00:25:18.014431 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.014415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"
Jul 12 00:25:18.016937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.016912    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:25:18.017050 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.016940    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:25:18.020257 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.020235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"]
Jul 12 00:25:18.140992 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.140956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78a29a8-4d8d-4b60-9920-66257e7b3af1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v\" (UID: \"f78a29a8-4d8d-4b60-9920-66257e7b3af1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"
Jul 12 00:25:18.241714 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.241673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78a29a8-4d8d-4b60-9920-66257e7b3af1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v\" (UID: \"f78a29a8-4d8d-4b60-9920-66257e7b3af1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"
Jul 12 00:25:18.242398 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.242377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78a29a8-4d8d-4b60-9920-66257e7b3af1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v\" (UID: \"f78a29a8-4d8d-4b60-9920-66257e7b3af1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"
Jul 12 00:25:18.325896 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.325869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"
Jul 12 00:25:18.453499 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.453472    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"]
Jul 12 00:25:18.455424 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:25:18.455395    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78a29a8_4d8d_4b60_9920_66257e7b3af1.slice/crio-f40b98aa2afd9f9986e50d8d1f6329f0070b586e68ab498774f35f37cec4586a WatchSource:0}: Error finding container f40b98aa2afd9f9986e50d8d1f6329f0070b586e68ab498774f35f37cec4586a: Status 404 returned error can't find the container with id f40b98aa2afd9f9986e50d8d1f6329f0070b586e68ab498774f35f37cec4586a
Jul 12 00:25:18.682586 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.682551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" event={"ID":"f78a29a8-4d8d-4b60-9920-66257e7b3af1","Type":"ContainerStarted","Data":"90217fbc1414e08f0a0fe92b7545b5597fa005090e7e73ef42918bd498bee2c6"}
Jul 12 00:25:18.682692 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.682606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" event={"ID":"f78a29a8-4d8d-4b60-9920-66257e7b3af1","Type":"ContainerStarted","Data":"f40b98aa2afd9f9986e50d8d1f6329f0070b586e68ab498774f35f37cec4586a"}
Jul 12 00:25:18.696750 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:18.696707    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" podStartSLOduration=1.696692133 podStartE2EDuration="1.696692133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:25:18.695794853 +0000 UTC m=+1698.324902389" watchObservedRunningTime="2026-07-12 00:25:18.696692133 +0000 UTC m=+1698.325799676"
Jul 12 00:25:19.688210 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:19.688172    2582 generic.go:356] "Generic (PLEG): container finished" podID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerID="90217fbc1414e08f0a0fe92b7545b5597fa005090e7e73ef42918bd498bee2c6" exitCode=7
Jul 12 00:25:19.688663 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:19.688259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" event={"ID":"f78a29a8-4d8d-4b60-9920-66257e7b3af1","Type":"ContainerDied","Data":"90217fbc1414e08f0a0fe92b7545b5597fa005090e7e73ef42918bd498bee2c6"}
Jul 12 00:25:19.688663 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:19.688449    2582 scope.go:117] "RemoveContainer" containerID="90217fbc1414e08f0a0fe92b7545b5597fa005090e7e73ef42918bd498bee2c6"
Jul 12 00:25:20.694799 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:20.694750    2582 generic.go:356] "Generic (PLEG): container finished" podID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerID="e9f8ab9f9c1f086d1428425a50f9841b8e163a721734d04be9869ba75aabf0f6" exitCode=7
Jul 12 00:25:20.695190 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:20.694856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" event={"ID":"f78a29a8-4d8d-4b60-9920-66257e7b3af1","Type":"ContainerDied","Data":"e9f8ab9f9c1f086d1428425a50f9841b8e163a721734d04be9869ba75aabf0f6"}
Jul 12 00:25:20.695190 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:20.694914    2582 scope.go:117] "RemoveContainer" containerID="90217fbc1414e08f0a0fe92b7545b5597fa005090e7e73ef42918bd498bee2c6"
Jul 12 00:25:20.695190 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:20.695037    2582 scope.go:117] "RemoveContainer" containerID="e9f8ab9f9c1f086d1428425a50f9841b8e163a721734d04be9869ba75aabf0f6"
Jul 12 00:25:20.695321 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:20.695248    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v_odh-ai-gateway-infra(f78a29a8-4d8d-4b60-9920-66257e7b3af1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1"
Jul 12 00:25:21.680282 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:21.680251    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:25:21.701199 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:21.701174    2582 scope.go:117] "RemoveContainer" containerID="e9f8ab9f9c1f086d1428425a50f9841b8e163a721734d04be9869ba75aabf0f6"
Jul 12 00:25:21.701531 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:25:21.701368    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v_odh-ai-gateway-infra(f78a29a8-4d8d-4b60-9920-66257e7b3af1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1"
Jul 12 00:25:28.630143 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:28.630102    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:29.211291 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.211250    2582 patch_prober.go:28] interesting pod/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:42576->10.133.0.34:15021: read: connection reset by peer" start-of-body=
Jul 12 00:25:29.211432 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.211321    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:42576->10.133.0.34:15021: read: connection reset by peer"
Jul 12 00:25:29.740724 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.740684    2582 generic.go:356] "Generic (PLEG): container finished" podID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerID="042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468" exitCode=0
Jul 12 00:25:29.741145 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.740753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" event={"ID":"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0","Type":"ContainerDied","Data":"042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468"}
Jul 12 00:25:29.741196 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.741178    2582 scope.go:117] "RemoveContainer" containerID="042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468"
Jul 12 00:25:29.742218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.742189    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:25:29.742302 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.742257    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:25:29.742302 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:29.742288    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:25:30.750932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:30.750889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" event={"ID":"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0","Type":"ContainerStarted","Data":"601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e"}
Jul 12 00:25:31.046410 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:31.046360    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:31.046803 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:31.046639    2582 patch_prober.go:28] interesting pod/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 12 00:25:31.046803 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:31.046702    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 12 00:25:32.046720 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:32.046682    2582 patch_prober.go:28] interesting pod/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 12 00:25:32.047329 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:32.047295    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 12 00:25:33.046185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:33.046140    2582 patch_prober.go:28] interesting pod/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 12 00:25:33.046402 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:33.046214    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 12 00:25:34.046691 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:34.046648    2582 patch_prober.go:28] interesting pod/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 12 00:25:34.047212 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:34.046722    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 12 00:25:35.049406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:35.049377    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:35.049783 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:35.049695    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:35.050411 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:35.050394    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:25:35.839779 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:35.839737    2582 scope.go:117] "RemoveContainer" containerID="e9f8ab9f9c1f086d1428425a50f9841b8e163a721734d04be9869ba75aabf0f6"
Jul 12 00:25:36.781201 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:36.781121    2582 generic.go:356] "Generic (PLEG): container finished" podID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerID="876e8e2d0ec48e0662af1e0abd92773f48f4f6a0e02dfd53d6402ec737c6b511" exitCode=0
Jul 12 00:25:36.781565 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:36.781196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" event={"ID":"f78a29a8-4d8d-4b60-9920-66257e7b3af1","Type":"ContainerDied","Data":"876e8e2d0ec48e0662af1e0abd92773f48f4f6a0e02dfd53d6402ec737c6b511"}
Jul 12 00:25:36.781565 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:36.781281    2582 scope.go:117] "RemoveContainer" containerID="e9f8ab9f9c1f086d1428425a50f9841b8e163a721734d04be9869ba75aabf0f6"
Jul 12 00:25:37.809185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:37.809152    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"]
Jul 12 00:25:37.916512 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:37.916485    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"
Jul 12 00:25:38.013607 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.013579    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78a29a8-4d8d-4b60-9920-66257e7b3af1-maas-api-service-ca\") pod \"f78a29a8-4d8d-4b60-9920-66257e7b3af1\" (UID: \"f78a29a8-4d8d-4b60-9920-66257e7b3af1\") "
Jul 12 00:25:38.013955 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.013933    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f78a29a8-4d8d-4b60-9920-66257e7b3af1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f78a29a8-4d8d-4b60-9920-66257e7b3af1" (UID: "f78a29a8-4d8d-4b60-9920-66257e7b3af1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:25:38.114363 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.114294    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78a29a8-4d8d-4b60-9920-66257e7b3af1-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:25:38.792918 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.792889    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"
Jul 12 00:25:38.793087 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.792918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v" event={"ID":"f78a29a8-4d8d-4b60-9920-66257e7b3af1","Type":"ContainerDied","Data":"f40b98aa2afd9f9986e50d8d1f6329f0070b586e68ab498774f35f37cec4586a"}
Jul 12 00:25:38.793087 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.792960    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f40b98aa2afd9f9986e50d8d1f6329f0070b586e68ab498774f35f37cec4586a"
Jul 12 00:25:38.821756 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.821710    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"]
Jul 12 00:25:38.823578 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.823558    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-j2t2v"]
Jul 12 00:25:38.844333 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:38.844305    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" path="/var/lib/kubelet/pods/f78a29a8-4d8d-4b60-9920-66257e7b3af1/volumes"
Jul 12 00:25:50.329428 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:50.329362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:25:50.430130 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:25:50.430098    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:18.054519 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054485    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"]
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054786    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054797    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054807    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054813    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054822    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054828    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054878    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.055002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.054886    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:18.057621 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.057604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"
Jul 12 00:26:18.060104 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.060078    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:26:18.060225 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.060126    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:26:18.064742 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.064317    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"]
Jul 12 00:26:18.118939 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.118906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2457b84-0b6d-4b2f-8921-445d5259a77a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16b55c03-926tw\" (UID: \"e2457b84-0b6d-4b2f-8921-445d5259a77a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"
Jul 12 00:26:18.219245 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.219211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2457b84-0b6d-4b2f-8921-445d5259a77a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16b55c03-926tw\" (UID: \"e2457b84-0b6d-4b2f-8921-445d5259a77a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"
Jul 12 00:26:18.219892 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.219866    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2457b84-0b6d-4b2f-8921-445d5259a77a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16b55c03-926tw\" (UID: \"e2457b84-0b6d-4b2f-8921-445d5259a77a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"
Jul 12 00:26:18.369511 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.369424    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"
Jul 12 00:26:18.492950 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.492907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"]
Jul 12 00:26:18.495711 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:26:18.495684    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2457b84_0b6d_4b2f_8921_445d5259a77a.slice/crio-c18a26b9f112f0af772043f5f9095b045f554f2cb905fc4244c89b9fc3e5829f WatchSource:0}: Error finding container c18a26b9f112f0af772043f5f9095b045f554f2cb905fc4244c89b9fc3e5829f: Status 404 returned error can't find the container with id c18a26b9f112f0af772043f5f9095b045f554f2cb905fc4244c89b9fc3e5829f
Jul 12 00:26:18.511000 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.510979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:18.612624 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.612583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:18.968640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.968553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw" event={"ID":"e2457b84-0b6d-4b2f-8921-445d5259a77a","Type":"ContainerStarted","Data":"ba14ab7c098c80454fea8d909993338a7e3979b44843b62f9216454c38ae9c5f"}
Jul 12 00:26:18.968640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.968607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw" event={"ID":"e2457b84-0b6d-4b2f-8921-445d5259a77a","Type":"ContainerStarted","Data":"c18a26b9f112f0af772043f5f9095b045f554f2cb905fc4244c89b9fc3e5829f"}
Jul 12 00:26:18.985531 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:18.985484    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw" podStartSLOduration=0.985469713 podStartE2EDuration="985.469713ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:26:18.984155005 +0000 UTC m=+1758.613262517" watchObservedRunningTime="2026-07-12 00:26:18.985469713 +0000 UTC m=+1758.614577223"
Jul 12 00:26:19.974777 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:19.974731    2582 generic.go:356] "Generic (PLEG): container finished" podID="e2457b84-0b6d-4b2f-8921-445d5259a77a" containerID="ba14ab7c098c80454fea8d909993338a7e3979b44843b62f9216454c38ae9c5f" exitCode=0
Jul 12 00:26:19.975169 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:19.974792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw" event={"ID":"e2457b84-0b6d-4b2f-8921-445d5259a77a","Type":"ContainerDied","Data":"ba14ab7c098c80454fea8d909993338a7e3979b44843b62f9216454c38ae9c5f"}
Jul 12 00:26:21.103727 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:21.103703    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"
Jul 12 00:26:21.143458 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:21.143431    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2457b84-0b6d-4b2f-8921-445d5259a77a-maas-api-service-ca\") pod \"e2457b84-0b6d-4b2f-8921-445d5259a77a\" (UID: \"e2457b84-0b6d-4b2f-8921-445d5259a77a\") "
Jul 12 00:26:21.143824 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:21.143799    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2457b84-0b6d-4b2f-8921-445d5259a77a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2457b84-0b6d-4b2f-8921-445d5259a77a" (UID: "e2457b84-0b6d-4b2f-8921-445d5259a77a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:26:21.244216 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:21.244138    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2457b84-0b6d-4b2f-8921-445d5259a77a-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:21.984501 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:21.984462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw" event={"ID":"e2457b84-0b6d-4b2f-8921-445d5259a77a","Type":"ContainerDied","Data":"c18a26b9f112f0af772043f5f9095b045f554f2cb905fc4244c89b9fc3e5829f"}
Jul 12 00:26:21.984699 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:21.984509    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16b55c03-926tw"
Jul 12 00:26:21.984699 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:21.984513    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c18a26b9f112f0af772043f5f9095b045f554f2cb905fc4244c89b9fc3e5829f"
Jul 12 00:26:28.576855 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:28.576816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:31.583995 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:31.583961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:26:33.146559 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:33.146526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:38.768024 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:38.767989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:38.829362 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:38.829335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:44.194537 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:44.194508    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"]
Jul 12 00:26:44.194985 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:44.194729    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy" containerID="cri-o://601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e" gracePeriod=30
Jul 12 00:26:44.223816 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:44.223782    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:45.535958 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.535918    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:45.648852 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.648802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:45.714971 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.714936    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"]
Jul 12 00:26:45.715296 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.715279    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2457b84-0b6d-4b2f-8921-445d5259a77a" containerName="revoke-keys"
Jul 12 00:26:45.715382 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.715299    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2457b84-0b6d-4b2f-8921-445d5259a77a" containerName="revoke-keys"
Jul 12 00:26:45.715436 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.715413    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78a29a8-4d8d-4b60-9920-66257e7b3af1" containerName="revoke-keys"
Jul 12 00:26:45.715436 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.715426    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2457b84-0b6d-4b2f-8921-445d5259a77a" containerName="revoke-keys"
Jul 12 00:26:45.718396 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.718374    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.720936 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.720913    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:26:45.720936 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.720929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\""
Jul 12 00:26:45.721124 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.720951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0aa3397f-serving-cert\""
Jul 12 00:26:45.722009 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.721995    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 00:26:45.730033 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.730010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"]
Jul 12 00:26:45.740105 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.740067    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:45.806740 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.806659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:45.842281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.842246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-openshift-service-ca\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.842458 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.842294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.842458 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.842322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6qk\" (UniqueName: \"kubernetes.io/projected/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-kube-api-access-9n6qk\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.943258 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.943218    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6qk\" (UniqueName: \"kubernetes.io/projected/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-kube-api-access-9n6qk\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.943445 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.943298    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-openshift-service-ca\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.943445 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.943365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.943573 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:26:45.943471    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-serving-cert: secret "maas-api-e2e-derive-0aa3397f-serving-cert" not found
Jul 12 00:26:45.943573 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:26:45.943537    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls podName:8376424a-f9fa-4fc8-be2a-6483f9dcde5b nodeName:}" failed. No retries permitted until 2026-07-12 00:26:46.443515859 +0000 UTC m=+1786.072623347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls") pod "maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4" (UID: "8376424a-f9fa-4fc8-be2a-6483f9dcde5b") : secret "maas-api-e2e-derive-0aa3397f-serving-cert" not found
Jul 12 00:26:45.944032 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.944011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-openshift-service-ca\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:45.952999 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:45.952979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6qk\" (UniqueName: \"kubernetes.io/projected/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-kube-api-access-9n6qk\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:46.153393 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:46.153315    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:46.254696 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:46.254665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:46.351826 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:46.351790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:46.448258 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:46.448160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:46.450615 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:46.450593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls\") pod \"maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:46.630298 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:46.630266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:46.758512 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:46.758487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"]
Jul 12 00:26:46.760823 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:26:46.760797    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8376424a_f9fa_4fc8_be2a_6483f9dcde5b.slice/crio-888d34f385501cd93d05eb8ae7b24e5f2c25ff42659ab56cf1153332e9311278 WatchSource:0}: Error finding container 888d34f385501cd93d05eb8ae7b24e5f2c25ff42659ab56cf1153332e9311278: Status 404 returned error can't find the container with id 888d34f385501cd93d05eb8ae7b24e5f2c25ff42659ab56cf1153332e9311278
Jul 12 00:26:47.097733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:47.097692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4" event={"ID":"8376424a-f9fa-4fc8-be2a-6483f9dcde5b","Type":"ContainerStarted","Data":"888d34f385501cd93d05eb8ae7b24e5f2c25ff42659ab56cf1153332e9311278"}
Jul 12 00:26:48.093492 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:48.093455    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:26:48.103123 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:48.103091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4" event={"ID":"8376424a-f9fa-4fc8-be2a-6483f9dcde5b","Type":"ContainerStarted","Data":"170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5"}
Jul 12 00:26:48.103256 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:48.103155    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:48.118960 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:48.118917    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4" podStartSLOduration=2.682218713 podStartE2EDuration="3.118897474s" totalImagesPullingTime="436.678761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:26:48.117984222 +0000 UTC m=+1787.747091740" watchObservedRunningTime="2026-07-12 00:26:48.118897474 +0000 UTC m=+1787.748005282"
Jul 12 00:26:49.440788 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.440749    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:26:49.573592 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573566    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4cjg\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-kube-api-access-x4cjg\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573746 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573604    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-envoy\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573746 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573636    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-credential-socket\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573746 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istiod-ca-cert\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573746 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-data\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573779    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-certs\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-podinfo\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-token\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573873    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-socket\") pod \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\" (UID: \"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0\") "
Jul 12 00:26:49.573983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.573934    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:26:49.574285 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.574063    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:26:49.574285 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.574140    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:26:49.574285 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.574168    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-credential-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.574285 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.574187    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.574471 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.574293    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:26:49.574709 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.574687    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:26:49.575866 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.575842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:26:49.575942 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.575842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 00:26:49.576040 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.576025    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-kube-api-access-x4cjg" (OuterVolumeSpecName: "kube-api-access-x4cjg") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "kube-api-access-x4cjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:26:49.576249 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.576231    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" (UID: "b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:26:49.674932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.674906    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-envoy\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.674932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.674928    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istiod-ca-cert\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.674932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.674937    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-data\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.675112 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.674945    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-podinfo\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.675112 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.674954    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-istio-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.675112 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.674962    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-workload-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:49.675112 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:49.674970    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4cjg\" (UniqueName: \"kubernetes.io/projected/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0-kube-api-access-x4cjg\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:26:50.091067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.087730    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"]
Jul 12 00:26:50.091067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.088456    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy"
Jul 12 00:26:50.091067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.088475    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy"
Jul 12 00:26:50.091067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.088500    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy"
Jul 12 00:26:50.091067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.088510    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy"
Jul 12 00:26:50.091067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.088668    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy"
Jul 12 00:26:50.091067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.088679    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerName="istio-proxy"
Jul 12 00:26:50.093334 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.093303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"
Jul 12 00:26:50.095363 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.095337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"]
Jul 12 00:26:50.096430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.096019    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:26:50.114025 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.113998    2582 generic.go:356] "Generic (PLEG): container finished" podID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" containerID="601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e" exitCode=0
Jul 12 00:26:50.114136 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.114052    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"
Jul 12 00:26:50.114136 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.114082    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" event={"ID":"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0","Type":"ContainerDied","Data":"601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e"}
Jul 12 00:26:50.114212 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.114143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95" event={"ID":"b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0","Type":"ContainerDied","Data":"c20230fa1bb804c6fc247cc17805571b93d0cf781bd60a351ceb62be93dc0487"}
Jul 12 00:26:50.114212 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.114176    2582 scope.go:117] "RemoveContainer" containerID="601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e"
Jul 12 00:26:50.122600 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.122582    2582 scope.go:117] "RemoveContainer" containerID="042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468"
Jul 12 00:26:50.129747 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.129732    2582 scope.go:117] "RemoveContainer" containerID="601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e"
Jul 12 00:26:50.130122 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:26:50.130103    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e\": container with ID starting with 601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e not found: ID does not exist" containerID="601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e"
Jul 12 00:26:50.130178 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.130130    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e"} err="failed to get container status \"601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e\": rpc error: code = NotFound desc = could not find container \"601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e\": container with ID starting with 601cbadfe1a0926d30cc5a0dfc113c3bd0d92cd4d185f97ce63420a09954eb5e not found: ID does not exist"
Jul 12 00:26:50.130178 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.130149    2582 scope.go:117] "RemoveContainer" containerID="042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468"
Jul 12 00:26:50.130366 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:26:50.130348    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468\": container with ID starting with 042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468 not found: ID does not exist" containerID="042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468"
Jul 12 00:26:50.130402 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.130372    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468"} err="failed to get container status \"042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468\": rpc error: code = NotFound desc = could not find container \"042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468\": container with ID starting with 042d36fcdd902738169b6114416b2427d9517d7a01461304f871c857e1927468 not found: ID does not exist"
Jul 12 00:26:50.136334 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.136314    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"]
Jul 12 00:26:50.138529 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.138508    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-16b55c03-openshift-default-6df55c585-kcc95"]
Jul 12 00:26:50.177523 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.177503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4113e12-e9e5-4ead-a405-9fa63a4a74d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts\" (UID: \"e4113e12-e9e5-4ead-a405-9fa63a4a74d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"
Jul 12 00:26:50.278880 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.278844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4113e12-e9e5-4ead-a405-9fa63a4a74d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts\" (UID: \"e4113e12-e9e5-4ead-a405-9fa63a4a74d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"
Jul 12 00:26:50.279431 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.279408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4113e12-e9e5-4ead-a405-9fa63a4a74d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts\" (UID: \"e4113e12-e9e5-4ead-a405-9fa63a4a74d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"
Jul 12 00:26:50.406717 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.406632    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"
Jul 12 00:26:50.533994 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.533920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"]
Jul 12 00:26:50.536341 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:26:50.536295    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4113e12_e9e5_4ead_a405_9fa63a4a74d8.slice/crio-84c07f0a974d7c755e131abc0df52a8943b2de25673eb9eb4222897e9987b124 WatchSource:0}: Error finding container 84c07f0a974d7c755e131abc0df52a8943b2de25673eb9eb4222897e9987b124: Status 404 returned error can't find the container with id 84c07f0a974d7c755e131abc0df52a8943b2de25673eb9eb4222897e9987b124
Jul 12 00:26:50.845076 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:50.845049    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0" path="/var/lib/kubelet/pods/b8f73ade-0f2d-4df2-8e27-92cc4e84a0a0/volumes"
Jul 12 00:26:51.120111 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:51.120072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" event={"ID":"e4113e12-e9e5-4ead-a405-9fa63a4a74d8","Type":"ContainerStarted","Data":"9a698474e2a15aa944088c94bf535d9c34013d75b16d256e60ed9739dba76c41"}
Jul 12 00:26:51.120324 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:51.120140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" event={"ID":"e4113e12-e9e5-4ead-a405-9fa63a4a74d8","Type":"ContainerStarted","Data":"84c07f0a974d7c755e131abc0df52a8943b2de25673eb9eb4222897e9987b124"}
Jul 12 00:26:51.135052 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:51.135004    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" podStartSLOduration=1.134986234 podStartE2EDuration="1.134986234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:26:51.13370353 +0000 UTC m=+1790.762811068" watchObservedRunningTime="2026-07-12 00:26:51.134986234 +0000 UTC m=+1790.764093745"
Jul 12 00:26:52.127383 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:52.127352    2582 generic.go:356] "Generic (PLEG): container finished" podID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerID="9a698474e2a15aa944088c94bf535d9c34013d75b16d256e60ed9739dba76c41" exitCode=7
Jul 12 00:26:52.127781 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:52.127418    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" event={"ID":"e4113e12-e9e5-4ead-a405-9fa63a4a74d8","Type":"ContainerDied","Data":"9a698474e2a15aa944088c94bf535d9c34013d75b16d256e60ed9739dba76c41"}
Jul 12 00:26:52.127781 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:52.127609    2582 scope.go:117] "RemoveContainer" containerID="9a698474e2a15aa944088c94bf535d9c34013d75b16d256e60ed9739dba76c41"
Jul 12 00:26:53.133797 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:53.133692    2582 generic.go:356] "Generic (PLEG): container finished" podID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerID="ffa3e0d7695643b2bbab8ce0c663aa8ef9e50c1f21601e75c1e2757dd5e75710" exitCode=7
Jul 12 00:26:53.134210 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:53.133797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" event={"ID":"e4113e12-e9e5-4ead-a405-9fa63a4a74d8","Type":"ContainerDied","Data":"ffa3e0d7695643b2bbab8ce0c663aa8ef9e50c1f21601e75c1e2757dd5e75710"}
Jul 12 00:26:53.134210 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:53.133868    2582 scope.go:117] "RemoveContainer" containerID="9a698474e2a15aa944088c94bf535d9c34013d75b16d256e60ed9739dba76c41"
Jul 12 00:26:53.134210 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:53.134047    2582 scope.go:117] "RemoveContainer" containerID="ffa3e0d7695643b2bbab8ce0c663aa8ef9e50c1f21601e75c1e2757dd5e75710"
Jul 12 00:26:53.134346 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:26:53.134274    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts_odh-ai-gateway-infra(e4113e12-e9e5-4ead-a405-9fa63a4a74d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8"
Jul 12 00:26:54.112480 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:54.112453    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:26:54.141374 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:54.141349    2582 scope.go:117] "RemoveContainer" containerID="ffa3e0d7695643b2bbab8ce0c663aa8ef9e50c1f21601e75c1e2757dd5e75710"
Jul 12 00:26:54.141726 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:26:54.141528    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts_odh-ai-gateway-infra(e4113e12-e9e5-4ead-a405-9fa63a4a74d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8"
Jul 12 00:26:55.643882 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:55.643850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:55.699591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:55.699554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:26:58.809506 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:26:58.809481    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:27:06.839749 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:06.839719    2582 scope.go:117] "RemoveContainer" containerID="ffa3e0d7695643b2bbab8ce0c663aa8ef9e50c1f21601e75c1e2757dd5e75710"
Jul 12 00:27:07.202238 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:07.202158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" event={"ID":"e4113e12-e9e5-4ead-a405-9fa63a4a74d8","Type":"ContainerStarted","Data":"fb52339883f70d3b48a224365c34efb445387459e74869f4cbf6117ea9f9151d"}
Jul 12 00:27:08.208564 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:08.208533    2582 generic.go:356] "Generic (PLEG): container finished" podID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerID="fb52339883f70d3b48a224365c34efb445387459e74869f4cbf6117ea9f9151d" exitCode=0
Jul 12 00:27:08.208973 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:08.208598    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" event={"ID":"e4113e12-e9e5-4ead-a405-9fa63a4a74d8","Type":"ContainerDied","Data":"fb52339883f70d3b48a224365c34efb445387459e74869f4cbf6117ea9f9151d"}
Jul 12 00:27:08.208973 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:08.208657    2582 scope.go:117] "RemoveContainer" containerID="ffa3e0d7695643b2bbab8ce0c663aa8ef9e50c1f21601e75c1e2757dd5e75710"
Jul 12 00:27:08.230790 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:08.230753    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"]
Jul 12 00:27:09.340227 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:09.340200    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"
Jul 12 00:27:09.426747 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:09.426716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4113e12-e9e5-4ead-a405-9fa63a4a74d8-maas-api-service-ca\") pod \"e4113e12-e9e5-4ead-a405-9fa63a4a74d8\" (UID: \"e4113e12-e9e5-4ead-a405-9fa63a4a74d8\") "
Jul 12 00:27:09.427085 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:09.427060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4113e12-e9e5-4ead-a405-9fa63a4a74d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4113e12-e9e5-4ead-a405-9fa63a4a74d8" (UID: "e4113e12-e9e5-4ead-a405-9fa63a4a74d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:27:09.528166 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:09.528090    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4113e12-e9e5-4ead-a405-9fa63a4a74d8-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:27:10.220424 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:10.220393    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"
Jul 12 00:27:10.220424 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:10.220418    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts" event={"ID":"e4113e12-e9e5-4ead-a405-9fa63a4a74d8","Type":"ContainerDied","Data":"84c07f0a974d7c755e131abc0df52a8943b2de25673eb9eb4222897e9987b124"}
Jul 12 00:27:10.220623 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:10.220469    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84c07f0a974d7c755e131abc0df52a8943b2de25673eb9eb4222897e9987b124"
Jul 12 00:27:10.248403 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:10.248372    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"]
Jul 12 00:27:10.252894 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:10.252870    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-c4lts"]
Jul 12 00:27:10.844677 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:10.844635    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" path="/var/lib/kubelet/pods/e4113e12-e9e5-4ead-a405-9fa63a4a74d8/volumes"
Jul 12 00:27:35.812206 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:35.812172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:27:35.862078 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:35.862053    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:27:50.127023 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.126994    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"]
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127275    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127285    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127304    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127310    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127317    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127322    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127374    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.127384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.127384    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:27:50.130255 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.130239    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"
Jul 12 00:27:50.132858 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.132828    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:27:50.136841 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.136818    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"]
Jul 12 00:27:50.266137 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.266104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724e8b00-4669-44cc-b7c3-e019bf62a549-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2\" (UID: \"724e8b00-4669-44cc-b7c3-e019bf62a549\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"
Jul 12 00:27:50.367098 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.367066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724e8b00-4669-44cc-b7c3-e019bf62a549-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2\" (UID: \"724e8b00-4669-44cc-b7c3-e019bf62a549\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"
Jul 12 00:27:50.367700 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.367675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724e8b00-4669-44cc-b7c3-e019bf62a549-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2\" (UID: \"724e8b00-4669-44cc-b7c3-e019bf62a549\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"
Jul 12 00:27:50.440672 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.440600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"
Jul 12 00:27:50.566155 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:50.566130    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"]
Jul 12 00:27:50.568500 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:27:50.568467    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724e8b00_4669_44cc_b7c3_e019bf62a549.slice/crio-5578da5d77da651871b033002ef8514c78522355840443a295fcd131dcfce241 WatchSource:0}: Error finding container 5578da5d77da651871b033002ef8514c78522355840443a295fcd131dcfce241: Status 404 returned error can't find the container with id 5578da5d77da651871b033002ef8514c78522355840443a295fcd131dcfce241
Jul 12 00:27:51.400490 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:51.400407    2582 generic.go:356] "Generic (PLEG): container finished" podID="724e8b00-4669-44cc-b7c3-e019bf62a549" containerID="deebe15b074fe35e8dee27e51946a72e587a00414e86cfe6bd732a9c291a68a3" exitCode=0
Jul 12 00:27:51.400490 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:51.400472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2" event={"ID":"724e8b00-4669-44cc-b7c3-e019bf62a549","Type":"ContainerDied","Data":"deebe15b074fe35e8dee27e51946a72e587a00414e86cfe6bd732a9c291a68a3"}
Jul 12 00:27:51.400913 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:51.400512    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2" event={"ID":"724e8b00-4669-44cc-b7c3-e019bf62a549","Type":"ContainerStarted","Data":"5578da5d77da651871b033002ef8514c78522355840443a295fcd131dcfce241"}
Jul 12 00:27:52.530778 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:52.530733    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"
Jul 12 00:27:52.686420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:52.686332    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724e8b00-4669-44cc-b7c3-e019bf62a549-maas-api-service-ca\") pod \"724e8b00-4669-44cc-b7c3-e019bf62a549\" (UID: \"724e8b00-4669-44cc-b7c3-e019bf62a549\") "
Jul 12 00:27:52.686696 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:52.686673    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/724e8b00-4669-44cc-b7c3-e019bf62a549-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "724e8b00-4669-44cc-b7c3-e019bf62a549" (UID: "724e8b00-4669-44cc-b7c3-e019bf62a549"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:27:52.787210 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:52.787181    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724e8b00-4669-44cc-b7c3-e019bf62a549-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:27:53.410628 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:53.410591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2" event={"ID":"724e8b00-4669-44cc-b7c3-e019bf62a549","Type":"ContainerDied","Data":"5578da5d77da651871b033002ef8514c78522355840443a295fcd131dcfce241"}
Jul 12 00:27:53.410628 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:53.410609    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2"
Jul 12 00:27:53.410853 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:27:53.410638    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5578da5d77da651871b033002ef8514c78522355840443a295fcd131dcfce241"
Jul 12 00:28:00.467439 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.467404    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"]
Jul 12 00:28:00.467900 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.467684    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4" podUID="8376424a-f9fa-4fc8-be2a-6483f9dcde5b" containerName="maas-api" containerID="cri-o://170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5" gracePeriod=30
Jul 12 00:28:00.491712 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.491685    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:00.713633 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.713609    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:28:00.743867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.743797    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n6qk\" (UniqueName: \"kubernetes.io/projected/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-kube-api-access-9n6qk\") pod \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") "
Jul 12 00:28:00.743867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.743835    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-openshift-service-ca\") pod \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") "
Jul 12 00:28:00.744076 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.743877    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls\") pod \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\" (UID: \"8376424a-f9fa-4fc8-be2a-6483f9dcde5b\") "
Jul 12 00:28:00.744270 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.744244    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8376424a-f9fa-4fc8-be2a-6483f9dcde5b" (UID: "8376424a-f9fa-4fc8-be2a-6483f9dcde5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:28:00.745965 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.745934    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8376424a-f9fa-4fc8-be2a-6483f9dcde5b" (UID: "8376424a-f9fa-4fc8-be2a-6483f9dcde5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:28:00.745965 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.745936    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-kube-api-access-9n6qk" (OuterVolumeSpecName: "kube-api-access-9n6qk") pod "8376424a-f9fa-4fc8-be2a-6483f9dcde5b" (UID: "8376424a-f9fa-4fc8-be2a-6483f9dcde5b"). InnerVolumeSpecName "kube-api-access-9n6qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:28:00.844890 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.844852    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n6qk\" (UniqueName: \"kubernetes.io/projected/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-kube-api-access-9n6qk\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:28:00.844890 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.844874    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:28:00.844890 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:00.844885    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8376424a-f9fa-4fc8-be2a-6483f9dcde5b-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:28:01.450381 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.450348    2582 generic.go:356] "Generic (PLEG): container finished" podID="8376424a-f9fa-4fc8-be2a-6483f9dcde5b" containerID="170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5" exitCode=0
Jul 12 00:28:01.450672 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.450406    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"
Jul 12 00:28:01.450672 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.450436    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4" event={"ID":"8376424a-f9fa-4fc8-be2a-6483f9dcde5b","Type":"ContainerDied","Data":"170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5"}
Jul 12 00:28:01.450672 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.450515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4" event={"ID":"8376424a-f9fa-4fc8-be2a-6483f9dcde5b","Type":"ContainerDied","Data":"888d34f385501cd93d05eb8ae7b24e5f2c25ff42659ab56cf1153332e9311278"}
Jul 12 00:28:01.450672 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.450541    2582 scope.go:117] "RemoveContainer" containerID="170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5"
Jul 12 00:28:01.458772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.458741    2582 scope.go:117] "RemoveContainer" containerID="170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5"
Jul 12 00:28:01.459012 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:28:01.458992    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5\": container with ID starting with 170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5 not found: ID does not exist" containerID="170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5"
Jul 12 00:28:01.459060 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.459019    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5"} err="failed to get container status \"170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5\": rpc error: code = NotFound desc = could not find container \"170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5\": container with ID starting with 170b5b8419a69cc24898ae8bcb03e17adac790dc6be1796d39ebdb3c4b6af0e5 not found: ID does not exist"
Jul 12 00:28:01.466127 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.466092    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"]
Jul 12 00:28:01.467973 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:01.467953    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aa3397f-656798fcfb-2sxl4"]
Jul 12 00:28:02.845964 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:02.845920    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8376424a-f9fa-4fc8-be2a-6483f9dcde5b" path="/var/lib/kubelet/pods/8376424a-f9fa-4fc8-be2a-6483f9dcde5b/volumes"
Jul 12 00:28:03.293594 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:03.293553    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:28:05.200266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:05.200228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:10.841232 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:10.841185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:10.897359 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:10.897329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:15.397093 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:15.397059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:16.055911 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:16.055868    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:16.153961 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:16.153930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:16.266148 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:16.266095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:17.872011 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:17.871982    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:21.962177 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:21.962145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:23.576668 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:23.576594    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:23.682546 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:23.682512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:23.776420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:23.776386    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:23.876549 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:23.876473    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:24.347444 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:24.347411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:50.447827 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:50.447800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:55.983276 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:55.983239    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:56.084209 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:56.084180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:56.184688 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:56.184658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:28:56.284633 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:28:56.284563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:00.951029 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:00.951002    2582 scope.go:117] "RemoveContainer" containerID="364cfa5031f8f50a606626af8860a41c4aaa461fae0dbaf4dd5544a1c29ece46"
Jul 12 00:29:04.792453 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:04.792418    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:12.246384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:12.246344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:17.981732 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:17.981699    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:18.089558 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:18.089527    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:18.182282 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:18.182245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:28.745167 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:28.745132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:29.614381 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:29.614350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:35.160935 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:35.160899    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:35.263084 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:35.263042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:35.361477 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:35.361442    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:35.461937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:35.461847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:36.337630 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:36.337580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:36.434905 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:36.434860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:36.532981 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:36.532950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:37.692043 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:37.692009    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:29:38.301777 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:38.301741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:44.045848 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:44.045816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:44.146088 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:44.146062    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:44.771798 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:44.771751    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:45.381731 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:45.381700    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:29:50.655604 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:50.655568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:50.715287 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:50.715255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:50.911554 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:50.911463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:51.218579 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218503    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"]
Jul 12 00:29:51.218805 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218793    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="724e8b00-4669-44cc-b7c3-e019bf62a549" containerName="revoke-keys"
Jul 12 00:29:51.218861 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218806    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="724e8b00-4669-44cc-b7c3-e019bf62a549" containerName="revoke-keys"
Jul 12 00:29:51.218861 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218839    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8376424a-f9fa-4fc8-be2a-6483f9dcde5b" containerName="maas-api"
Jul 12 00:29:51.218861 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218845    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8376424a-f9fa-4fc8-be2a-6483f9dcde5b" containerName="maas-api"
Jul 12 00:29:51.218952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218893    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8376424a-f9fa-4fc8-be2a-6483f9dcde5b" containerName="maas-api"
Jul 12 00:29:51.218952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218902    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="724e8b00-4669-44cc-b7c3-e019bf62a549" containerName="revoke-keys"
Jul 12 00:29:51.218952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.218911    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4113e12-e9e5-4ead-a405-9fa63a4a74d8" containerName="revoke-keys"
Jul 12 00:29:51.221734 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.221718    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.224697 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.224673    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-061e4a12-openshift-default-dockercfg-d9gjj\""
Jul 12 00:29:51.241670 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.241639    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"]
Jul 12 00:29:51.257799 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.246797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:51.301650 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-podinfo\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.301860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-envoy\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.301860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-credential-socket\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.301860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-socket\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.301860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istiod-ca-cert\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.301860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59crp\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-kube-api-access-59crp\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.302081 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-data\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.302081 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-token\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.302081 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.301931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-certs\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403050 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-data\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403050 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-token\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403265 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-certs\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403265 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-podinfo\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403265 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-envoy\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-credential-socket\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-socket\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istiod-ca-cert\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403573 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59crp\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-kube-api-access-59crp\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403573 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-data\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403573 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-certs\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403747 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-credential-socket\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.403826 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.403756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-socket\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.404134 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.404112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istiod-ca-cert\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.405412 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.405391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-envoy\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.405629 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.405609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-podinfo\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.411164 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.411137    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59crp\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-kube-api-access-59crp\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.411306 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.411291    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-token\") pod \"e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") " pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.531709 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.531616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:51.667856 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.667832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"]
Jul 12 00:29:51.669737 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:29:51.669714    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9a732b_2f11_43a6_8056_4980a6ba0a5e.slice/crio-111a91c25e41ecc7cbc5d7519bc236962fa99319203927ec8acacfe2d7f591d9 WatchSource:0}: Error finding container 111a91c25e41ecc7cbc5d7519bc236962fa99319203927ec8acacfe2d7f591d9: Status 404 returned error can't find the container with id 111a91c25e41ecc7cbc5d7519bc236962fa99319203927ec8acacfe2d7f591d9
Jul 12 00:29:51.671816 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.671780    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:29:51.671910 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.671864    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:29:51.671977 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.671909    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:29:51.682167 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.682138    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:51.928971 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.928936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" event={"ID":"0a9a732b-2f11-43a6-8056-4980a6ba0a5e","Type":"ContainerStarted","Data":"2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201"}
Jul 12 00:29:51.929149 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.928987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" event={"ID":"0a9a732b-2f11-43a6-8056-4980a6ba0a5e","Type":"ContainerStarted","Data":"111a91c25e41ecc7cbc5d7519bc236962fa99319203927ec8acacfe2d7f591d9"}
Jul 12 00:29:51.950336 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:51.950286    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" podStartSLOduration=0.950272283 podStartE2EDuration="950.272283ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:29:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:29:51.948982695 +0000 UTC m=+1971.578090250" watchObservedRunningTime="2026-07-12 00:29:51.950272283 +0000 UTC m=+1971.579379793"
Jul 12 00:29:52.532401 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:52.532365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:52.537314 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:52.537287    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:52.933557 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:52.933521    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:52.934517 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:52.934499    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:29:54.334394 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.334361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:54.415249 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.415217    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:54.416347 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.416323    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"]
Jul 12 00:29:54.420289 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.420271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.423140 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.423118    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:29:54.424009 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.423991    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 00:29:54.424086 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.424044    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-061e4a12-serving-cert\""
Jul 12 00:29:54.424141 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.424044    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\""
Jul 12 00:29:54.428712 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.428680    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"]
Jul 12 00:29:54.484077 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.484047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:54.531176 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.531146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d35b7c57-d416-4dfa-83ba-5348c306fdcc-openshift-service-ca\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.531311 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.531213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747vj\" (UniqueName: \"kubernetes.io/projected/d35b7c57-d416-4dfa-83ba-5348c306fdcc-kube-api-access-747vj\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.531311 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.531256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d35b7c57-d416-4dfa-83ba-5348c306fdcc-maas-api-tls\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.632204 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.632130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-747vj\" (UniqueName: \"kubernetes.io/projected/d35b7c57-d416-4dfa-83ba-5348c306fdcc-kube-api-access-747vj\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.632204 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.632167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d35b7c57-d416-4dfa-83ba-5348c306fdcc-maas-api-tls\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.632204 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.632196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d35b7c57-d416-4dfa-83ba-5348c306fdcc-openshift-service-ca\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.632936 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.632914    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d35b7c57-d416-4dfa-83ba-5348c306fdcc-openshift-service-ca\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.634834 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.634811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d35b7c57-d416-4dfa-83ba-5348c306fdcc-maas-api-tls\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.636499 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.636478    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:54.640221 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.640198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-747vj\" (UniqueName: \"kubernetes.io/projected/d35b7c57-d416-4dfa-83ba-5348c306fdcc-kube-api-access-747vj\") pod \"maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.692820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.692769    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:29:54.732340 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.732302    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:54.867670 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.867647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"]
Jul 12 00:29:54.870122 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:29:54.870094    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35b7c57_d416_4dfa_83ba_5348c306fdcc.slice/crio-2fc409788b199f9a5c50709d0cc6caef5334f46701fa0d6fa7416e0cc3a015a6 WatchSource:0}: Error finding container 2fc409788b199f9a5c50709d0cc6caef5334f46701fa0d6fa7416e0cc3a015a6: Status 404 returned error can't find the container with id 2fc409788b199f9a5c50709d0cc6caef5334f46701fa0d6fa7416e0cc3a015a6
Jul 12 00:29:54.870617 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.870599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:54.871558 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.871539    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:29:54.931465 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.931405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:54.943194 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:54.943168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4" event={"ID":"d35b7c57-d416-4dfa-83ba-5348c306fdcc","Type":"ContainerStarted","Data":"2fc409788b199f9a5c50709d0cc6caef5334f46701fa0d6fa7416e0cc3a015a6"}
Jul 12 00:29:55.948683 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:55.948644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4" event={"ID":"d35b7c57-d416-4dfa-83ba-5348c306fdcc","Type":"ContainerStarted","Data":"763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a"}
Jul 12 00:29:55.949091 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:55.948797    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:29:55.966332 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:55.966286    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4" podStartSLOduration=1.451466382 podStartE2EDuration="1.966271299s" totalImagesPullingTime="514.804917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:29:55.964785996 +0000 UTC m=+1975.593893530" watchObservedRunningTime="2026-07-12 00:29:55.966271299 +0000 UTC m=+1975.595378810"
Jul 12 00:29:58.878329 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:58.878297    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:59.621707 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:59.621677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:29:59.719896 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:29:59.719870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:00.105976 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:00.105943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:01.960975 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:01.960939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:30:05.745745 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:05.745704    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:05.801517 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:05.801492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:06.121002 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.120970    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"]
Jul 12 00:30:06.124091 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.124073    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"
Jul 12 00:30:06.126673 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.126649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:30:06.132972 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.131734    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"]
Jul 12 00:30:06.233839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.233805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k\" (UID: \"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"
Jul 12 00:30:06.335204 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.335158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k\" (UID: \"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"
Jul 12 00:30:06.336104 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.336076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k\" (UID: \"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"
Jul 12 00:30:06.384647 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.384547    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:30:06.436298 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.436253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"
Jul 12 00:30:06.579209 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:06.579008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"]
Jul 12 00:30:06.581363 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:30:06.581329    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6a884e_ccaf_4c6a_b69f_706fe3ad7ede.slice/crio-b6b02a7d9c76580e8587fd654b1db7631b00fcae808be57992e84a0f5f92c609 WatchSource:0}: Error finding container b6b02a7d9c76580e8587fd654b1db7631b00fcae808be57992e84a0f5f92c609: Status 404 returned error can't find the container with id b6b02a7d9c76580e8587fd654b1db7631b00fcae808be57992e84a0f5f92c609
Jul 12 00:30:07.003314 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:07.003212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k" event={"ID":"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede","Type":"ContainerStarted","Data":"3f24d21aff5881109d45a22c9984aa49fa8d6031a3357a23d67aab5786f17d96"}
Jul 12 00:30:07.003314 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:07.003281    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k" event={"ID":"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede","Type":"ContainerStarted","Data":"b6b02a7d9c76580e8587fd654b1db7631b00fcae808be57992e84a0f5f92c609"}
Jul 12 00:30:07.018528 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:07.018473    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k" podStartSLOduration=1.018457751 podStartE2EDuration="1.018457751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:30:07.017670068 +0000 UTC m=+1986.646777580" watchObservedRunningTime="2026-07-12 00:30:07.018457751 +0000 UTC m=+1986.647565260"
Jul 12 00:30:08.011230 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:08.011191    2582 generic.go:356] "Generic (PLEG): container finished" podID="2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede" containerID="3f24d21aff5881109d45a22c9984aa49fa8d6031a3357a23d67aab5786f17d96" exitCode=0
Jul 12 00:30:08.011606 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:08.011269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k" event={"ID":"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede","Type":"ContainerDied","Data":"3f24d21aff5881109d45a22c9984aa49fa8d6031a3357a23d67aab5786f17d96"}
Jul 12 00:30:08.321008 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:08.320186    2582 patch_prober.go:28] interesting pod/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": read tcp 10.133.0.2:54536->10.133.0.40:15021: read: connection reset by peer" start-of-body=
Jul 12 00:30:08.321008 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:08.320282    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": read tcp 10.133.0.2:54536->10.133.0.40:15021: read: connection reset by peer"
Jul 12 00:30:09.017090 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.017054    2582 generic.go:356] "Generic (PLEG): container finished" podID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerID="2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201" exitCode=0
Jul 12 00:30:09.017472 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.017085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" event={"ID":"0a9a732b-2f11-43a6-8056-4980a6ba0a5e","Type":"ContainerDied","Data":"2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201"}
Jul 12 00:30:09.017844 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.017624    2582 scope.go:117] "RemoveContainer" containerID="2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201"
Jul 12 00:30:09.018651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.018616    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:30:09.018752 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.018685    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:30:09.018752 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.018720    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:30:09.162247 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.162220    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"
Jul 12 00:30:09.263475 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.263439    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede-maas-api-service-ca\") pod \"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede\" (UID: \"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede\") "
Jul 12 00:30:09.263792 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.263752    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede" (UID: "2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:30:09.365026 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:09.364990    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:10.023385 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:10.023340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" event={"ID":"0a9a732b-2f11-43a6-8056-4980a6ba0a5e","Type":"ContainerStarted","Data":"a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5"}
Jul 12 00:30:10.024618 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:10.024598    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k"
Jul 12 00:30:10.024791 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:10.024621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k" event={"ID":"2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede","Type":"ContainerDied","Data":"b6b02a7d9c76580e8587fd654b1db7631b00fcae808be57992e84a0f5f92c609"}
Jul 12 00:30:10.024791 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:10.024660    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6b02a7d9c76580e8587fd654b1db7631b00fcae808be57992e84a0f5f92c609"
Jul 12 00:30:10.532631 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:10.532005    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:30:10.532631 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:10.532338    2582 patch_prober.go:28] interesting pod/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 12 00:30:10.532631 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:10.532384    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 12 00:30:11.532545 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:11.532505    2582 patch_prober.go:28] interesting pod/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 12 00:30:11.533140 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:11.533103    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 12 00:30:12.532827 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:12.532783    2582 patch_prober.go:28] interesting pod/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 12 00:30:12.533298 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:12.532857    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 12 00:30:13.532676 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:13.532627    2582 patch_prober.go:28] interesting pod/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 12 00:30:13.532903 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:13.532710    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 12 00:30:14.535637 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:14.535607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:30:14.536108 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:14.536007    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:30:14.536768 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:14.536735    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:30:14.808849 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:14.808750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:14.909733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:14.909702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:16.470935 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.470901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"]
Jul 12 00:30:16.471428 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.471141    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4" podUID="d35b7c57-d416-4dfa-83ba-5348c306fdcc" containerName="maas-api" containerID="cri-o://763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a" gracePeriod=30
Jul 12 00:30:16.495588 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.495566    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:16.716859 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.716835    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:30:16.721288 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.721238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d35b7c57-d416-4dfa-83ba-5348c306fdcc-maas-api-tls\") pod \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") "
Jul 12 00:30:16.721380 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.721307    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d35b7c57-d416-4dfa-83ba-5348c306fdcc-openshift-service-ca\") pod \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") "
Jul 12 00:30:16.721380 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.721339    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-747vj\" (UniqueName: \"kubernetes.io/projected/d35b7c57-d416-4dfa-83ba-5348c306fdcc-kube-api-access-747vj\") pod \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\" (UID: \"d35b7c57-d416-4dfa-83ba-5348c306fdcc\") "
Jul 12 00:30:16.721634 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.721605    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d35b7c57-d416-4dfa-83ba-5348c306fdcc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d35b7c57-d416-4dfa-83ba-5348c306fdcc" (UID: "d35b7c57-d416-4dfa-83ba-5348c306fdcc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:30:16.723196 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.723178    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d35b7c57-d416-4dfa-83ba-5348c306fdcc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d35b7c57-d416-4dfa-83ba-5348c306fdcc" (UID: "d35b7c57-d416-4dfa-83ba-5348c306fdcc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:30:16.723373 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.723352    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d35b7c57-d416-4dfa-83ba-5348c306fdcc-kube-api-access-747vj" (OuterVolumeSpecName: "kube-api-access-747vj") pod "d35b7c57-d416-4dfa-83ba-5348c306fdcc" (UID: "d35b7c57-d416-4dfa-83ba-5348c306fdcc"). InnerVolumeSpecName "kube-api-access-747vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:30:16.822510 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.822481    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d35b7c57-d416-4dfa-83ba-5348c306fdcc-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:16.822510 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.822508    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-747vj\" (UniqueName: \"kubernetes.io/projected/d35b7c57-d416-4dfa-83ba-5348c306fdcc-kube-api-access-747vj\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:16.822510 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:16.822518    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d35b7c57-d416-4dfa-83ba-5348c306fdcc-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:17.075485 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.075452    2582 generic.go:356] "Generic (PLEG): container finished" podID="d35b7c57-d416-4dfa-83ba-5348c306fdcc" containerID="763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a" exitCode=0
Jul 12 00:30:17.075634 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.075496    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"
Jul 12 00:30:17.075634 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.075527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4" event={"ID":"d35b7c57-d416-4dfa-83ba-5348c306fdcc","Type":"ContainerDied","Data":"763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a"}
Jul 12 00:30:17.075634 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.075565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4" event={"ID":"d35b7c57-d416-4dfa-83ba-5348c306fdcc","Type":"ContainerDied","Data":"2fc409788b199f9a5c50709d0cc6caef5334f46701fa0d6fa7416e0cc3a015a6"}
Jul 12 00:30:17.075634 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.075585    2582 scope.go:117] "RemoveContainer" containerID="763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a"
Jul 12 00:30:17.088959 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.088935    2582 scope.go:117] "RemoveContainer" containerID="763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a"
Jul 12 00:30:17.089219 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:30:17.089197    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a\": container with ID starting with 763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a not found: ID does not exist" containerID="763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a"
Jul 12 00:30:17.089272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.089226    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a"} err="failed to get container status \"763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a\": rpc error: code = NotFound desc = could not find container \"763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a\": container with ID starting with 763ef03c26aa57a0878fadd42db33a1f58df3909f8d059f224e6928135c7122a not found: ID does not exist"
Jul 12 00:30:17.095784 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.095749    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"]
Jul 12 00:30:17.099228 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:17.099208    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-061e4a12-7fdcb46544-kxgm4"]
Jul 12 00:30:18.844258 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:18.844222    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d35b7c57-d416-4dfa-83ba-5348c306fdcc" path="/var/lib/kubelet/pods/d35b7c57-d416-4dfa-83ba-5348c306fdcc/volumes"
Jul 12 00:30:19.382276 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:19.382233    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:30:21.197719 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:21.197681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:26.970192 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:26.970152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:27.028000 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:27.027945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:31.906074 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:31.906036    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"]
Jul 12 00:30:31.906582 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:31.906249    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy" containerID="cri-o://a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5" gracePeriod=30
Jul 12 00:30:31.928517 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:31.928486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:32.162363 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:32.162275    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:32.316018 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:32.315934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:32.401503 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:32.401468    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:32.563456 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:32.563414    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:37.152959 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.152931    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:30:37.164169 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.164143    2582 generic.go:356] "Generic (PLEG): container finished" podID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerID="a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5" exitCode=0
Jul 12 00:30:37.164324 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.164192    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"
Jul 12 00:30:37.164324 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.164213    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" event={"ID":"0a9a732b-2f11-43a6-8056-4980a6ba0a5e","Type":"ContainerDied","Data":"a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5"}
Jul 12 00:30:37.164324 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.164263    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g" event={"ID":"0a9a732b-2f11-43a6-8056-4980a6ba0a5e","Type":"ContainerDied","Data":"111a91c25e41ecc7cbc5d7519bc236962fa99319203927ec8acacfe2d7f591d9"}
Jul 12 00:30:37.164324 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.164287    2582 scope.go:117] "RemoveContainer" containerID="a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5"
Jul 12 00:30:37.172332 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.172316    2582 scope.go:117] "RemoveContainer" containerID="2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201"
Jul 12 00:30:37.183220 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.183199    2582 scope.go:117] "RemoveContainer" containerID="a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5"
Jul 12 00:30:37.183518 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:30:37.183500    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5\": container with ID starting with a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5 not found: ID does not exist" containerID="a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5"
Jul 12 00:30:37.183579 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.183528    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5"} err="failed to get container status \"a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5\": rpc error: code = NotFound desc = could not find container \"a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5\": container with ID starting with a8e3d2e8deac1acef53b3364ae18277fade326f281f6caa27db662cd546612f5 not found: ID does not exist"
Jul 12 00:30:37.183579 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.183546    2582 scope.go:117] "RemoveContainer" containerID="2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201"
Jul 12 00:30:37.183788 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:30:37.183748    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201\": container with ID starting with 2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201 not found: ID does not exist" containerID="2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201"
Jul 12 00:30:37.183788 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.183782    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201"} err="failed to get container status \"2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201\": rpc error: code = NotFound desc = could not find container \"2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201\": container with ID starting with 2d8a836264e20f98bf713ffa7ffe07fcd56cfe39c174c0365d1a072302ef5201 not found: ID does not exist"
Jul 12 00:30:37.282974 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.282933    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-socket\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.282974 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.282979    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59crp\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-kube-api-access-59crp\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283014    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istiod-ca-cert\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283036    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-token\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283053    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-credential-socket\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283111    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-podinfo\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283136    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-certs\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283168    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-envoy\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283207 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283188    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-data\") pod \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\" (UID: \"0a9a732b-2f11-43a6-8056-4980a6ba0a5e\") "
Jul 12 00:30:37.283563 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283236    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:30:37.283563 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283470    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:30:37.283563 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283498    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.283713 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283567    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:30:37.283713 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.283681    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:30:37.284720 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.284690    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:30:37.285392 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.285365    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:30:37.285473 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.285370    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-kube-api-access-59crp" (OuterVolumeSpecName: "kube-api-access-59crp") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "kube-api-access-59crp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:30:37.285473 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.285373    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 00:30:37.285473 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.285421    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a9a732b-2f11-43a6-8056-4980a6ba0a5e" (UID: "0a9a732b-2f11-43a6-8056-4980a6ba0a5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:30:37.384090 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384061    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-podinfo\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.384090 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384087    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-workload-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.384090 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384097    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-envoy\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.384304 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384104    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-data\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.384304 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384113    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59crp\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-kube-api-access-59crp\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.384304 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384122    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istiod-ca-cert\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.384304 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384130    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-istio-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.384304 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.384138    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a732b-2f11-43a6-8056-4980a6ba0a5e-credential-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:30:37.488369 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.488339    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"]
Jul 12 00:30:37.492453 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:37.492422    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-061e4a12-openshift-default-5c64669bdc-58v2g"]
Jul 12 00:30:38.298940 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:38.298904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:38.380979 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:38.380954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:38.454679 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:38.454650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:38.558033 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:38.557958    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:38.708470 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:38.708439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:38.844648 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:38.844570    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" path="/var/lib/kubelet/pods/0a9a732b-2f11-43a6-8056-4980a6ba0a5e/volumes"
Jul 12 00:30:44.379045 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:44.378990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:44.440866 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:44.440840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:51.002392 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.002363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:51.104177 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.104147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:51.409441 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.409412    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:51.713584 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.713492    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"]
Jul 12 00:30:51.714120 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714097    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy"
Jul 12 00:30:51.714120 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714118    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy"
Jul 12 00:30:51.714294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714128    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d35b7c57-d416-4dfa-83ba-5348c306fdcc" containerName="maas-api"
Jul 12 00:30:51.714294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714134    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d35b7c57-d416-4dfa-83ba-5348c306fdcc" containerName="maas-api"
Jul 12 00:30:51.714294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714145    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede" containerName="revoke-keys"
Jul 12 00:30:51.714294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714150    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede" containerName="revoke-keys"
Jul 12 00:30:51.714294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714206    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede" containerName="revoke-keys"
Jul 12 00:30:51.714294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714214    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy"
Jul 12 00:30:51.714294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.714223    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d35b7c57-d416-4dfa-83ba-5348c306fdcc" containerName="maas-api"
Jul 12 00:30:51.717268 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.717245    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.719999 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.719979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-68596461-openshift-default-dockercfg-fszkg\""
Jul 12 00:30:51.727406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.727378    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"]
Jul 12 00:30:51.741110 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.741087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:51.806043 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-socket\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806227 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-certs\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806227 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-token\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806227 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-envoy\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806227 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-credential-socket\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806227 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istiod-ca-cert\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806227 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-podinfo\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806549 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m84j7\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-kube-api-access-m84j7\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.806549 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.806264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-data\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906815 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-token\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-envoy\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-credential-socket\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istiod-ca-cert\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-podinfo\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m84j7\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-kube-api-access-m84j7\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-data\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.906991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.906987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-socket\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.907363 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.907020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-certs\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.907363 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.907301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-credential-socket\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.907483 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.907465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-certs\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.907562 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.907541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-data\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.907665 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.907649    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-socket\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.907814 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.907795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istiod-ca-cert\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.909173 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.909151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-envoy\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.909749 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.909727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-podinfo\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.914843 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.914821    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-token\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:51.915033 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:51.915012    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m84j7\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-kube-api-access-m84j7\") pod \"e2e-mt-68596461-openshift-default-575b59cbcf-87qms\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") " pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:52.028891 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:52.028806    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:52.168032 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:52.168003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"]
Jul 12 00:30:52.170840 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:30:52.170814    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeab7b5e_16a3_422f_8b3e_dda932c0cd2f.slice/crio-ba5518db9d50a61c1aaa8558755c76ce4410d460c622f177d2919c4629ef6d73 WatchSource:0}: Error finding container ba5518db9d50a61c1aaa8558755c76ce4410d460c622f177d2919c4629ef6d73: Status 404 returned error can't find the container with id ba5518db9d50a61c1aaa8558755c76ce4410d460c622f177d2919c4629ef6d73
Jul 12 00:30:52.173506 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:52.173470    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:30:52.173591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:52.173539    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:30:52.173591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:52.173566    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:30:52.236647 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:52.236607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" event={"ID":"beab7b5e-16a3-422f-8b3e-dda932c0cd2f","Type":"ContainerStarted","Data":"ba5518db9d50a61c1aaa8558755c76ce4410d460c622f177d2919c4629ef6d73"}
Jul 12 00:30:52.382449 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:52.382404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:53.242938 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:53.242900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" event={"ID":"beab7b5e-16a3-422f-8b3e-dda932c0cd2f","Type":"ContainerStarted","Data":"11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9"}
Jul 12 00:30:53.263545 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:53.263494    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podStartSLOduration=2.263476586 podStartE2EDuration="2.263476586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:30:53.261609621 +0000 UTC m=+2032.890717125" watchObservedRunningTime="2026-07-12 00:30:53.263476586 +0000 UTC m=+2032.892584095"
Jul 12 00:30:54.029893 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:54.029858    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:54.034868 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:54.034840    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:54.247718 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:54.247688    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:54.248877 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:54.248856    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:30:55.213079 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:55.213048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:55.336167 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:55.336127    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:55.425975 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:55.425938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:55.523714 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:55.523633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:55.829713 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:55.829683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:55.930324 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:55.930294    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:30:59.815067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:30:59.815034    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:31:00.979386 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:00.979351    2582 scope.go:117] "RemoveContainer" containerID="90c04dbf31f590a24aa7dfe25fc3eced744d6af866e705cdb22ceb4eaf8fb1a3"
Jul 12 00:31:01.447051 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:01.447012    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:31:02.085497 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:02.085455    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:31:09.658344 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:09.657118    2582 patch_prober.go:28] interesting pod/e2e-mt-68596461-openshift-default-575b59cbcf-87qms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:38776->10.133.0.43:15021: read: connection reset by peer" start-of-body=
Jul 12 00:31:09.658344 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:09.657204    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:38776->10.133.0.43:15021: read: connection reset by peer"
Jul 12 00:31:10.329446 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:10.329415    2582 generic.go:356] "Generic (PLEG): container finished" podID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerID="11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9" exitCode=0
Jul 12 00:31:10.329624 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:10.329462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" event={"ID":"beab7b5e-16a3-422f-8b3e-dda932c0cd2f","Type":"ContainerDied","Data":"11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9"}
Jul 12 00:31:10.329859 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:10.329847    2582 scope.go:117] "RemoveContainer" containerID="11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9"
Jul 12 00:31:10.330915 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:10.330884    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:31:10.330978 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:10.330953    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:31:10.331016 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:10.331000    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:31:11.282740 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:11.282707    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:31:11.338890 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:11.338854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" event={"ID":"beab7b5e-16a3-422f-8b3e-dda932c0cd2f","Type":"ContainerStarted","Data":"0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1"}
Jul 12 00:31:12.029178 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:12.029139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:31:12.029361 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:12.029335    2582 patch_prober.go:28] interesting pod/e2e-mt-68596461-openshift-default-575b59cbcf-87qms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 12 00:31:12.029410 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:12.029394    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 12 00:31:13.029956 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:13.029926    2582 patch_prober.go:28] interesting pod/e2e-mt-68596461-openshift-default-575b59cbcf-87qms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 12 00:31:13.030337 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:13.029979    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 12 00:31:14.029912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:14.029866    2582 patch_prober.go:28] interesting pod/e2e-mt-68596461-openshift-default-575b59cbcf-87qms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 12 00:31:14.030125 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:14.029941    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 12 00:31:15.029628 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:15.029585    2582 patch_prober.go:28] interesting pod/e2e-mt-68596461-openshift-default-575b59cbcf-87qms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 12 00:31:15.029865 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:15.029840    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 12 00:31:16.034398 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:16.034365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:31:16.034846 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:16.034721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:31:16.035386 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:16.035359    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:31:19.986538 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:19.986501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:31:22.685181 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.685141    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"]
Jul 12 00:31:22.685785 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.685581    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy"
Jul 12 00:31:22.685785 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.685600    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy"
Jul 12 00:31:22.685785 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.685706    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9a732b-2f11-43a6-8056-4980a6ba0a5e" containerName="istio-proxy"
Jul 12 00:31:22.688811 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.688791    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"
Jul 12 00:31:22.691262 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.691228    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:31:22.691386 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.691291    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:31:22.698944 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.698919    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"]
Jul 12 00:31:22.756487 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.756426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d11faf9f-720d-41a6-9743-156d9bb8d4fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-68596461-sxltj\" (UID: \"d11faf9f-720d-41a6-9743-156d9bb8d4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"
Jul 12 00:31:22.857280 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.857252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d11faf9f-720d-41a6-9743-156d9bb8d4fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-68596461-sxltj\" (UID: \"d11faf9f-720d-41a6-9743-156d9bb8d4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"
Jul 12 00:31:22.857871 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:22.857852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d11faf9f-720d-41a6-9743-156d9bb8d4fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-68596461-sxltj\" (UID: \"d11faf9f-720d-41a6-9743-156d9bb8d4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"
Jul 12 00:31:23.001307 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:23.001204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"
Jul 12 00:31:23.126317 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:23.126295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"]
Jul 12 00:31:23.128752 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:31:23.128723    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11faf9f_720d_41a6_9743_156d9bb8d4fc.slice/crio-bd022e7d6282f7913175f78867898f5b2d72987227b0032d20ba7eb32ef7c3b7 WatchSource:0}: Error finding container bd022e7d6282f7913175f78867898f5b2d72987227b0032d20ba7eb32ef7c3b7: Status 404 returned error can't find the container with id bd022e7d6282f7913175f78867898f5b2d72987227b0032d20ba7eb32ef7c3b7
Jul 12 00:31:23.403556 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:23.403521    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj" event={"ID":"d11faf9f-720d-41a6-9743-156d9bb8d4fc","Type":"ContainerStarted","Data":"bd022e7d6282f7913175f78867898f5b2d72987227b0032d20ba7eb32ef7c3b7"}
Jul 12 00:31:24.409795 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:24.409740    2582 generic.go:356] "Generic (PLEG): container finished" podID="d11faf9f-720d-41a6-9743-156d9bb8d4fc" containerID="d25c0f9efe2220e4ef085868d43ed1dfbe3466938141e2d4b274991a8b74643a" exitCode=0
Jul 12 00:31:24.410166 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:24.409811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj" event={"ID":"d11faf9f-720d-41a6-9743-156d9bb8d4fc","Type":"ContainerDied","Data":"d25c0f9efe2220e4ef085868d43ed1dfbe3466938141e2d4b274991a8b74643a"}
Jul 12 00:31:25.545253 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:25.545225    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"
Jul 12 00:31:25.580692 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:25.580664    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d11faf9f-720d-41a6-9743-156d9bb8d4fc-maas-api-service-ca\") pod \"d11faf9f-720d-41a6-9743-156d9bb8d4fc\" (UID: \"d11faf9f-720d-41a6-9743-156d9bb8d4fc\") "
Jul 12 00:31:25.581128 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:25.581099    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d11faf9f-720d-41a6-9743-156d9bb8d4fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d11faf9f-720d-41a6-9743-156d9bb8d4fc" (UID: "d11faf9f-720d-41a6-9743-156d9bb8d4fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:31:25.681458 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:25.681390    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d11faf9f-720d-41a6-9743-156d9bb8d4fc-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:31:26.420033 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:26.420004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj" event={"ID":"d11faf9f-720d-41a6-9743-156d9bb8d4fc","Type":"ContainerDied","Data":"bd022e7d6282f7913175f78867898f5b2d72987227b0032d20ba7eb32ef7c3b7"}
Jul 12 00:31:26.420033 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:26.420021    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68596461-sxltj"
Jul 12 00:31:26.420246 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:26.420050    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd022e7d6282f7913175f78867898f5b2d72987227b0032d20ba7eb32ef7c3b7"
Jul 12 00:31:33.211013 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:33.210974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:31:36.786067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:36.786031    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:31:37.764054 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:37.764018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:31:42.787195 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:31:42.787162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:01.003608 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:01.003577    2582 scope.go:117] "RemoveContainer" containerID="876e8e2d0ec48e0662af1e0abd92773f48f4f6a0e02dfd53d6402ec737c6b511"
Jul 12 00:32:19.427493 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:19.427462    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:20.588348 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:20.588312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:25.350407 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:25.350372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:25.407424 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:25.407390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:29.897680 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:29.897652    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"]
Jul 12 00:32:29.898152 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:29.897899    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy" containerID="cri-o://0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1" gracePeriod=30
Jul 12 00:32:29.919904 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:29.919872    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:30.033850 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:30.033818    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:30.134714 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:30.134675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:31.037631 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:31.037593    2582 patch_prober.go:28] interesting pod/e2e-mt-68596461-openshift-default-575b59cbcf-87qms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 00:32:31.038039 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:31.037649    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 00:32:31.141374 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:31.141335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:31.231490 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:31.231465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:31.331052 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:31.330967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:32.068330 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:32.068280    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:32.179192 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:32.179163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:32.277140 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:32.277110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:33.679164 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:33.679128    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:34.285677 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:34.285644    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:32:35.142999 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.142974    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:32:35.252597 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252517    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-podinfo\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252597 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252558    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m84j7\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-kube-api-access-m84j7\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252628    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istiod-ca-cert\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252662    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-socket\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-data\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252703    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-certs\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252751    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-token\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-envoy\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.252854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.252838    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-credential-socket\") pod \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\" (UID: \"beab7b5e-16a3-422f-8b3e-dda932c0cd2f\") "
Jul 12 00:32:35.253211 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.253009    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:32:35.253211 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.253088    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:32:35.253211 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.253130    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.253211 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.253200    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:32:35.253417 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.253243    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:32:35.253689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.253658    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:32:35.254817 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.254744    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 00:32:35.254938 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.254814    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-kube-api-access-m84j7" (OuterVolumeSpecName: "kube-api-access-m84j7") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "kube-api-access-m84j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:32:35.255299 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.255282    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:32:35.255299 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.255283    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "beab7b5e-16a3-422f-8b3e-dda932c0cd2f" (UID: "beab7b5e-16a3-422f-8b3e-dda932c0cd2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:32:35.353639 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353608    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-workload-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.353639 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353633    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.353639 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353642    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-envoy\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.353912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353652    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-credential-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.353912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353663    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-podinfo\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.353912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353673    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m84j7\" (UniqueName: \"kubernetes.io/projected/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-kube-api-access-m84j7\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.353912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353681    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istiod-ca-cert\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.353912 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.353689    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beab7b5e-16a3-422f-8b3e-dda932c0cd2f-istio-data\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:32:35.733826 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.733794    2582 generic.go:356] "Generic (PLEG): container finished" podID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerID="0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1" exitCode=0
Jul 12 00:32:35.734026 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.733877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" event={"ID":"beab7b5e-16a3-422f-8b3e-dda932c0cd2f","Type":"ContainerDied","Data":"0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1"}
Jul 12 00:32:35.734026 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.733906    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"
Jul 12 00:32:35.734026 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.733924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms" event={"ID":"beab7b5e-16a3-422f-8b3e-dda932c0cd2f","Type":"ContainerDied","Data":"ba5518db9d50a61c1aaa8558755c76ce4410d460c622f177d2919c4629ef6d73"}
Jul 12 00:32:35.734026 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.733954    2582 scope.go:117] "RemoveContainer" containerID="0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1"
Jul 12 00:32:35.743407 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.743390    2582 scope.go:117] "RemoveContainer" containerID="11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9"
Jul 12 00:32:35.751235 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.751216    2582 scope.go:117] "RemoveContainer" containerID="0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1"
Jul 12 00:32:35.751493 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:32:35.751474    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1\": container with ID starting with 0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1 not found: ID does not exist" containerID="0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1"
Jul 12 00:32:35.751539 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.751501    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1"} err="failed to get container status \"0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1\": rpc error: code = NotFound desc = could not find container \"0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1\": container with ID starting with 0f0289df2595b9cb1a84bdc54c3acff8384c3282f835d3daedca7ab2e8de7aa1 not found: ID does not exist"
Jul 12 00:32:35.751539 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.751518    2582 scope.go:117] "RemoveContainer" containerID="11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9"
Jul 12 00:32:35.751786 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:32:35.751747    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9\": container with ID starting with 11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9 not found: ID does not exist" containerID="11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9"
Jul 12 00:32:35.751833 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.751794    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9"} err="failed to get container status \"11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9\": rpc error: code = NotFound desc = could not find container \"11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9\": container with ID starting with 11aa02a52dbbff188b4666733292dbbb59abe06c640e47eef0f8176b4aed26b9 not found: ID does not exist"
Jul 12 00:32:35.755870 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.755848    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"]
Jul 12 00:32:35.763370 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:35.763349    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-68596461-openshift-default-575b59cbcf-87qms"]
Jul 12 00:32:36.844415 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:36.844382    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" path="/var/lib/kubelet/pods/beab7b5e-16a3-422f-8b3e-dda932c0cd2f/volumes"
Jul 12 00:32:39.440218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:39.440185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:39.498190 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:39.498161    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:40.153953 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:40.153916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:45.891053 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:45.891005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:45.951564 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:45.951535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:46.032797 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:46.032725    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:46.131559 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:46.131530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:46.884980 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:46.884943    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:32:56.621005 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:56.620920    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:32:56.994042 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:32:56.993956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:07.055008 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:07.054977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:17.968840 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:17.968806    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:23.777024 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:23.776985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:23.838283 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:23.838252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:24.071811 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.071734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:24.381542 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381463    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"]
Jul 12 00:33:24.381771 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381746    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy"
Jul 12 00:33:24.381820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381774    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy"
Jul 12 00:33:24.381820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381794    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy"
Jul 12 00:33:24.381820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381800    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy"
Jul 12 00:33:24.381820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381811    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11faf9f-720d-41a6-9743-156d9bb8d4fc" containerName="revoke-keys"
Jul 12 00:33:24.381820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381817    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11faf9f-720d-41a6-9743-156d9bb8d4fc" containerName="revoke-keys"
Jul 12 00:33:24.381976 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381865    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy"
Jul 12 00:33:24.381976 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.381875    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11faf9f-720d-41a6-9743-156d9bb8d4fc" containerName="revoke-keys"
Jul 12 00:33:24.384924 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.384903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.387500 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.387478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e82014-openshift-default-dockercfg-rkq9t\""
Jul 12 00:33:24.397194 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.397172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"]
Jul 12 00:33:24.405701 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.405676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:24.441317 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-certs\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441492 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztn5c\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-kube-api-access-ztn5c\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441492 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-credential-socket\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441492 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-data\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441492 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-envoy\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441720 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-token\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441720 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-podinfo\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441720 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istiod-ca-cert\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.441720 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.441557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-socket\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542415 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-credential-socket\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542415 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-data\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-envoy\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-token\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-podinfo\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istiod-ca-cert\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-socket\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-certs\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.542653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztn5c\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-kube-api-access-ztn5c\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.543033 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-data\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.543033 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.542939    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-credential-socket\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.543176 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.543149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-socket\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.543233 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.543202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-certs\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.543385 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.543367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istiod-ca-cert\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.544951 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.544933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-envoy\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.545092 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.545073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-podinfo\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.553673 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.553648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-token\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.556224 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.556201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztn5c\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-kube-api-access-ztn5c\") pod \"e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") " pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.690380 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.690297    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:24.695279 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.695257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:24.832163 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.832139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"]
Jul 12 00:33:24.834427 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:33:24.834402    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0494f6bc_408b_42ac_9bdc_9d04fafd4c9f.slice/crio-d297a68906fc6f015f63b424a5e58f775fb7740bcc69e7da9e322a56538f816a WatchSource:0}: Error finding container d297a68906fc6f015f63b424a5e58f775fb7740bcc69e7da9e322a56538f816a: Status 404 returned error can't find the container with id d297a68906fc6f015f63b424a5e58f775fb7740bcc69e7da9e322a56538f816a
Jul 12 00:33:24.836545 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.836507    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:33:24.836621 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.836586    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:33:24.836660 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.836622    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:33:24.956107 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.956020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" event={"ID":"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f","Type":"ContainerStarted","Data":"7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc"}
Jul 12 00:33:24.956107 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.956074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" event={"ID":"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f","Type":"ContainerStarted","Data":"d297a68906fc6f015f63b424a5e58f775fb7740bcc69e7da9e322a56538f816a"}
Jul 12 00:33:24.976781 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:24.976725    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podStartSLOduration=0.976709003 podStartE2EDuration="976.709003ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:33:24.974696043 +0000 UTC m=+2184.603803572" watchObservedRunningTime="2026-07-12 00:33:24.976709003 +0000 UTC m=+2184.605816512"
Jul 12 00:33:25.696358 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:25.696323    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:25.701075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:25.701049    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:25.960854 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:25.960743    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:25.961745 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:25.961728    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:26.910575 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:26.910539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:26.992657 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:26.992610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:26.993450 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:26.993431    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"]
Jul 12 00:33:26.993824 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:26.993810    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="beab7b5e-16a3-422f-8b3e-dda932c0cd2f" containerName="istio-proxy"
Jul 12 00:33:26.996651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:26.996634    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:26.999292 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:26.999269    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e82014-serving-cert\""
Jul 12 00:33:26.999591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:26.999572    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 00:33:27.000571 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.000552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:33:27.000634 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.000591    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\""
Jul 12 00:33:27.007976 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.007952    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"]
Jul 12 00:33:27.056957 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.056919    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:27.066240 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.066217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82db6c95-9919-4c3e-b974-4225de2f0ca9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.066367 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.066348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.066424 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.066383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwrpw\" (UniqueName: \"kubernetes.io/projected/82db6c95-9919-4c3e-b974-4225de2f0ca9-kube-api-access-pwrpw\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.167069 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.166987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.167069 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.167023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwrpw\" (UniqueName: \"kubernetes.io/projected/82db6c95-9919-4c3e-b974-4225de2f0ca9-kube-api-access-pwrpw\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.167263 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.167100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82db6c95-9919-4c3e-b974-4225de2f0ca9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.167263 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:33:27.167146    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-serving-cert: secret "maas-api-e2e-inf-a-e82014-serving-cert" not found
Jul 12 00:33:27.167263 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:33:27.167214    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls podName:82db6c95-9919-4c3e-b974-4225de2f0ca9 nodeName:}" failed. No retries permitted until 2026-07-12 00:33:27.66719214 +0000 UTC m=+2187.296299632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls") pod "maas-api-e2e-inf-a-e82014-64fb548546-rncp6" (UID: "82db6c95-9919-4c3e-b974-4225de2f0ca9") : secret "maas-api-e2e-inf-a-e82014-serving-cert" not found
Jul 12 00:33:27.167703 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.167684    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82db6c95-9919-4c3e-b974-4225de2f0ca9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.175124 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.175103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwrpw\" (UniqueName: \"kubernetes.io/projected/82db6c95-9919-4c3e-b974-4225de2f0ca9-kube-api-access-pwrpw\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.256604 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.256571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:27.435158 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.435055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:27.535079 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.535047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:27.675441 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.675406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.677881 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.677860    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls\") pod \"maas-api-e2e-inf-a-e82014-64fb548546-rncp6\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:27.908139 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:27.908087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:28.043654 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:28.043620    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"]
Jul 12 00:33:28.047235 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:33:28.047208    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82db6c95_9919_4c3e_b974_4225de2f0ca9.slice/crio-c4b7d1969eec6227053a61c18f131e7700e5dffec1a36839519564fad7695a5a WatchSource:0}: Error finding container c4b7d1969eec6227053a61c18f131e7700e5dffec1a36839519564fad7695a5a: Status 404 returned error can't find the container with id c4b7d1969eec6227053a61c18f131e7700e5dffec1a36839519564fad7695a5a
Jul 12 00:33:28.975938 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:28.975903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6" event={"ID":"82db6c95-9919-4c3e-b974-4225de2f0ca9","Type":"ContainerStarted","Data":"419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04"}
Jul 12 00:33:28.976120 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:28.975952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6" event={"ID":"82db6c95-9919-4c3e-b974-4225de2f0ca9","Type":"ContainerStarted","Data":"c4b7d1969eec6227053a61c18f131e7700e5dffec1a36839519564fad7695a5a"}
Jul 12 00:33:28.976120 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:28.975986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:28.992281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:28.992221    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6" podStartSLOduration=2.60024879 podStartE2EDuration="2.992206578s" totalImagesPullingTime="391.957788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:33:28.99094096 +0000 UTC m=+2188.620048469" watchObservedRunningTime="2026-07-12 00:33:28.992206578 +0000 UTC m=+2188.621314088"
Jul 12 00:33:31.442007 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:31.441973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:31.766888 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:31.766803    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:32.075986 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:32.075958    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:32.289169 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:32.289137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:32.373845 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:32.373717    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:34.284052 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:34.284017    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:33:34.994997 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:34.994959    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:33:35.081485 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.081442    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:35.185233 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.185197    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"]
Jul 12 00:33:35.186071 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.186045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:35.189109 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.189088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.191837 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.191814    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-25afa8-serving-cert\""
Jul 12 00:33:35.198795 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.198752    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"]
Jul 12 00:33:35.254266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.254153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67386e7-61e9-4c54-b242-cb5ea63e3b48-openshift-service-ca\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.254266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.254217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.254516 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.254272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4gc9\" (UniqueName: \"kubernetes.io/projected/d67386e7-61e9-4c54-b242-cb5ea63e3b48-kube-api-access-m4gc9\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.258780 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.254919    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:35.355110 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.355067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4gc9\" (UniqueName: \"kubernetes.io/projected/d67386e7-61e9-4c54-b242-cb5ea63e3b48-kube-api-access-m4gc9\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.355892 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.355866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67386e7-61e9-4c54-b242-cb5ea63e3b48-openshift-service-ca\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.357108 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.356982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67386e7-61e9-4c54-b242-cb5ea63e3b48-openshift-service-ca\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.357284 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.357072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.357617 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:33:35.357486    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-serving-cert: secret "maas-api-e2e-inf-b-25afa8-serving-cert" not found
Jul 12 00:33:35.357819 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:33:35.357807    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls podName:d67386e7-61e9-4c54-b242-cb5ea63e3b48 nodeName:}" failed. No retries permitted until 2026-07-12 00:33:35.857783413 +0000 UTC m=+2195.486890907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls") pod "maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql" (UID: "d67386e7-61e9-4c54-b242-cb5ea63e3b48") : secret "maas-api-e2e-inf-b-25afa8-serving-cert" not found
Jul 12 00:33:35.365484 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.365445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4gc9\" (UniqueName: \"kubernetes.io/projected/d67386e7-61e9-4c54-b242-cb5ea63e3b48-kube-api-access-m4gc9\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.453507 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.453459    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:35.716328 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.716296    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:35.814181 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.814148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:35.863843 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.863312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:35.865958 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:35.865927    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls\") pod \"maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:36.101137 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:36.101099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:36.267317 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:36.267285    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"]
Jul 12 00:33:36.269906 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:33:36.269879    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67386e7_61e9_4c54_b242_cb5ea63e3b48.slice/crio-4ea31fb6c6ee98b99af25b1b336e212f03d2291fa2f36fa527b2ef38450dee5d WatchSource:0}: Error finding container 4ea31fb6c6ee98b99af25b1b336e212f03d2291fa2f36fa527b2ef38450dee5d: Status 404 returned error can't find the container with id 4ea31fb6c6ee98b99af25b1b336e212f03d2291fa2f36fa527b2ef38450dee5d
Jul 12 00:33:37.015232 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:37.015141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql" event={"ID":"d67386e7-61e9-4c54-b242-cb5ea63e3b48","Type":"ContainerStarted","Data":"f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279"}
Jul 12 00:33:37.015232 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:37.015202    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql" event={"ID":"d67386e7-61e9-4c54-b242-cb5ea63e3b48","Type":"ContainerStarted","Data":"4ea31fb6c6ee98b99af25b1b336e212f03d2291fa2f36fa527b2ef38450dee5d"}
Jul 12 00:33:37.015630 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:37.015306    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:37.034262 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:37.034189    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql" podStartSLOduration=1.667593444 podStartE2EDuration="2.034167823s" totalImagesPullingTime="366.574379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:33:37.032198886 +0000 UTC m=+2196.661306397" watchObservedRunningTime="2026-07-12 00:33:37.034167823 +0000 UTC m=+2196.663275331"
Jul 12 00:33:39.611409 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:39.611367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:41.795384 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:41.795352    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:45368->10.133.0.45:15021: read: connection reset by peer" start-of-body=
Jul 12 00:33:41.796175 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:41.795425    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:45368->10.133.0.45:15021: read: connection reset by peer"
Jul 12 00:33:42.039401 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:42.039371    2582 generic.go:356] "Generic (PLEG): container finished" podID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerID="7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc" exitCode=0
Jul 12 00:33:42.039593 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:42.039451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" event={"ID":"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f","Type":"ContainerDied","Data":"7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc"}
Jul 12 00:33:42.039906 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:42.039890    2582 scope.go:117] "RemoveContainer" containerID="7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc"
Jul 12 00:33:42.040878 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:42.040853    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:33:42.040952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:42.040920    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:33:42.040996 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:42.040951    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:33:43.025265 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:43.025238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:33:43.052258 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:43.052209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" event={"ID":"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f","Type":"ContainerStarted","Data":"38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41"}
Jul 12 00:33:43.696504 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:43.696474    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:43.696746 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:43.696723    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 12 00:33:43.696863 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:43.696805    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 12 00:33:44.696055 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:44.696018    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 12 00:33:44.696447 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:44.696075    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 12 00:33:45.696315 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:45.696274    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 12 00:33:45.696817 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:45.696340    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 12 00:33:46.696602 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:46.696565    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 12 00:33:46.697014 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:46.696626    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 12 00:33:47.699752 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:47.699721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:47.700132 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:47.700009    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:47.700778 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:47.700743    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:33:48.119662 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:48.119631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:48.220850 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:48.220819    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:48.579021 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:48.578993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:33:56.399714 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:56.399683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:56.462252 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:56.462219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:33:59.656192 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:33:59.656149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:01.031556 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:01.031528    2582 scope.go:117] "RemoveContainer" containerID="fb52339883f70d3b48a224365c34efb445387459e74869f4cbf6117ea9f9151d"
Jul 12 00:34:03.989648 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:03.989612    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:34:14.852734 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:14.852698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:21.478864 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:21.478825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:34:33.136310 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:33.136220    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:34.026091 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.026059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:34.173894 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.173860    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"]
Jul 12 00:34:34.176284 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.176266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"
Jul 12 00:34:34.178719 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.178698    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:34:34.184999 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.184976    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"]
Jul 12 00:34:34.257628 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.257598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cc658a-d25a-4fac-b74f-6a974a3aeef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm\" (UID: \"70cc658a-d25a-4fac-b74f-6a974a3aeef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"
Jul 12 00:34:34.358536 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.358502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cc658a-d25a-4fac-b74f-6a974a3aeef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm\" (UID: \"70cc658a-d25a-4fac-b74f-6a974a3aeef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"
Jul 12 00:34:34.359173 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.359154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cc658a-d25a-4fac-b74f-6a974a3aeef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm\" (UID: \"70cc658a-d25a-4fac-b74f-6a974a3aeef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"
Jul 12 00:34:34.487455 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.487421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"
Jul 12 00:34:34.613835 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.613704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"]
Jul 12 00:34:34.616075 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:34:34.616046    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70cc658a_d25a_4fac_b74f_6a974a3aeef9.slice/crio-ebd50a5688721b8e79a6dcbee322bb448dc9fc2244b5ebad0325eeb6d4f69cd2 WatchSource:0}: Error finding container ebd50a5688721b8e79a6dcbee322bb448dc9fc2244b5ebad0325eeb6d4f69cd2: Status 404 returned error can't find the container with id ebd50a5688721b8e79a6dcbee322bb448dc9fc2244b5ebad0325eeb6d4f69cd2
Jul 12 00:34:34.635550 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.635510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:34.733739 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:34.733709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:35.292534 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:35.292503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm" event={"ID":"70cc658a-d25a-4fac-b74f-6a974a3aeef9","Type":"ContainerStarted","Data":"e56aed21a382e884748d2285720d0ff874c428c225934579e223df83e95ead4b"}
Jul 12 00:34:35.292994 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:35.292552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm" event={"ID":"70cc658a-d25a-4fac-b74f-6a974a3aeef9","Type":"ContainerStarted","Data":"ebd50a5688721b8e79a6dcbee322bb448dc9fc2244b5ebad0325eeb6d4f69cd2"}
Jul 12 00:34:35.307750 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:35.307677    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm" podStartSLOduration=1.307663591 podStartE2EDuration="1.307663591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:34:35.306343851 +0000 UTC m=+2254.935451364" watchObservedRunningTime="2026-07-12 00:34:35.307663591 +0000 UTC m=+2254.936771102"
Jul 12 00:34:36.298601 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:36.298564    2582 generic.go:356] "Generic (PLEG): container finished" podID="70cc658a-d25a-4fac-b74f-6a974a3aeef9" containerID="e56aed21a382e884748d2285720d0ff874c428c225934579e223df83e95ead4b" exitCode=0
Jul 12 00:34:36.299035 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:36.298647    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm" event={"ID":"70cc658a-d25a-4fac-b74f-6a974a3aeef9","Type":"ContainerDied","Data":"e56aed21a382e884748d2285720d0ff874c428c225934579e223df83e95ead4b"}
Jul 12 00:34:37.424490 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:37.424468    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"
Jul 12 00:34:37.588311 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:37.588205    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cc658a-d25a-4fac-b74f-6a974a3aeef9-maas-api-service-ca\") pod \"70cc658a-d25a-4fac-b74f-6a974a3aeef9\" (UID: \"70cc658a-d25a-4fac-b74f-6a974a3aeef9\") "
Jul 12 00:34:37.588595 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:37.588574    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70cc658a-d25a-4fac-b74f-6a974a3aeef9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70cc658a-d25a-4fac-b74f-6a974a3aeef9" (UID: "70cc658a-d25a-4fac-b74f-6a974a3aeef9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:34:37.689199 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:37.689162    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cc658a-d25a-4fac-b74f-6a974a3aeef9-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:34:38.308621 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:38.308586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm" event={"ID":"70cc658a-d25a-4fac-b74f-6a974a3aeef9","Type":"ContainerDied","Data":"ebd50a5688721b8e79a6dcbee322bb448dc9fc2244b5ebad0325eeb6d4f69cd2"}
Jul 12 00:34:38.308825 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:38.308639    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebd50a5688721b8e79a6dcbee322bb448dc9fc2244b5ebad0325eeb6d4f69cd2"
Jul 12 00:34:38.309140 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:38.309092    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm"
Jul 12 00:34:39.482520 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:39.482490    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:34:44.526572 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.526537    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"]
Jul 12 00:34:44.526985 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.526814    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6" podUID="82db6c95-9919-4c3e-b974-4225de2f0ca9" containerName="maas-api" containerID="cri-o://419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04" gracePeriod=30
Jul 12 00:34:44.546691 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.546668    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:44.772296 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.772271    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:34:44.945814 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.945782    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls\") pod \"82db6c95-9919-4c3e-b974-4225de2f0ca9\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") "
Jul 12 00:34:44.945984 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.945822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwrpw\" (UniqueName: \"kubernetes.io/projected/82db6c95-9919-4c3e-b974-4225de2f0ca9-kube-api-access-pwrpw\") pod \"82db6c95-9919-4c3e-b974-4225de2f0ca9\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") "
Jul 12 00:34:44.945984 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.945926    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82db6c95-9919-4c3e-b974-4225de2f0ca9-openshift-service-ca\") pod \"82db6c95-9919-4c3e-b974-4225de2f0ca9\" (UID: \"82db6c95-9919-4c3e-b974-4225de2f0ca9\") "
Jul 12 00:34:44.946286 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.946261    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82db6c95-9919-4c3e-b974-4225de2f0ca9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "82db6c95-9919-4c3e-b974-4225de2f0ca9" (UID: "82db6c95-9919-4c3e-b974-4225de2f0ca9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:34:44.947983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.947953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82db6c95-9919-4c3e-b974-4225de2f0ca9-kube-api-access-pwrpw" (OuterVolumeSpecName: "kube-api-access-pwrpw") pod "82db6c95-9919-4c3e-b974-4225de2f0ca9" (UID: "82db6c95-9919-4c3e-b974-4225de2f0ca9"). InnerVolumeSpecName "kube-api-access-pwrpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:34:44.948092 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:44.948052    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "82db6c95-9919-4c3e-b974-4225de2f0ca9" (UID: "82db6c95-9919-4c3e-b974-4225de2f0ca9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:34:45.047168 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.047136    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82db6c95-9919-4c3e-b974-4225de2f0ca9-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:34:45.047168 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.047162    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82db6c95-9919-4c3e-b974-4225de2f0ca9-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:34:45.047168 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.047171    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwrpw\" (UniqueName: \"kubernetes.io/projected/82db6c95-9919-4c3e-b974-4225de2f0ca9-kube-api-access-pwrpw\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:34:45.342042 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.342005    2582 generic.go:356] "Generic (PLEG): container finished" podID="82db6c95-9919-4c3e-b974-4225de2f0ca9" containerID="419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04" exitCode=0
Jul 12 00:34:45.342218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.342069    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"
Jul 12 00:34:45.342218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.342079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6" event={"ID":"82db6c95-9919-4c3e-b974-4225de2f0ca9","Type":"ContainerDied","Data":"419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04"}
Jul 12 00:34:45.342218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.342131    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6" event={"ID":"82db6c95-9919-4c3e-b974-4225de2f0ca9","Type":"ContainerDied","Data":"c4b7d1969eec6227053a61c18f131e7700e5dffec1a36839519564fad7695a5a"}
Jul 12 00:34:45.342218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.342161    2582 scope.go:117] "RemoveContainer" containerID="419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04"
Jul 12 00:34:45.351941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.351923    2582 scope.go:117] "RemoveContainer" containerID="419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04"
Jul 12 00:34:45.352263 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:34:45.352235    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04\": container with ID starting with 419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04 not found: ID does not exist" containerID="419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04"
Jul 12 00:34:45.352319 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.352272    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04"} err="failed to get container status \"419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04\": rpc error: code = NotFound desc = could not find container \"419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04\": container with ID starting with 419c1c6a2a7ecf21ec3fd190ba9b5a66a7ba6d9cab3d533db45900ab051dce04 not found: ID does not exist"
Jul 12 00:34:45.363247 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.363218    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"]
Jul 12 00:34:45.364873 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:45.364852    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e82014-64fb548546-rncp6"]
Jul 12 00:34:46.845462 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:46.845426    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82db6c95-9919-4c3e-b974-4225de2f0ca9" path="/var/lib/kubelet/pods/82db6c95-9919-4c3e-b974-4225de2f0ca9/volumes"
Jul 12 00:34:49.247979 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:49.247947    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:50.678813 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:50.678750    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:34:55.136986 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:55.136953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:55.196941 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:55.196915    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:34:59.916945 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:59.916899    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"]
Jul 12 00:34:59.917355 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:59.917128    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy" containerID="cri-o://38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41" gracePeriod=30
Jul 12 00:34:59.938628 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:34:59.938602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:00.165245 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.165212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:00.284358 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.284283    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"]
Jul 12 00:35:00.284578 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.284567    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82db6c95-9919-4c3e-b974-4225de2f0ca9" containerName="maas-api"
Jul 12 00:35:00.284620 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.284579    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="82db6c95-9919-4c3e-b974-4225de2f0ca9" containerName="maas-api"
Jul 12 00:35:00.284620 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.284599    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cc658a-d25a-4fac-b74f-6a974a3aeef9" containerName="revoke-keys"
Jul 12 00:35:00.284620 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.284604    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cc658a-d25a-4fac-b74f-6a974a3aeef9" containerName="revoke-keys"
Jul 12 00:35:00.284715 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.284656    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cc658a-d25a-4fac-b74f-6a974a3aeef9" containerName="revoke-keys"
Jul 12 00:35:00.284715 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.284665    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="82db6c95-9919-4c3e-b974-4225de2f0ca9" containerName="maas-api"
Jul 12 00:35:00.287052 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.287036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"
Jul 12 00:35:00.289604 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.289577    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:35:00.294291 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.294264    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"]
Jul 12 00:35:00.472277 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.472230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35918c9a-989b-42dc-af63-aa2da159ed8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb\" (UID: \"35918c9a-989b-42dc-af63-aa2da159ed8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"
Jul 12 00:35:00.573387 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.573355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35918c9a-989b-42dc-af63-aa2da159ed8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb\" (UID: \"35918c9a-989b-42dc-af63-aa2da159ed8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"
Jul 12 00:35:00.573992 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.573973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35918c9a-989b-42dc-af63-aa2da159ed8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb\" (UID: \"35918c9a-989b-42dc-af63-aa2da159ed8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"
Jul 12 00:35:00.598392 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.598370    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"
Jul 12 00:35:00.725817 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.725729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"]
Jul 12 00:35:00.728087 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:35:00.728064    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35918c9a_989b_42dc_af63_aa2da159ed8d.slice/crio-c19238524ac5103be50c99931de05d8f7ca446b41c17ff8a911b39c9af6ee881 WatchSource:0}: Error finding container c19238524ac5103be50c99931de05d8f7ca446b41c17ff8a911b39c9af6ee881: Status 404 returned error can't find the container with id c19238524ac5103be50c99931de05d8f7ca446b41c17ff8a911b39c9af6ee881
Jul 12 00:35:00.742751 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.742692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:00.843146 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:00.843057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:01.413990 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:01.413945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb" event={"ID":"35918c9a-989b-42dc-af63-aa2da159ed8d","Type":"ContainerStarted","Data":"9dba2988b02ba7cdab3c74ba11a689301afddc29b6887b2b0773c103114a7ae7"}
Jul 12 00:35:01.414406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:01.414042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb" event={"ID":"35918c9a-989b-42dc-af63-aa2da159ed8d","Type":"ContainerStarted","Data":"c19238524ac5103be50c99931de05d8f7ca446b41c17ff8a911b39c9af6ee881"}
Jul 12 00:35:01.431201 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:01.431152    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb" podStartSLOduration=1.4311370270000001 podStartE2EDuration="1.431137027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:35:01.429743241 +0000 UTC m=+2281.058850754" watchObservedRunningTime="2026-07-12 00:35:01.431137027 +0000 UTC m=+2281.060244597"
Jul 12 00:35:02.419986 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:02.419953    2582 generic.go:356] "Generic (PLEG): container finished" podID="35918c9a-989b-42dc-af63-aa2da159ed8d" containerID="9dba2988b02ba7cdab3c74ba11a689301afddc29b6887b2b0773c103114a7ae7" exitCode=0
Jul 12 00:35:02.420369 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:02.420034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb" event={"ID":"35918c9a-989b-42dc-af63-aa2da159ed8d","Type":"ContainerDied","Data":"9dba2988b02ba7cdab3c74ba11a689301afddc29b6887b2b0773c103114a7ae7"}
Jul 12 00:35:02.702420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:02.702344    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 00:35:02.702420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:02.702399    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 00:35:03.548081 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:03.548058    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"
Jul 12 00:35:03.600457 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:03.600426    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35918c9a-989b-42dc-af63-aa2da159ed8d-maas-api-service-ca\") pod \"35918c9a-989b-42dc-af63-aa2da159ed8d\" (UID: \"35918c9a-989b-42dc-af63-aa2da159ed8d\") "
Jul 12 00:35:03.600806 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:03.600785    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35918c9a-989b-42dc-af63-aa2da159ed8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35918c9a-989b-42dc-af63-aa2da159ed8d" (UID: "35918c9a-989b-42dc-af63-aa2da159ed8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:35:03.702092 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:03.702006    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35918c9a-989b-42dc-af63-aa2da159ed8d-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:04.429600 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:04.429574    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb"
Jul 12 00:35:04.429945 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:04.429608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb" event={"ID":"35918c9a-989b-42dc-af63-aa2da159ed8d","Type":"ContainerDied","Data":"c19238524ac5103be50c99931de05d8f7ca446b41c17ff8a911b39c9af6ee881"}
Jul 12 00:35:04.429945 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:04.429657    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c19238524ac5103be50c99931de05d8f7ca446b41c17ff8a911b39c9af6ee881"
Jul 12 00:35:05.160032 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.160003    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:35:05.210937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.210849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-socket\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.210937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.210887    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istiod-ca-cert\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.210937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.210932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztn5c\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-kube-api-access-ztn5c\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.211360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.210956    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-podinfo\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.211360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.210996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-token\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.211360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-credential-socket\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.211360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211067    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-data\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.211360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211090    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-envoy\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.211360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211136    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-certs\") pod \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\" (UID: \"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f\") "
Jul 12 00:35:05.211360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211172    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:35:05.211653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211366    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:35:05.211653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211367    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:35:05.211653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211380    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.211901 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.211860    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:35:05.212300 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.212272    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:35:05.213189 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.213170    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 00:35:05.213370 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.213349    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:35:05.213578 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.213559    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:35:05.213578 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.213569    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-kube-api-access-ztn5c" (OuterVolumeSpecName: "kube-api-access-ztn5c") pod "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" (UID: "0494f6bc-408b-42ac-9bdc-9d04fafd4c9f"). InnerVolumeSpecName "kube-api-access-ztn5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:35:05.312310 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312282    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-workload-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.312310 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312308    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istiod-ca-cert\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.312479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312320    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztn5c\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-kube-api-access-ztn5c\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.312479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312336    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-podinfo\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.312479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312346    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.312479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312357    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-credential-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.312479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312368    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-data\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.312479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.312379    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f-istio-envoy\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:05.435453 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.435417    2582 generic.go:356] "Generic (PLEG): container finished" podID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerID="38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41" exitCode=0
Jul 12 00:35:05.435686 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.435471    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"
Jul 12 00:35:05.435686 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.435473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" event={"ID":"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f","Type":"ContainerDied","Data":"38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41"}
Jul 12 00:35:05.435686 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.435536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd" event={"ID":"0494f6bc-408b-42ac-9bdc-9d04fafd4c9f","Type":"ContainerDied","Data":"d297a68906fc6f015f63b424a5e58f775fb7740bcc69e7da9e322a56538f816a"}
Jul 12 00:35:05.435686 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.435600    2582 scope.go:117] "RemoveContainer" containerID="38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41"
Jul 12 00:35:05.444264 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.444235    2582 scope.go:117] "RemoveContainer" containerID="7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc"
Jul 12 00:35:05.451738 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.451721    2582 scope.go:117] "RemoveContainer" containerID="38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41"
Jul 12 00:35:05.452035 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:35:05.452013    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41\": container with ID starting with 38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41 not found: ID does not exist" containerID="38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41"
Jul 12 00:35:05.452125 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.452045    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41"} err="failed to get container status \"38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41\": rpc error: code = NotFound desc = could not find container \"38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41\": container with ID starting with 38d102516640bc62ed5f2371bf311d957fab40ae30fb450a5f3cbf69eb39af41 not found: ID does not exist"
Jul 12 00:35:05.452125 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.452069    2582 scope.go:117] "RemoveContainer" containerID="7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc"
Jul 12 00:35:05.452312 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:35:05.452296    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc\": container with ID starting with 7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc not found: ID does not exist" containerID="7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc"
Jul 12 00:35:05.452355 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.452320    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc"} err="failed to get container status \"7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc\": rpc error: code = NotFound desc = could not find container \"7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc\": container with ID starting with 7e43aa4a3ea8b53853a730e71944039ce63af636830eadea3eb738eed5027cfc not found: ID does not exist"
Jul 12 00:35:05.456846 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.456825    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"]
Jul 12 00:35:05.459131 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:05.459113    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e82014-openshift-default-5599f4857-fzpcd"]
Jul 12 00:35:06.844589 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:06.844554    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" path="/var/lib/kubelet/pods/0494f6bc-408b-42ac-9bdc-9d04fafd4c9f/volumes"
Jul 12 00:35:08.142093 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:08.142048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:08.191821 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:08.191786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:10.615794 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.613805    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"]
Jul 12 00:35:10.615794 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.614072    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql" podUID="d67386e7-61e9-4c54-b242-cb5ea63e3b48" containerName="maas-api" containerID="cri-o://f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279" gracePeriod=30
Jul 12 00:35:10.638689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.638615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:10.868971 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.868904    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:35:10.956049 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.956013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls\") pod \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") "
Jul 12 00:35:10.956238 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.956059    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4gc9\" (UniqueName: \"kubernetes.io/projected/d67386e7-61e9-4c54-b242-cb5ea63e3b48-kube-api-access-m4gc9\") pod \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") "
Jul 12 00:35:10.956238 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.956118    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67386e7-61e9-4c54-b242-cb5ea63e3b48-openshift-service-ca\") pod \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\" (UID: \"d67386e7-61e9-4c54-b242-cb5ea63e3b48\") "
Jul 12 00:35:10.956606 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.956579    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67386e7-61e9-4c54-b242-cb5ea63e3b48-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d67386e7-61e9-4c54-b242-cb5ea63e3b48" (UID: "d67386e7-61e9-4c54-b242-cb5ea63e3b48"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:35:10.958312 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.958278    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d67386e7-61e9-4c54-b242-cb5ea63e3b48" (UID: "d67386e7-61e9-4c54-b242-cb5ea63e3b48"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:35:10.958682 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:10.958663    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67386e7-61e9-4c54-b242-cb5ea63e3b48-kube-api-access-m4gc9" (OuterVolumeSpecName: "kube-api-access-m4gc9") pod "d67386e7-61e9-4c54-b242-cb5ea63e3b48" (UID: "d67386e7-61e9-4c54-b242-cb5ea63e3b48"). InnerVolumeSpecName "kube-api-access-m4gc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:35:11.056814 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.056776    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67386e7-61e9-4c54-b242-cb5ea63e3b48-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:11.056814 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.056808    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67386e7-61e9-4c54-b242-cb5ea63e3b48-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:11.056814 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.056822    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4gc9\" (UniqueName: \"kubernetes.io/projected/d67386e7-61e9-4c54-b242-cb5ea63e3b48-kube-api-access-m4gc9\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:35:11.465622 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.465590    2582 generic.go:356] "Generic (PLEG): container finished" podID="d67386e7-61e9-4c54-b242-cb5ea63e3b48" containerID="f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279" exitCode=0
Jul 12 00:35:11.465821 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.465633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql" event={"ID":"d67386e7-61e9-4c54-b242-cb5ea63e3b48","Type":"ContainerDied","Data":"f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279"}
Jul 12 00:35:11.465821 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.465648    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"
Jul 12 00:35:11.465821 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.465697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql" event={"ID":"d67386e7-61e9-4c54-b242-cb5ea63e3b48","Type":"ContainerDied","Data":"4ea31fb6c6ee98b99af25b1b336e212f03d2291fa2f36fa527b2ef38450dee5d"}
Jul 12 00:35:11.465821 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.465718    2582 scope.go:117] "RemoveContainer" containerID="f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279"
Jul 12 00:35:11.474707 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.474688    2582 scope.go:117] "RemoveContainer" containerID="f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279"
Jul 12 00:35:11.474971 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:35:11.474953    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279\": container with ID starting with f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279 not found: ID does not exist" containerID="f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279"
Jul 12 00:35:11.475029 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.474983    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279"} err="failed to get container status \"f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279\": rpc error: code = NotFound desc = could not find container \"f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279\": container with ID starting with f861ce7f561cbee12e71b328e3fbf6bfbf60c2f5d38b32af4da8c206fc4d3279 not found: ID does not exist"
Jul 12 00:35:11.485898 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.485873    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"]
Jul 12 00:35:11.489969 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:11.489947    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25afa8-f79c7965b-6hnql"]
Jul 12 00:35:12.844128 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:12.844090    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67386e7-61e9-4c54-b242-cb5ea63e3b48" path="/var/lib/kubelet/pods/d67386e7-61e9-4c54-b242-cb5ea63e3b48/volumes"
Jul 12 00:35:13.582135 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:13.582099    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:35:15.355314 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:15.355279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:21.050197 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:21.050159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:21.110622 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:21.110591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:26.043884 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.043849    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:26.295571 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.295487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:26.660543 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.660454    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:26.948122 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948035    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"]
Jul 12 00:35:26.948410 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948393    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35918c9a-989b-42dc-af63-aa2da159ed8d" containerName="revoke-keys"
Jul 12 00:35:26.948479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948410    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="35918c9a-989b-42dc-af63-aa2da159ed8d" containerName="revoke-keys"
Jul 12 00:35:26.948479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948421    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67386e7-61e9-4c54-b242-cb5ea63e3b48" containerName="maas-api"
Jul 12 00:35:26.948479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948426    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67386e7-61e9-4c54-b242-cb5ea63e3b48" containerName="maas-api"
Jul 12 00:35:26.948479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948439    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy"
Jul 12 00:35:26.948479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948445    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy"
Jul 12 00:35:26.948479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948450    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy"
Jul 12 00:35:26.948479 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948455    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy"
Jul 12 00:35:26.948856 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948518    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy"
Jul 12 00:35:26.948856 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948526    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="35918c9a-989b-42dc-af63-aa2da159ed8d" containerName="revoke-keys"
Jul 12 00:35:26.948856 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.948533    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67386e7-61e9-4c54-b242-cb5ea63e3b48" containerName="maas-api"
Jul 12 00:35:26.952894 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.952872    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.955476 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.955453    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-483dcb-openshift-default-dockercfg-4hs2z\""
Jul 12 00:35:26.962532 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.962498    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"]
Jul 12 00:35:26.967829 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.967807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:26.972722 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.972687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-istio-token\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.972875 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.972739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-credential-socket\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.972875 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.972798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a246b03-1478-4763-922b-c003aa8adc00-istiod-ca-cert\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.972875 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.972823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8tl8\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-kube-api-access-r8tl8\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.972875 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.972871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-certs\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.973157 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.972997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a246b03-1478-4763-922b-c003aa8adc00-istio-podinfo\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.973157 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.973038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-data\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.973157 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.973086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-socket\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:26.973287 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:26.973181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-envoy\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.073772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.073721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-credential-socket\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.073772 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.073772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a246b03-1478-4763-922b-c003aa8adc00-istiod-ca-cert\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.073802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tl8\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-kube-api-access-r8tl8\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.073829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-certs\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.073971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a246b03-1478-4763-922b-c003aa8adc00-istio-podinfo\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-data\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-socket\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-envoy\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-istio-token\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074278 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-certs\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074621 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-data\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074621 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-socket\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074621 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-credential-socket\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.074621 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.074561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a246b03-1478-4763-922b-c003aa8adc00-istiod-ca-cert\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.076295 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.076272    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-envoy\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.076628 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.076604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a246b03-1478-4763-922b-c003aa8adc00-istio-podinfo\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.081398 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.081371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-istio-token\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.081480 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.081380    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8tl8\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-kube-api-access-r8tl8\") pod \"e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") " pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.264595 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.264506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:27.317009 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.316973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:27.402607 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.402582    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"]
Jul 12 00:35:27.404286 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:35:27.404245    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a246b03_1478_4763_922b_c003aa8adc00.slice/crio-aa0d41b139a8fff357936c5887731f0f4b1d8b9df02a5729c1a22045ac1e0a24 WatchSource:0}: Error finding container aa0d41b139a8fff357936c5887731f0f4b1d8b9df02a5729c1a22045ac1e0a24: Status 404 returned error can't find the container with id aa0d41b139a8fff357936c5887731f0f4b1d8b9df02a5729c1a22045ac1e0a24
Jul 12 00:35:27.406461 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.406430    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:35:27.406536 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.406495    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:35:27.406536 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.406524    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:35:27.540929 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.540888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" event={"ID":"8a246b03-1478-4763-922b-c003aa8adc00","Type":"ContainerStarted","Data":"0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79"}
Jul 12 00:35:27.541116 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.540956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" event={"ID":"8a246b03-1478-4763-922b-c003aa8adc00","Type":"ContainerStarted","Data":"aa0d41b139a8fff357936c5887731f0f4b1d8b9df02a5729c1a22045ac1e0a24"}
Jul 12 00:35:27.561655 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:27.561593    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podStartSLOduration=1.561571688 podStartE2EDuration="1.561571688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:35:27.558881312 +0000 UTC m=+2307.187988839" watchObservedRunningTime="2026-07-12 00:35:27.561571688 +0000 UTC m=+2307.190679201"
Jul 12 00:35:28.264869 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:28.264819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:28.269838 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:28.269814    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:28.545688 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:28.545661    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:28.546731 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:28.546711    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:29.492420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.492381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:29.559871 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.559835    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"]
Jul 12 00:35:29.560185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.560173    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0494f6bc-408b-42ac-9bdc-9d04fafd4c9f" containerName="istio-proxy"
Jul 12 00:35:29.562615 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.562589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:29.563277 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.563263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.565985 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.565964    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\""
Jul 12 00:35:29.566117 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.566065    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 00:35:29.566117 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.565995    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-483dcb-serving-cert\""
Jul 12 00:35:29.567014 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.566997    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:35:29.574259 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.574235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"]
Jul 12 00:35:29.596272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.596237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6cmt\" (UniqueName: \"kubernetes.io/projected/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-kube-api-access-j6cmt\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.596395 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.596356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.596449 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.596396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.632430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.632400    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:29.697649 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.697618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.697820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.697676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6cmt\" (UniqueName: \"kubernetes.io/projected/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-kube-api-access-j6cmt\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.697820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.697731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.697820 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:35:29.697809    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-serving-cert: secret "maas-api-e2e-api-a-483dcb-serving-cert" not found
Jul 12 00:35:29.697975 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:35:29.697894    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls podName:24f2ce7d-d771-45aa-972d-33fa44cdbb3b nodeName:}" failed. No retries permitted until 2026-07-12 00:35:30.197872615 +0000 UTC m=+2309.826980105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls") pod "maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx" (UID: "24f2ce7d-d771-45aa-972d-33fa44cdbb3b") : secret "maas-api-e2e-api-a-483dcb-serving-cert" not found
Jul 12 00:35:29.698360 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.698343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.714855 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.714824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6cmt\" (UniqueName: \"kubernetes.io/projected/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-kube-api-access-j6cmt\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:29.891823 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:29.891791    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:30.109928 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:30.109894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:30.201538 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:30.201438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:30.203862 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:30.203839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls\") pod \"maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:30.211317 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:30.211290    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:30.475744 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:30.475654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:30.608589 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:30.608561    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"]
Jul 12 00:35:30.611569 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:35:30.611548    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f2ce7d_d771_45aa_972d_33fa44cdbb3b.slice/crio-67c4734acf341ee5ffd5853b68b004e5635dbcf584e12a700a21847cd62b6ca9 WatchSource:0}: Error finding container 67c4734acf341ee5ffd5853b68b004e5635dbcf584e12a700a21847cd62b6ca9: Status 404 returned error can't find the container with id 67c4734acf341ee5ffd5853b68b004e5635dbcf584e12a700a21847cd62b6ca9
Jul 12 00:35:30.613023 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:30.613004    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:35:31.561366 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:31.561333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx" event={"ID":"24f2ce7d-d771-45aa-972d-33fa44cdbb3b","Type":"ContainerStarted","Data":"4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf"}
Jul 12 00:35:31.561551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:31.561414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx" event={"ID":"24f2ce7d-d771-45aa-972d-33fa44cdbb3b","Type":"ContainerStarted","Data":"67c4734acf341ee5ffd5853b68b004e5635dbcf584e12a700a21847cd62b6ca9"}
Jul 12 00:35:31.561551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:31.561529    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:31.578768 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:31.578715    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx" podStartSLOduration=2.021893879 podStartE2EDuration="2.578699756s" totalImagesPullingTime="556.805877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:35:31.576230204 +0000 UTC m=+2311.205337734" watchObservedRunningTime="2026-07-12 00:35:31.578699756 +0000 UTC m=+2311.207807318"
Jul 12 00:35:34.064934 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:34.064902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:34.562702 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:34.562675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:34.892514 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:34.892439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:35.188642 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:35.188558    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:35:35.661293 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:35.661260    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:37.571865 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.571834    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:35:37.733668 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.733625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:37.837319 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.837195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:37.907533 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.907504    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"]
Jul 12 00:35:37.910978 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.910956    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:37.913581 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.913561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-fa215e-serving-cert\""
Jul 12 00:35:37.923780 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.923742    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"]
Jul 12 00:35:37.957784 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.952008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:37.973337 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.973306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrzf\" (UniqueName: \"kubernetes.io/projected/912be8cc-c988-4e6c-be35-ab8d48627590-kube-api-access-9jrzf\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:37.973452 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.973350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912be8cc-c988-4e6c-be35-ab8d48627590-openshift-service-ca\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:37.973452 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:37.973410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.074205 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.074172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrzf\" (UniqueName: \"kubernetes.io/projected/912be8cc-c988-4e6c-be35-ab8d48627590-kube-api-access-9jrzf\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.074390 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.074226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912be8cc-c988-4e6c-be35-ab8d48627590-openshift-service-ca\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.074390 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.074351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.074508 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:35:38.074488    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-serving-cert: secret "maas-api-e2e-api-b-fa215e-serving-cert" not found
Jul 12 00:35:38.074573 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:35:38.074562    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls podName:912be8cc-c988-4e6c-be35-ab8d48627590 nodeName:}" failed. No retries permitted until 2026-07-12 00:35:38.574541241 +0000 UTC m=+2318.203648736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls") pod "maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn" (UID: "912be8cc-c988-4e6c-be35-ab8d48627590") : secret "maas-api-e2e-api-b-fa215e-serving-cert" not found
Jul 12 00:35:38.074965 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.074948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912be8cc-c988-4e6c-be35-ab8d48627590-openshift-service-ca\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.087261 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.087232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrzf\" (UniqueName: \"kubernetes.io/projected/912be8cc-c988-4e6c-be35-ab8d48627590-kube-api-access-9jrzf\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.310219 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.310188    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:38.481309 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.481271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:38.578303 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.578215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:38.578675 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.578448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.580850 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.580827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls\") pod \"maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:38.821846 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:38.821810    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:39.005318 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:39.005288    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"]
Jul 12 00:35:39.007133 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:35:39.007104    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912be8cc_c988_4e6c_be35_ab8d48627590.slice/crio-8493a284b18fddbcf923114af8d34a152c0f3f5815d63f0d89894e3c716c74c7 WatchSource:0}: Error finding container 8493a284b18fddbcf923114af8d34a152c0f3f5815d63f0d89894e3c716c74c7: Status 404 returned error can't find the container with id 8493a284b18fddbcf923114af8d34a152c0f3f5815d63f0d89894e3c716c74c7
Jul 12 00:35:39.597269 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:39.597239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn" event={"ID":"912be8cc-c988-4e6c-be35-ab8d48627590","Type":"ContainerStarted","Data":"9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba"}
Jul 12 00:35:39.597659 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:39.597293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn" event={"ID":"912be8cc-c988-4e6c-be35-ab8d48627590","Type":"ContainerStarted","Data":"8493a284b18fddbcf923114af8d34a152c0f3f5815d63f0d89894e3c716c74c7"}
Jul 12 00:35:39.597659 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:39.597349    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:39.615491 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:39.615450    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn" podStartSLOduration=2.178540631 podStartE2EDuration="2.615435891s" totalImagesPullingTime="436.89526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:35:39.614258495 +0000 UTC m=+2319.243366005" watchObservedRunningTime="2026-07-12 00:35:39.615435891 +0000 UTC m=+2319.244543401"
Jul 12 00:35:42.252159 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:42.252101    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:43.547094 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.547057    2582 patch_prober.go:28] interesting pod/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 00:35:43.547495 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.547125    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 00:35:43.617618 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.617583    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a246b03-1478-4763-922b-c003aa8adc00" containerID="0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79" exitCode=0
Jul 12 00:35:43.617794 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.617641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" event={"ID":"8a246b03-1478-4763-922b-c003aa8adc00","Type":"ContainerDied","Data":"0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79"}
Jul 12 00:35:43.618089 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.618071    2582 scope.go:117] "RemoveContainer" containerID="0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79"
Jul 12 00:35:43.619119 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.619087    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:35:43.619206 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.619176    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:35:43.619250 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:43.619231    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:35:44.623742 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:44.623706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" event={"ID":"8a246b03-1478-4763-922b-c003aa8adc00","Type":"ContainerStarted","Data":"2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174"}
Jul 12 00:35:45.264983 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:45.264943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:45.265167 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:45.265145    2582 patch_prober.go:28] interesting pod/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 00:35:45.265210 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:45.265192    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 00:35:45.607337 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:45.607307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:35:46.265037 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:46.265001    2582 patch_prober.go:28] interesting pod/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 00:35:46.265430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:46.265058    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 00:35:47.265218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:47.265182    2582 patch_prober.go:28] interesting pod/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 00:35:47.265594 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:47.265240    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 00:35:48.265683 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:48.265642    2582 patch_prober.go:28] interesting pod/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 00:35:48.266185 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:48.265721    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 00:35:49.269049 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:49.269017    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:49.269419 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:49.269348    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:49.270131 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:49.270111    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:35:50.776913 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:50.776870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:50.880638 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:50.880607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:51.492146 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:51.492115    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:35:51.965431 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:51.965403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:52.063246 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:52.063208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:59.135963 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:59.135876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:35:59.233719 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:35:59.233691    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:01.102927 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.102890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:01.202603 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.202553    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:01.311952 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.311918    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"]
Jul 12 00:36:01.312217 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.312193    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx" podUID="24f2ce7d-d771-45aa-972d-33fa44cdbb3b" containerName="maas-api" containerID="cri-o://4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf" gracePeriod=30
Jul 12 00:36:01.339932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.339908    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:01.561586 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.561564    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:36:01.684860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.684786    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-openshift-service-ca\") pod \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") "
Jul 12 00:36:01.684860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.684831    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls\") pod \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") "
Jul 12 00:36:01.684860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.684859    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6cmt\" (UniqueName: \"kubernetes.io/projected/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-kube-api-access-j6cmt\") pod \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\" (UID: \"24f2ce7d-d771-45aa-972d-33fa44cdbb3b\") "
Jul 12 00:36:01.685118 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.685098    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24f2ce7d-d771-45aa-972d-33fa44cdbb3b" (UID: "24f2ce7d-d771-45aa-972d-33fa44cdbb3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:36:01.686869 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.686842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24f2ce7d-d771-45aa-972d-33fa44cdbb3b" (UID: "24f2ce7d-d771-45aa-972d-33fa44cdbb3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:36:01.686973 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.686953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-kube-api-access-j6cmt" (OuterVolumeSpecName: "kube-api-access-j6cmt") pod "24f2ce7d-d771-45aa-972d-33fa44cdbb3b" (UID: "24f2ce7d-d771-45aa-972d-33fa44cdbb3b"). InnerVolumeSpecName "kube-api-access-j6cmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:36:01.705200 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.705177    2582 generic.go:356] "Generic (PLEG): container finished" podID="24f2ce7d-d771-45aa-972d-33fa44cdbb3b" containerID="4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf" exitCode=0
Jul 12 00:36:01.705305 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.705218    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"
Jul 12 00:36:01.705305 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.705261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx" event={"ID":"24f2ce7d-d771-45aa-972d-33fa44cdbb3b","Type":"ContainerDied","Data":"4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf"}
Jul 12 00:36:01.705377 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.705317    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx" event={"ID":"24f2ce7d-d771-45aa-972d-33fa44cdbb3b","Type":"ContainerDied","Data":"67c4734acf341ee5ffd5853b68b004e5635dbcf584e12a700a21847cd62b6ca9"}
Jul 12 00:36:01.705377 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.705347    2582 scope.go:117] "RemoveContainer" containerID="4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf"
Jul 12 00:36:01.713521 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.713505    2582 scope.go:117] "RemoveContainer" containerID="4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf"
Jul 12 00:36:01.713781 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:36:01.713742    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf\": container with ID starting with 4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf not found: ID does not exist" containerID="4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf"
Jul 12 00:36:01.713858 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.713785    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf"} err="failed to get container status \"4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf\": rpc error: code = NotFound desc = could not find container \"4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf\": container with ID starting with 4c66bc3644f2e699859d95d42970d938b1d287487e07df917baa6744bd6b96cf not found: ID does not exist"
Jul 12 00:36:01.725877 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.725853    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"]
Jul 12 00:36:01.729187 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.729169    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-483dcb-8896b7cf9-t5mwx"]
Jul 12 00:36:01.786371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.786349    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:01.786371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.786370    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:01.786505 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:01.786380    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6cmt\" (UniqueName: \"kubernetes.io/projected/24f2ce7d-d771-45aa-972d-33fa44cdbb3b-kube-api-access-j6cmt\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:02.844216 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:02.844181    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f2ce7d-d771-45aa-972d-33fa44cdbb3b" path="/var/lib/kubelet/pods/24f2ce7d-d771-45aa-972d-33fa44cdbb3b/volumes"
Jul 12 00:36:05.574064 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:05.574034    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:06.891057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:06.891021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:36:11.263961 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:11.263928    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:11.364111 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:11.364079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:16.342166 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.342127    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"]
Jul 12 00:36:16.342576 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.342427    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy" containerID="cri-o://2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174" gracePeriod=30
Jul 12 00:36:16.361165 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.361135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:16.651234 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.651149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:16.777990 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.777949    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"]
Jul 12 00:36:16.778461 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.778439    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f2ce7d-d771-45aa-972d-33fa44cdbb3b" containerName="maas-api"
Jul 12 00:36:16.778509 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.778466    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f2ce7d-d771-45aa-972d-33fa44cdbb3b" containerName="maas-api"
Jul 12 00:36:16.778581 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.778569    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f2ce7d-d771-45aa-972d-33fa44cdbb3b" containerName="maas-api"
Jul 12 00:36:16.781527 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.781508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"
Jul 12 00:36:16.784080 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.784060    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:36:16.787860 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.787835    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"]
Jul 12 00:36:16.804367 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.804338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1866854-54fd-4470-904d-beea21eecc75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h\" (UID: \"c1866854-54fd-4470-904d-beea21eecc75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"
Jul 12 00:36:16.905335 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.905250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1866854-54fd-4470-904d-beea21eecc75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h\" (UID: \"c1866854-54fd-4470-904d-beea21eecc75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"
Jul 12 00:36:16.906016 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:16.905995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1866854-54fd-4470-904d-beea21eecc75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h\" (UID: \"c1866854-54fd-4470-904d-beea21eecc75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"
Jul 12 00:36:17.092425 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:17.092398    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"
Jul 12 00:36:17.217317 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:17.217241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"]
Jul 12 00:36:17.219790 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:36:17.219747    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1866854_54fd_4470_904d_beea21eecc75.slice/crio-159fb3d34069d9c9f45533e25b9c45bc1161fafc3ab871e2a2b4d22722d164e0 WatchSource:0}: Error finding container 159fb3d34069d9c9f45533e25b9c45bc1161fafc3ab871e2a2b4d22722d164e0: Status 404 returned error can't find the container with id 159fb3d34069d9c9f45533e25b9c45bc1161fafc3ab871e2a2b4d22722d164e0
Jul 12 00:36:17.297970 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:17.297940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:17.396651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:17.396618    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:17.781266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:17.781172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h" event={"ID":"c1866854-54fd-4470-904d-beea21eecc75","Type":"ContainerStarted","Data":"a8e4a205090e51aadf3f7ede09f805e61fcdfe536a7de03f9ec0ec49f26613cd"}
Jul 12 00:36:17.781266 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:17.781230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h" event={"ID":"c1866854-54fd-4470-904d-beea21eecc75","Type":"ContainerStarted","Data":"159fb3d34069d9c9f45533e25b9c45bc1161fafc3ab871e2a2b4d22722d164e0"}
Jul 12 00:36:17.795641 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:17.795594    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h" podStartSLOduration=1.795576158 podStartE2EDuration="1.795576158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:36:17.794900839 +0000 UTC m=+2357.424008350" watchObservedRunningTime="2026-07-12 00:36:17.795576158 +0000 UTC m=+2357.424683670"
Jul 12 00:36:18.786649 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:18.786616    2582 generic.go:356] "Generic (PLEG): container finished" podID="c1866854-54fd-4470-904d-beea21eecc75" containerID="a8e4a205090e51aadf3f7ede09f805e61fcdfe536a7de03f9ec0ec49f26613cd" exitCode=0
Jul 12 00:36:18.787062 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:18.786706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h" event={"ID":"c1866854-54fd-4470-904d-beea21eecc75","Type":"ContainerDied","Data":"a8e4a205090e51aadf3f7ede09f805e61fcdfe536a7de03f9ec0ec49f26613cd"}
Jul 12 00:36:19.271455 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:19.271365    2582 patch_prober.go:28] interesting pod/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 00:36:19.271615 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:19.271447    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 00:36:19.916058 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:19.916035    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"
Jul 12 00:36:19.927871 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:19.927849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1866854-54fd-4470-904d-beea21eecc75-maas-api-service-ca\") pod \"c1866854-54fd-4470-904d-beea21eecc75\" (UID: \"c1866854-54fd-4470-904d-beea21eecc75\") "
Jul 12 00:36:19.928166 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:19.928145    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1866854-54fd-4470-904d-beea21eecc75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1866854-54fd-4470-904d-beea21eecc75" (UID: "c1866854-54fd-4470-904d-beea21eecc75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:36:20.029213 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:20.029184    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1866854-54fd-4470-904d-beea21eecc75-maas-api-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:20.796932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:20.796900    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h"
Jul 12 00:36:20.796932 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:20.796910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h" event={"ID":"c1866854-54fd-4470-904d-beea21eecc75","Type":"ContainerDied","Data":"159fb3d34069d9c9f45533e25b9c45bc1161fafc3ab871e2a2b4d22722d164e0"}
Jul 12 00:36:20.797144 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:20.796989    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="159fb3d34069d9c9f45533e25b9c45bc1161fafc3ab871e2a2b4d22722d164e0"
Jul 12 00:36:21.594746 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.594721    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:36:21.642651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642580    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-data\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642651 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642622    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-envoy\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642653    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-istio-token\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642670    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-socket\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-credential-socket\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642724    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8tl8\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-kube-api-access-r8tl8\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642783    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a246b03-1478-4763-922b-c003aa8adc00-istiod-ca-cert\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a246b03-1478-4763-922b-c003aa8adc00-istio-podinfo\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.642867 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.642848    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-certs\") pod \"8a246b03-1478-4763-922b-c003aa8adc00\" (UID: \"8a246b03-1478-4763-922b-c003aa8adc00\") "
Jul 12 00:36:21.643225 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.643076    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:36:21.643286 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.643233    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:36:21.643286 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.643252    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a246b03-1478-4763-922b-c003aa8adc00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:36:21.643494 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.643468    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:36:21.643658 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.643642    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:36:21.645232 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.645201    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:36:21.645348 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.645249    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:36:21.645485 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.645463    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-kube-api-access-r8tl8" (OuterVolumeSpecName: "kube-api-access-r8tl8") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "kube-api-access-r8tl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:36:21.645485 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.645476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a246b03-1478-4763-922b-c003aa8adc00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a246b03-1478-4763-922b-c003aa8adc00" (UID: "8a246b03-1478-4763-922b-c003aa8adc00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 00:36:21.744371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744318    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-credential-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744363    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8tl8\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-kube-api-access-r8tl8\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744375    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a246b03-1478-4763-922b-c003aa8adc00-istiod-ca-cert\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744385    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a246b03-1478-4763-922b-c003aa8adc00-istio-podinfo\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744641 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744393    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744641 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744401    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-data\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744641 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744409    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-istio-envoy\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744641 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744417    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a246b03-1478-4763-922b-c003aa8adc00-istio-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.744641 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.744424    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a246b03-1478-4763-922b-c003aa8adc00-workload-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:21.804427 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.804398    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a246b03-1478-4763-922b-c003aa8adc00" containerID="2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174" exitCode=0
Jul 12 00:36:21.804566 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.804448    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"
Jul 12 00:36:21.804566 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.804482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" event={"ID":"8a246b03-1478-4763-922b-c003aa8adc00","Type":"ContainerDied","Data":"2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174"}
Jul 12 00:36:21.804566 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.804559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp" event={"ID":"8a246b03-1478-4763-922b-c003aa8adc00","Type":"ContainerDied","Data":"aa0d41b139a8fff357936c5887731f0f4b1d8b9df02a5729c1a22045ac1e0a24"}
Jul 12 00:36:21.804666 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.804583    2582 scope.go:117] "RemoveContainer" containerID="2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174"
Jul 12 00:36:21.813549 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.813535    2582 scope.go:117] "RemoveContainer" containerID="0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79"
Jul 12 00:36:21.821001 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.820985    2582 scope.go:117] "RemoveContainer" containerID="2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174"
Jul 12 00:36:21.821252 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:36:21.821235    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174\": container with ID starting with 2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174 not found: ID does not exist" containerID="2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174"
Jul 12 00:36:21.821297 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.821257    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174"} err="failed to get container status \"2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174\": rpc error: code = NotFound desc = could not find container \"2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174\": container with ID starting with 2bead274c35ddf84f142e72f3a91c25e86a44bf819f11a7104d588e76ba3e174 not found: ID does not exist"
Jul 12 00:36:21.821297 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.821279    2582 scope.go:117] "RemoveContainer" containerID="0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79"
Jul 12 00:36:21.821507 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:36:21.821490    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79\": container with ID starting with 0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79 not found: ID does not exist" containerID="0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79"
Jul 12 00:36:21.821550 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.821512    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79"} err="failed to get container status \"0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79\": rpc error: code = NotFound desc = could not find container \"0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79\": container with ID starting with 0c414315e4636bd57fe421add3b671b20dc8f24a1db182bfcb8f69d4cd1fce79 not found: ID does not exist"
Jul 12 00:36:21.826595 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.826576    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"]
Jul 12 00:36:21.831508 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:21.831487    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-483dcb-openshift-default-6cdf77544c-26wzp"]
Jul 12 00:36:22.844308 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:22.844274    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a246b03-1478-4763-922b-c003aa8adc00" path="/var/lib/kubelet/pods/8a246b03-1478-4763-922b-c003aa8adc00/volumes"
Jul 12 00:36:27.254182 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.254150    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"]
Jul 12 00:36:27.254586 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.254357    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn" podUID="912be8cc-c988-4e6c-be35-ab8d48627590" containerName="maas-api" containerID="cri-o://9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba" gracePeriod=30
Jul 12 00:36:27.294514 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.294486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:27.498156 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.498131    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:36:27.587623 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.587589    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls\") pod \"912be8cc-c988-4e6c-be35-ab8d48627590\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") "
Jul 12 00:36:27.587844 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.587650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jrzf\" (UniqueName: \"kubernetes.io/projected/912be8cc-c988-4e6c-be35-ab8d48627590-kube-api-access-9jrzf\") pod \"912be8cc-c988-4e6c-be35-ab8d48627590\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") "
Jul 12 00:36:27.587844 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.587676    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912be8cc-c988-4e6c-be35-ab8d48627590-openshift-service-ca\") pod \"912be8cc-c988-4e6c-be35-ab8d48627590\" (UID: \"912be8cc-c988-4e6c-be35-ab8d48627590\") "
Jul 12 00:36:27.588078 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.588052    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/912be8cc-c988-4e6c-be35-ab8d48627590-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "912be8cc-c988-4e6c-be35-ab8d48627590" (UID: "912be8cc-c988-4e6c-be35-ab8d48627590"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:36:27.589733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.589707    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "912be8cc-c988-4e6c-be35-ab8d48627590" (UID: "912be8cc-c988-4e6c-be35-ab8d48627590"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:36:27.589841 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.589820    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/912be8cc-c988-4e6c-be35-ab8d48627590-kube-api-access-9jrzf" (OuterVolumeSpecName: "kube-api-access-9jrzf") pod "912be8cc-c988-4e6c-be35-ab8d48627590" (UID: "912be8cc-c988-4e6c-be35-ab8d48627590"). InnerVolumeSpecName "kube-api-access-9jrzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:36:27.688437 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.688405    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912be8cc-c988-4e6c-be35-ab8d48627590-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:27.688437 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.688432    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jrzf\" (UniqueName: \"kubernetes.io/projected/912be8cc-c988-4e6c-be35-ab8d48627590-kube-api-access-9jrzf\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:27.688437 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.688443    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912be8cc-c988-4e6c-be35-ab8d48627590-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:36:27.834306 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.834271    2582 generic.go:356] "Generic (PLEG): container finished" podID="912be8cc-c988-4e6c-be35-ab8d48627590" containerID="9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba" exitCode=0
Jul 12 00:36:27.834481 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.834330    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"
Jul 12 00:36:27.834481 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.834358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn" event={"ID":"912be8cc-c988-4e6c-be35-ab8d48627590","Type":"ContainerDied","Data":"9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba"}
Jul 12 00:36:27.834481 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.834408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn" event={"ID":"912be8cc-c988-4e6c-be35-ab8d48627590","Type":"ContainerDied","Data":"8493a284b18fddbcf923114af8d34a152c0f3f5815d63f0d89894e3c716c74c7"}
Jul 12 00:36:27.834481 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.834431    2582 scope.go:117] "RemoveContainer" containerID="9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba"
Jul 12 00:36:27.843196 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.843159    2582 scope.go:117] "RemoveContainer" containerID="9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba"
Jul 12 00:36:27.843447 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:36:27.843422    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba\": container with ID starting with 9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba not found: ID does not exist" containerID="9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba"
Jul 12 00:36:27.843522 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.843458    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba"} err="failed to get container status \"9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba\": rpc error: code = NotFound desc = could not find container \"9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba\": container with ID starting with 9e0fbebc48d4c34f3a5644830ab6c87fa65e52272db79a5e9eb7bd203e8c92ba not found: ID does not exist"
Jul 12 00:36:27.857982 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.857960    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"]
Jul 12 00:36:27.861243 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:27.861222    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa215e-6575f6dd88-94lbn"]
Jul 12 00:36:28.843670 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:28.843632    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="912be8cc-c988-4e6c-be35-ab8d48627590" path="/var/lib/kubelet/pods/912be8cc-c988-4e6c-be35-ab8d48627590/volumes"
Jul 12 00:36:30.488405 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:30.488370    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:36:31.854522 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:31.854476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:37.474701 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:37.474665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:37.533142 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:37.533088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:42.584685 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:42.584655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:42.823928 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:42.823899    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:43.220268 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.220241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:43.532635 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.532539    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"]
Jul 12 00:36:43.533023 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533001    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="912be8cc-c988-4e6c-be35-ab8d48627590" containerName="maas-api"
Jul 12 00:36:43.533197 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533180    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="912be8cc-c988-4e6c-be35-ab8d48627590" containerName="maas-api"
Jul 12 00:36:43.533281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533202    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1866854-54fd-4470-904d-beea21eecc75" containerName="revoke-keys"
Jul 12 00:36:43.533281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533212    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1866854-54fd-4470-904d-beea21eecc75" containerName="revoke-keys"
Jul 12 00:36:43.533281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533233    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy"
Jul 12 00:36:43.533281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533241    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy"
Jul 12 00:36:43.533281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533252    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy"
Jul 12 00:36:43.533281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533261    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy"
Jul 12 00:36:43.533519 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533380    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="912be8cc-c988-4e6c-be35-ab8d48627590" containerName="maas-api"
Jul 12 00:36:43.533519 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533392    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy"
Jul 12 00:36:43.533519 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533401    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a246b03-1478-4763-922b-c003aa8adc00" containerName="istio-proxy"
Jul 12 00:36:43.533519 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.533411    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1866854-54fd-4470-904d-beea21eecc75" containerName="revoke-keys"
Jul 12 00:36:43.536776 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.536737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.539660 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.539638    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-45be6f-openshift-default-dockercfg-6xhbx\""
Jul 12 00:36:43.548529 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.548505    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"]
Jul 12 00:36:43.556582 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.556558    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:43.615660 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-envoy\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-data\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-socket\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31e322e8-508c-4d11-aff6-96a8a42d17fa-istiod-ca-cert\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrg5\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-kube-api-access-bsrg5\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-token\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-certs\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-podinfo\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.616036 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.615995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-credential-socket\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717080 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-envoy\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717093    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-data\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-socket\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31e322e8-508c-4d11-aff6-96a8a42d17fa-istiod-ca-cert\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrg5\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-kube-api-access-bsrg5\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-token\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-certs\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-podinfo\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717551 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-credential-socket\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717780 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-data\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717780 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-certs\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717780 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-socket\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.717984 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.717960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-credential-socket\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.718084 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.718037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31e322e8-508c-4d11-aff6-96a8a42d17fa-istiod-ca-cert\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.719976 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.719949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-envoy\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.720304 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.720285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-podinfo\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.730829 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.730801    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrg5\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-kube-api-access-bsrg5\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.731499 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.731477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-token\") pod \"e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") " pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.757493 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.757469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:43.848933 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.848907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:43.981239 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.981212    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"]
Jul 12 00:36:43.983171 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:36:43.983144    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e322e8_508c_4d11_aff6_96a8a42d17fa.slice/crio-2f7e540f5c7bb0350f38ee7d0fd3ea3c2bbeb5c333de82ed230c42930724094f WatchSource:0}: Error finding container 2f7e540f5c7bb0350f38ee7d0fd3ea3c2bbeb5c333de82ed230c42930724094f: Status 404 returned error can't find the container with id 2f7e540f5c7bb0350f38ee7d0fd3ea3c2bbeb5c333de82ed230c42930724094f
Jul 12 00:36:43.985120 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.985087    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:36:43.985218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.985166    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:36:43.985218 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:43.985211    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:36:44.913048 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:44.913016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" event={"ID":"31e322e8-508c-4d11-aff6-96a8a42d17fa","Type":"ContainerStarted","Data":"e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071"}
Jul 12 00:36:44.913457 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:44.913066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" event={"ID":"31e322e8-508c-4d11-aff6-96a8a42d17fa","Type":"ContainerStarted","Data":"2f7e540f5c7bb0350f38ee7d0fd3ea3c2bbeb5c333de82ed230c42930724094f"}
Jul 12 00:36:44.939502 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:44.939455    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" podStartSLOduration=1.939438865 podStartE2EDuration="1.939438865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:36:44.938227595 +0000 UTC m=+2384.567335127" watchObservedRunningTime="2026-07-12 00:36:44.939438865 +0000 UTC m=+2384.568546374"
Jul 12 00:36:45.849914 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:45.849876    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:45.854689 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:45.854662    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:45.917444 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:45.917415    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:45.918337 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:45.918315    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:36:45.981335 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:45.981300    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:46.904032 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:46.903994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:47.058066 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.058036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:47.060729 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.060705    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"]
Jul 12 00:36:47.063991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.063975    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.067290 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.067266    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:36:47.067290 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.067284    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-45be6f-serving-cert\""
Jul 12 00:36:47.068281 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.068254    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\""
Jul 12 00:36:47.068371 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.068300    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 00:36:47.083244 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.083225    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"]
Jul 12 00:36:47.143702 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.143675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89560e90-9d92-40d6-87fb-7ac3fdd866ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.143878 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.143710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knltx\" (UniqueName: \"kubernetes.io/projected/89560e90-9d92-40d6-87fb-7ac3fdd866ba-kube-api-access-knltx\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.143878 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.143732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89560e90-9d92-40d6-87fb-7ac3fdd866ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.152150 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.152129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:47.244684 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.244601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89560e90-9d92-40d6-87fb-7ac3fdd866ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.244684 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.244637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knltx\" (UniqueName: \"kubernetes.io/projected/89560e90-9d92-40d6-87fb-7ac3fdd866ba-kube-api-access-knltx\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.244684 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.244657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89560e90-9d92-40d6-87fb-7ac3fdd866ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.245322 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.245298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89560e90-9d92-40d6-87fb-7ac3fdd866ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.247103 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.247073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89560e90-9d92-40d6-87fb-7ac3fdd866ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.253373 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.253348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:47.255554 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.255532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knltx\" (UniqueName: \"kubernetes.io/projected/89560e90-9d92-40d6-87fb-7ac3fdd866ba-kube-api-access-knltx\") pod \"maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.377214 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.377164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:47.515496 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.515314    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"]
Jul 12 00:36:47.518125 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:36:47.518099    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89560e90_9d92_40d6_87fb_7ac3fdd866ba.slice/crio-9a3406e06096702682223b41fbec029fd2ac5274e22a17803f8e01cfe96ef086 WatchSource:0}: Error finding container 9a3406e06096702682223b41fbec029fd2ac5274e22a17803f8e01cfe96ef086: Status 404 returned error can't find the container with id 9a3406e06096702682223b41fbec029fd2ac5274e22a17803f8e01cfe96ef086
Jul 12 00:36:47.623294 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.623260    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:47.721601 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.721568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:47.928030 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:47.927998    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d" event={"ID":"89560e90-9d92-40d6-87fb-7ac3fdd866ba","Type":"ContainerStarted","Data":"9a3406e06096702682223b41fbec029fd2ac5274e22a17803f8e01cfe96ef086"}
Jul 12 00:36:48.934527 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:48.934492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d" event={"ID":"89560e90-9d92-40d6-87fb-7ac3fdd866ba","Type":"ContainerStarted","Data":"6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074"}
Jul 12 00:36:48.934920 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:48.934600    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:48.951054 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:48.951010    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d" podStartSLOduration=1.5520005669999999 podStartE2EDuration="1.950994146s" totalImagesPullingTime="398.993579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:36:48.94983749 +0000 UTC m=+2388.578944999" watchObservedRunningTime="2026-07-12 00:36:48.950994146 +0000 UTC m=+2388.580101700"
Jul 12 00:36:50.887610 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:50.887574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:36:51.466490 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:51.466461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:51.843948 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:51.843916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:52.170276 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:52.170164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:52.424423 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:52.424336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:54.952352 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:54.952057    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:36:55.144023 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.143986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:55.273047 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.272960    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"]
Jul 12 00:36:55.276262 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.276240    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.279109 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.279091    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-39949b-serving-cert\""
Jul 12 00:36:55.292722 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.292697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"]
Jul 12 00:36:55.308518 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.308489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:55.399463 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.399424    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:55.412550 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.412520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-openshift-service-ca\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.412676 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.412563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6dws\" (UniqueName: \"kubernetes.io/projected/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-kube-api-access-w6dws\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.412676 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.412623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.514091 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.514053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-openshift-service-ca\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.514280 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.514102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6dws\" (UniqueName: \"kubernetes.io/projected/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-kube-api-access-w6dws\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.514280 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.514138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.514280 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:36:55.514257    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-serving-cert: secret "maas-api-e2e-shared-b-39949b-serving-cert" not found
Jul 12 00:36:55.514398 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:36:55.514330    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls podName:d2eb12e7-f934-4a63-aa4c-86d68c7c7d82 nodeName:}" failed. No retries permitted until 2026-07-12 00:36:56.014310555 +0000 UTC m=+2395.643418043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls") pod "maas-api-e2e-shared-b-39949b-7f687555bc-8948x" (UID: "d2eb12e7-f934-4a63-aa4c-86d68c7c7d82") : secret "maas-api-e2e-shared-b-39949b-serving-cert" not found
Jul 12 00:36:55.514751 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.514731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-openshift-service-ca\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.523022 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.523002    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6dws\" (UniqueName: \"kubernetes.io/projected/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-kube-api-access-w6dws\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:55.620936 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.620902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:55.799802 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.799768    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:55.899735 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:55.899644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:56.018705 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.018670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:56.021250 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.021225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls\") pod \"maas-api-e2e-shared-b-39949b-7f687555bc-8948x\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:56.190726 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.190641    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:56.329257 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.329227    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"]
Jul 12 00:36:56.331254 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:36:56.331220    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2eb12e7_f934_4a63_aa4c_86d68c7c7d82.slice/crio-812e9a80d1ffe35e79e6f97b62598a3932d97b715c0777a570b88e54e67f605f WatchSource:0}: Error finding container 812e9a80d1ffe35e79e6f97b62598a3932d97b715c0777a570b88e54e67f605f: Status 404 returned error can't find the container with id 812e9a80d1ffe35e79e6f97b62598a3932d97b715c0777a570b88e54e67f605f
Jul 12 00:36:56.979846 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.979738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x" event={"ID":"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82","Type":"ContainerStarted","Data":"681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2"}
Jul 12 00:36:56.979846 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.979810    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x" event={"ID":"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82","Type":"ContainerStarted","Data":"812e9a80d1ffe35e79e6f97b62598a3932d97b715c0777a570b88e54e67f605f"}
Jul 12 00:36:56.979846 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.979831    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:36:56.997849 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:56.997800    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x" podStartSLOduration=1.641710652 podStartE2EDuration="1.997782994s" totalImagesPullingTime="356.072342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:36:56.995573799 +0000 UTC m=+2396.624681311" watchObservedRunningTime="2026-07-12 00:36:56.997782994 +0000 UTC m=+2396.626890501"
Jul 12 00:36:58.991135 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:58.991046    2582 generic.go:356] "Generic (PLEG): container finished" podID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerID="e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071" exitCode=0
Jul 12 00:36:58.991135 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:58.991118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" event={"ID":"31e322e8-508c-4d11-aff6-96a8a42d17fa","Type":"ContainerDied","Data":"e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071"}
Jul 12 00:36:58.991563 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:58.991536    2582 scope.go:117] "RemoveContainer" containerID="e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071"
Jul 12 00:36:58.992465 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:58.992438    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:36:58.992514 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:58.992503    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:36:58.992549 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:58.992537    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 12 00:36:59.697915 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:59.697860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:36:59.997671 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:36:59.997584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" event={"ID":"31e322e8-508c-4d11-aff6-96a8a42d17fa","Type":"ContainerStarted","Data":"33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266"}
Jul 12 00:37:00.855178 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:00.855140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:37:00.855391 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:00.855364    2582 patch_prober.go:28] interesting pod/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 00:37:00.855483 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:00.855417    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 00:37:00.917417 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:00.917392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:37:01.850298 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:01.850256    2582 patch_prober.go:28] interesting pod/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 00:37:01.850805 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:01.850325    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 00:37:02.850082 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:02.850041    2582 patch_prober.go:28] interesting pod/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 00:37:02.850285 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:02.850103    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 00:37:02.991337 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:02.991300    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:37:03.850159 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:03.850119    2582 patch_prober.go:28] interesting pod/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 00:37:03.850460 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:03.850427    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 00:37:04.854080 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:04.854049    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:37:04.854889 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:04.854870    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:37:07.489631 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:07.489595    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:37:08.297652 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:08.297612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:37:08.398501 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:08.398473    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:37:16.460365 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:16.460326    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:37:16.561909 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:16.561879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:37:24.567671 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:24.567592    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:37:27.989591 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:27.989558    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:37:56.546717 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:37:56.546676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:38:00.184021 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:38:00.183992    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:38:19.584813 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:38:19.584774    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:38:35.485175 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:38:35.485138    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:38:52.788599 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:38:52.788519    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:39:09.591064 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:39:09.591032    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:39:23.782597 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:39:23.782562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:39:23.837284 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:39:23.837249    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:39:25.280798 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:39:25.280748    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:39:42.581998 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:39:42.581962    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:39:56.380164 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:39:56.380129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:39:57.134280 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:39:57.134251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:40:01.180453 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:40:01.180418    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:40:13.653372 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:40:13.653324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:40:18.776525 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:40:18.776486    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:40:49.158971 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:40:49.158941    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:40:52.642200 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:40:52.642163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:40:52.743118 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:40:52.743088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:40:52.991510 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:40:52.991435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:41:13.985776 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:13.985730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:41:26.534728 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:26.534688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:41:33.285101 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:33.285064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:41:39.822275 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:39.822239    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:41:40.728396 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:40.728364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:41:49.889352 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:49.889321    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:41:55.130258 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.130169    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"]
Jul 12 00:41:55.133402 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.133380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.136245 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.136208    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"kube-root-ca.crt\""
Jul 12 00:41:55.136361 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.136265    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"default-dockercfg-bcrl9\""
Jul 12 00:41:55.137300 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.137259    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"openshift-service-ca.crt\""
Jul 12 00:41:55.137406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.137387    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"rate-test-model-45be6f-kserve-self-signed-certs\""
Jul 12 00:41:55.142137 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.142116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"]
Jul 12 00:41:55.160000 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.159979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:41:55.226736 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.226711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-home\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.226866 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.226737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tmp-dir\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.226866 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.226789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-model-cache\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.226866 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.226815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-dshm\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.226866 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.226857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tls-certs\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.227018 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.226892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75zzh\" (UniqueName: \"kubernetes.io/projected/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-kube-api-access-75zzh\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.327653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.327602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-model-cache\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.327653 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.327655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-dshm\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.327944 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.327702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tls-certs\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.327944 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.327728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75zzh\" (UniqueName: \"kubernetes.io/projected/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-kube-api-access-75zzh\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.327944 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.327754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-home\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.327944 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.327797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tmp-dir\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.328158 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.328107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-model-cache\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.328158 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.328130    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-home\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.328240 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.328195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tmp-dir\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.330032 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.330013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-dshm\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.330305 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.330289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tls-certs\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.335320 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.335296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75zzh\" (UniqueName: \"kubernetes.io/projected/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-kube-api-access-75zzh\") pod \"rate-test-model-45be6f-kserve-595bd958c5-6rs6r\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") " pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.398820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.398723    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:41:55.443406 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.443375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:41:55.502839 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.502711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:41:55.573704 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:55.573628    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"]
Jul 12 00:41:55.576037 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:41:55.576010    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c492dc4_1917_4d63_9c8e_ff8e7f2219bd.slice/crio-ef0b5f33ad89d04ff571d4f5f2c3f18723f25dc52f526141a4dbc09c614e74fa WatchSource:0}: Error finding container ef0b5f33ad89d04ff571d4f5f2c3f18723f25dc52f526141a4dbc09c614e74fa: Status 404 returned error can't find the container with id ef0b5f33ad89d04ff571d4f5f2c3f18723f25dc52f526141a4dbc09c614e74fa
Jul 12 00:41:56.387838 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:56.387800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r" event={"ID":"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd","Type":"ContainerStarted","Data":"a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0"}
Jul 12 00:41:56.387838 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:56.387844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r" event={"ID":"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd","Type":"ContainerStarted","Data":"ef0b5f33ad89d04ff571d4f5f2c3f18723f25dc52f526141a4dbc09c614e74fa"}
Jul 12 00:41:56.404730 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:41:56.404674    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r" podStartSLOduration=1.404652899 podStartE2EDuration="1.404652899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:41:56.404377216 +0000 UTC m=+2696.033484726" watchObservedRunningTime="2026-07-12 00:41:56.404652899 +0000 UTC m=+2696.033760410"
Jul 12 00:42:01.088067 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:01.088030    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:42:05.444075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:05.444036    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:42:05.444075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:05.444079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:42:05.456586 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:05.456560    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:42:06.446035 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:06.446007    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:42:09.100094 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:09.100043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:42:09.200940 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:09.200886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:42:17.135939 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:17.135903    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:42:17.237005 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:17.236959    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:42:55.563488 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:55.563452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:42:57.895613 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:57.895582    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:42:57.947879 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:42:57.947836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:43:00.379431 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:00.379397    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:43:15.096247 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:15.096202    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:43:30.684545 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:30.684461    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:43:38.404909 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:38.404879    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"]
Jul 12 00:43:38.424430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:38.424378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:43:39.149344 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:39.149288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:43:44.185012 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:44.184978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:43:53.424831 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.424755    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r" podUID="6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" containerName="main" containerID="cri-o://a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0" gracePeriod=45
Jul 12 00:43:53.669485 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.669457    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:43:53.795692 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.795667    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-home\") pod \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") "
Jul 12 00:43:53.795885 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.795717    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75zzh\" (UniqueName: \"kubernetes.io/projected/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-kube-api-access-75zzh\") pod \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") "
Jul 12 00:43:53.795885 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.795742    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-model-cache\") pod \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") "
Jul 12 00:43:53.795885 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.795781    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tmp-dir\") pod \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") "
Jul 12 00:43:53.795885 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.795852    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tls-certs\") pod \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") "
Jul 12 00:43:53.795885 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.795870    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-dshm\") pod \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\" (UID: \"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd\") "
Jul 12 00:43:53.796135 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.795987    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-home" (OuterVolumeSpecName: "home") pod "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" (UID: "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:53.796135 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.796003    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" (UID: "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:53.796135 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.796030    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" (UID: "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:53.797970 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.797947    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-dshm" (OuterVolumeSpecName: "dshm") pod "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" (UID: "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:53.798071 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.798006    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" (UID: "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:43:53.798129 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.798085    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-kube-api-access-75zzh" (OuterVolumeSpecName: "kube-api-access-75zzh") pod "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" (UID: "6c492dc4-1917-4d63-9c8e-ff8e7f2219bd"). InnerVolumeSpecName "kube-api-access-75zzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:53.896626 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.896583    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tls-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:43:53.896626 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.896620    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-dshm\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:43:53.896626 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.896629    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-home\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:43:53.896626 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.896638    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75zzh\" (UniqueName: \"kubernetes.io/projected/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-kube-api-access-75zzh\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:43:53.896626 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.896646    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-model-cache\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:43:53.896954 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.896655    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd-tmp-dir\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:43:53.934053 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.934023    2582 generic.go:356] "Generic (PLEG): container finished" podID="6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" containerID="a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0" exitCode=0
Jul 12 00:43:53.934193 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.934064    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"
Jul 12 00:43:53.934193 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.934108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r" event={"ID":"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd","Type":"ContainerDied","Data":"a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0"}
Jul 12 00:43:53.934193 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.934156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r" event={"ID":"6c492dc4-1917-4d63-9c8e-ff8e7f2219bd","Type":"ContainerDied","Data":"ef0b5f33ad89d04ff571d4f5f2c3f18723f25dc52f526141a4dbc09c614e74fa"}
Jul 12 00:43:53.934193 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.934178    2582 scope.go:117] "RemoveContainer" containerID="a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0"
Jul 12 00:43:53.943042 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.943027    2582 scope.go:117] "RemoveContainer" containerID="a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0"
Jul 12 00:43:53.943310 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:43:53.943291    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0\": container with ID starting with a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0 not found: ID does not exist" containerID="a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0"
Jul 12 00:43:53.943365 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.943321    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0"} err="failed to get container status \"a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0\": rpc error: code = NotFound desc = could not find container \"a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0\": container with ID starting with a5a6dfa805aa030a76efee3ba58fe69b45baa2053ba7c566278290bb19076ea0 not found: ID does not exist"
Jul 12 00:43:53.954606 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.954582    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"]
Jul 12 00:43:53.958471 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:53.958452    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/rate-test-model-45be6f-kserve-595bd958c5-6rs6r"]
Jul 12 00:43:54.844726 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:54.844690    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" path="/var/lib/kubelet/pods/6c492dc4-1917-4d63-9c8e-ff8e7f2219bd/volumes"
Jul 12 00:43:59.102673 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:59.102600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:43:59.203579 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:43:59.203539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:09.128501 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.128462    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"]
Jul 12 00:44:09.128994 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.128800    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d" podUID="89560e90-9d92-40d6-87fb-7ac3fdd866ba" containerName="maas-api" containerID="cri-o://6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074" gracePeriod=30
Jul 12 00:44:09.151353 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.151326    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:09.373609 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.373584    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:44:09.421188 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.421116    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knltx\" (UniqueName: \"kubernetes.io/projected/89560e90-9d92-40d6-87fb-7ac3fdd866ba-kube-api-access-knltx\") pod \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") "
Jul 12 00:44:09.421188 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.421160    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89560e90-9d92-40d6-87fb-7ac3fdd866ba-openshift-service-ca\") pod \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") "
Jul 12 00:44:09.421385 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.421215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89560e90-9d92-40d6-87fb-7ac3fdd866ba-maas-api-tls\") pod \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\" (UID: \"89560e90-9d92-40d6-87fb-7ac3fdd866ba\") "
Jul 12 00:44:09.421528 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.421504    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89560e90-9d92-40d6-87fb-7ac3fdd866ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89560e90-9d92-40d6-87fb-7ac3fdd866ba" (UID: "89560e90-9d92-40d6-87fb-7ac3fdd866ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:44:09.423169 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.423142    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89560e90-9d92-40d6-87fb-7ac3fdd866ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89560e90-9d92-40d6-87fb-7ac3fdd866ba" (UID: "89560e90-9d92-40d6-87fb-7ac3fdd866ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:44:09.423169 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.423156    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89560e90-9d92-40d6-87fb-7ac3fdd866ba-kube-api-access-knltx" (OuterVolumeSpecName: "kube-api-access-knltx") pod "89560e90-9d92-40d6-87fb-7ac3fdd866ba" (UID: "89560e90-9d92-40d6-87fb-7ac3fdd866ba"). InnerVolumeSpecName "kube-api-access-knltx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:44:09.522269 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.522237    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89560e90-9d92-40d6-87fb-7ac3fdd866ba-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:09.522269 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.522262    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knltx\" (UniqueName: \"kubernetes.io/projected/89560e90-9d92-40d6-87fb-7ac3fdd866ba-kube-api-access-knltx\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:09.522269 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:09.522270    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89560e90-9d92-40d6-87fb-7ac3fdd866ba-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:10.010674 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.010636    2582 generic.go:356] "Generic (PLEG): container finished" podID="89560e90-9d92-40d6-87fb-7ac3fdd866ba" containerID="6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074" exitCode=0
Jul 12 00:44:10.010892 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.010684    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"
Jul 12 00:44:10.010892 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.010713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d" event={"ID":"89560e90-9d92-40d6-87fb-7ac3fdd866ba","Type":"ContainerDied","Data":"6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074"}
Jul 12 00:44:10.010892 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.010753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d" event={"ID":"89560e90-9d92-40d6-87fb-7ac3fdd866ba","Type":"ContainerDied","Data":"9a3406e06096702682223b41fbec029fd2ac5274e22a17803f8e01cfe96ef086"}
Jul 12 00:44:10.010892 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.010794    2582 scope.go:117] "RemoveContainer" containerID="6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074"
Jul 12 00:44:10.019395 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.019372    2582 scope.go:117] "RemoveContainer" containerID="6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074"
Jul 12 00:44:10.019631 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:44:10.019611    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074\": container with ID starting with 6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074 not found: ID does not exist" containerID="6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074"
Jul 12 00:44:10.019700 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.019640    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074"} err="failed to get container status \"6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074\": rpc error: code = NotFound desc = could not find container \"6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074\": container with ID starting with 6e81e698fd0f8a711a921e8f5ef06b82babc86af3f654f4144493246f39dd074 not found: ID does not exist"
Jul 12 00:44:10.031431 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.031407    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"]
Jul 12 00:44:10.034145 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.034119    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-45be6f-7cdfd7d8fb-xnd8d"]
Jul 12 00:44:10.844280 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:10.844249    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89560e90-9d92-40d6-87fb-7ac3fdd866ba" path="/var/lib/kubelet/pods/89560e90-9d92-40d6-87fb-7ac3fdd866ba/volumes"
Jul 12 00:44:12.479261 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:12.479224    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:44:13.725451 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:13.725422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:19.568352 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:19.568315    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:19.624066 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:19.624038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:24.383937 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:24.383904    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"]
Jul 12 00:44:24.384459 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:24.384119    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy" containerID="cri-o://33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266" gracePeriod=30
Jul 12 00:44:24.402267 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:24.402240    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:24.640921 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:24.640829    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:25.205904 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:25.205873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:25.307243 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:25.307212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:29.622553 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.622531    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:44:29.677473 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-envoy\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677473 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677435    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-token\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677473 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677453    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-data\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677483    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsrg5\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-kube-api-access-bsrg5\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677506    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-socket\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677546    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31e322e8-508c-4d11-aff6-96a8a42d17fa-istiod-ca-cert\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677574    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-podinfo\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677612    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-credential-socket\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.677733 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677646    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-certs\") pod \"31e322e8-508c-4d11-aff6-96a8a42d17fa\" (UID: \"31e322e8-508c-4d11-aff6-96a8a42d17fa\") "
Jul 12 00:44:29.678075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677840    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:44:29.678075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677919    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e322e8-508c-4d11-aff6-96a8a42d17fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:44:29.678075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.677932    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.678075 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.678039    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:44:29.678272 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.678101    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:44:29.678365 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.678336    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:44:29.679595 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.679571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:44:29.679753 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.679732    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 00:44:29.680047 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.680025    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:44:29.680121 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.680032    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-kube-api-access-bsrg5" (OuterVolumeSpecName: "kube-api-access-bsrg5") pod "31e322e8-508c-4d11-aff6-96a8a42d17fa" (UID: "31e322e8-508c-4d11-aff6-96a8a42d17fa"). InnerVolumeSpecName "kube-api-access-bsrg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:44:29.779251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779227    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-envoy\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.779251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779247    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-token\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.779251 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779256    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-data\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.779430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779265    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsrg5\" (UniqueName: \"kubernetes.io/projected/31e322e8-508c-4d11-aff6-96a8a42d17fa-kube-api-access-bsrg5\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.779430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779273    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31e322e8-508c-4d11-aff6-96a8a42d17fa-istiod-ca-cert\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.779430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779282    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31e322e8-508c-4d11-aff6-96a8a42d17fa-istio-podinfo\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.779430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779290    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-credential-socket\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:29.779430 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:29.779298    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31e322e8-508c-4d11-aff6-96a8a42d17fa-workload-certs\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:30.102455 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.102425    2582 generic.go:356] "Generic (PLEG): container finished" podID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerID="33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266" exitCode=0
Jul 12 00:44:30.102625 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.102472    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"
Jul 12 00:44:30.102625 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.102506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" event={"ID":"31e322e8-508c-4d11-aff6-96a8a42d17fa","Type":"ContainerDied","Data":"33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266"}
Jul 12 00:44:30.102625 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.102573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d" event={"ID":"31e322e8-508c-4d11-aff6-96a8a42d17fa","Type":"ContainerDied","Data":"2f7e540f5c7bb0350f38ee7d0fd3ea3c2bbeb5c333de82ed230c42930724094f"}
Jul 12 00:44:30.102625 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.102609    2582 scope.go:117] "RemoveContainer" containerID="33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266"
Jul 12 00:44:30.111438 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.111422    2582 scope.go:117] "RemoveContainer" containerID="e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071"
Jul 12 00:44:30.118951 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.118936    2582 scope.go:117] "RemoveContainer" containerID="33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266"
Jul 12 00:44:30.119174 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:44:30.119159    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266\": container with ID starting with 33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266 not found: ID does not exist" containerID="33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266"
Jul 12 00:44:30.119212 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.119180    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266"} err="failed to get container status \"33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266\": rpc error: code = NotFound desc = could not find container \"33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266\": container with ID starting with 33d229649b325d45969cb138bb236d6aa62409ddde58a64c9704d693bad64266 not found: ID does not exist"
Jul 12 00:44:30.119212 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.119197    2582 scope.go:117] "RemoveContainer" containerID="e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071"
Jul 12 00:44:30.119400 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:44:30.119382    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071\": container with ID starting with e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071 not found: ID does not exist" containerID="e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071"
Jul 12 00:44:30.119447 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.119402    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071"} err="failed to get container status \"e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071\": rpc error: code = NotFound desc = could not find container \"e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071\": container with ID starting with e9d3bb0a60dfcea4f5d727548f67af1916d96a33a11f8b76692f25666d1e6071 not found: ID does not exist"
Jul 12 00:44:30.127084 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.127028    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"]
Jul 12 00:44:30.129820 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.129801    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-45be6f-openshift-default-7c5b57b7-fqr5d"]
Jul 12 00:44:30.845189 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:30.845153    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" path="/var/lib/kubelet/pods/31e322e8-508c-4d11-aff6-96a8a42d17fa/volumes"
Jul 12 00:44:35.148736 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.148693    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"]
Jul 12 00:44:35.149209 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.148950    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x" podUID="d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" containerName="maas-api" containerID="cri-o://681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2" gracePeriod=30
Jul 12 00:44:35.174815 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.174787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:35.394143 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.394116    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:44:35.421320 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.421241    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls\") pod \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") "
Jul 12 00:44:35.421320 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.421291    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-openshift-service-ca\") pod \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") "
Jul 12 00:44:35.421320 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.421309    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6dws\" (UniqueName: \"kubernetes.io/projected/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-kube-api-access-w6dws\") pod \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\" (UID: \"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82\") "
Jul 12 00:44:35.421640 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.421606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" (UID: "d2eb12e7-f934-4a63-aa4c-86d68c7c7d82"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:44:35.423377 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.423353    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" (UID: "d2eb12e7-f934-4a63-aa4c-86d68c7c7d82"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:44:35.423440 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.423400    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-kube-api-access-w6dws" (OuterVolumeSpecName: "kube-api-access-w6dws") pod "d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" (UID: "d2eb12e7-f934-4a63-aa4c-86d68c7c7d82"). InnerVolumeSpecName "kube-api-access-w6dws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:44:35.522017 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.521983    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-maas-api-tls\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:35.522017 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.522013    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-openshift-service-ca\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:35.522017 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:35.522023    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6dws\" (UniqueName: \"kubernetes.io/projected/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82-kube-api-access-w6dws\") on node \"ip-10-0-142-235.ec2.internal\" DevicePath \"\""
Jul 12 00:44:36.131927 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.131892    2582 generic.go:356] "Generic (PLEG): container finished" podID="d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" containerID="681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2" exitCode=0
Jul 12 00:44:36.132096 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.131950    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"
Jul 12 00:44:36.132096 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.131951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x" event={"ID":"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82","Type":"ContainerDied","Data":"681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2"}
Jul 12 00:44:36.132096 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.132080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x" event={"ID":"d2eb12e7-f934-4a63-aa4c-86d68c7c7d82","Type":"ContainerDied","Data":"812e9a80d1ffe35e79e6f97b62598a3932d97b715c0777a570b88e54e67f605f"}
Jul 12 00:44:36.132313 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.132109    2582 scope.go:117] "RemoveContainer" containerID="681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2"
Jul 12 00:44:36.141739 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.141717    2582 scope.go:117] "RemoveContainer" containerID="681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2"
Jul 12 00:44:36.142075 ip-10-0-142-235 kubenswrapper[2582]: E0712 00:44:36.142039    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2\": container with ID starting with 681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2 not found: ID does not exist" containerID="681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2"
Jul 12 00:44:36.142261 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.142087    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2"} err="failed to get container status \"681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2\": rpc error: code = NotFound desc = could not find container \"681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2\": container with ID starting with 681b976829cdcbdf91fd3dddd884e30c7e75e5cbb5bb4183cdafdfe3d54d9dc2 not found: ID does not exist"
Jul 12 00:44:36.156392 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.156366    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"]
Jul 12 00:44:36.158099 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.158081    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-39949b-7f687555bc-8948x"]
Jul 12 00:44:36.844335 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:36.844299    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" path="/var/lib/kubelet/pods/d2eb12e7-f934-4a63-aa4c-86d68c7c7d82/volumes"
Jul 12 00:44:38.380904 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:38.380866    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dcrgg"]
Jul 12 00:44:39.834752 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:39.834714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:45.607194 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:45.607154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:45.707996 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:45.707964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:50.502149 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:50.502109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:50.726958 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:50.726925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:44:56.706550 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:56.706479    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-hb25l_a63c3543-0638-4660-a38c-18c339664ea4/copy-manifests/0.log"
Jul 12 00:44:56.713312 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:56.713292    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-hb25l_a63c3543-0638-4660-a38c-18c339664ea4/manager/0.log"
Jul 12 00:44:57.321841 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:57.321802    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29730255-wgrmd_68508936-c38b-4bd6-b2ce-cf46e8d8c183/cleanup/0.log"
Jul 12 00:44:57.539189 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:57.539157    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-16b55c03-926tw_e2457b84-0b6d-4b2f-8921-445d5259a77a/revoke-keys/0.log"
Jul 12 00:44:57.648019 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:57.647947    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-cb79ec53-kh6xt_6612057b-e5f6-4f99-92cc-37fedcd326f3/revoke-keys/0.log"
Jul 12 00:44:57.874731 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:57.874707    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-fa215e-z2x4h_c1866854-54fd-4470-904d-beea21eecc75/revoke-keys/0.log"
Jul 12 00:44:57.984671 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:57.984597    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-0aa3397f-wqmm2_724e8b00-4669-44cc-b7c3-e019bf62a549/revoke-keys/0.log"
Jul 12 00:44:58.092368 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:58.092341    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-e82014-rjnfm_70cc658a-d25a-4fac-b74f-6a974a3aeef9/revoke-keys/0.log"
Jul 12 00:44:58.196687 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:58.196664    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-25afa8-d94nb_35918c9a-989b-42dc-af63-aa2da159ed8d/revoke-keys/0.log"
Jul 12 00:44:58.308210 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:58.308185    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-beef7709-g9cbg_58760f3c-fd01-4f18-a131-3798c440d6f2/revoke-keys/0.log"
Jul 12 00:44:58.423292 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:58.423259    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-061e4a12-4fh8k_2b6a884e-ccaf-4c6a-b69f-706fe3ad7ede/revoke-keys/0.log"
Jul 12 00:44:58.535832 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:44:58.535795    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-68596461-sxltj_d11faf9f-720d-41a6-9743-156d9bb8d4fc/revoke-keys/0.log"
Jul 12 00:45:00.130693 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.130664    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b"]
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.130974    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy"
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.130986    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy"
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.130998    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" containerName="maas-api"
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131003    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" containerName="maas-api"
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131016    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89560e90-9d92-40d6-87fb-7ac3fdd866ba" containerName="maas-api"
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131022    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="89560e90-9d92-40d6-87fb-7ac3fdd866ba" containerName="maas-api"
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131032    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" containerName="main"
Jul 12 00:45:00.131057 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131040    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" containerName="main"
Jul 12 00:45:00.131303 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131105    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy"
Jul 12 00:45:00.131303 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131114    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c492dc4-1917-4d63-9c8e-ff8e7f2219bd" containerName="main"
Jul 12 00:45:00.131303 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131125    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="89560e90-9d92-40d6-87fb-7ac3fdd866ba" containerName="maas-api"
Jul 12 00:45:00.131303 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.131133    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2eb12e7-f934-4a63-aa4c-86d68c7c7d82" containerName="maas-api"
Jul 12 00:45:00.133728 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.133711    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b"
Jul 12 00:45:00.138086 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.138065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:45:00.139874 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.139850    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b"]
Jul 12 00:45:00.144276 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.144259    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b"
Jul 12 00:45:00.267026 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.267003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b"]
Jul 12 00:45:00.269047 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:45:00.269016    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb606923a_599a_4678_aeb5_d76f9e43af13.slice/crio-3cb842ed65df51ee26b8d63862e5f1b414d1805a0820c1f8a876fe4a9d0db410 WatchSource:0}: Error finding container 3cb842ed65df51ee26b8d63862e5f1b414d1805a0820c1f8a876fe4a9d0db410: Status 404 returned error can't find the container with id 3cb842ed65df51ee26b8d63862e5f1b414d1805a0820c1f8a876fe4a9d0db410
Jul 12 00:45:00.304420 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.304401    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2csdf_b29fb729-3862-46b0-b5c7-2dfa8196f627/manager/0.log"
Jul 12 00:45:00.769539 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.769464    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ppjc7_abe48adc-0b6f-40cd-b383-9fddeb43b175/manager/0.log"
Jul 12 00:45:00.896916 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:00.896888    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dcrgg_5153660f-3647-49b0-9327-084457e1e118/limitador/0.log"
Jul 12 00:45:01.253830 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:01.253794    2582 generic.go:356] "Generic (PLEG): container finished" podID="b606923a-599a-4678-aeb5-d76f9e43af13" containerID="d754d6bcf32ac9410437c74c5e8b7c76a3ebef5b0243aad6944e504151db1207" exitCode=0
Jul 12 00:45:01.254230 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:01.253856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b" event={"ID":"b606923a-599a-4678-aeb5-d76f9e43af13","Type":"ContainerDied","Data":"d754d6bcf32ac9410437c74c5e8b7c76a3ebef5b0243aad6944e504151db1207"}
Jul 12 00:45:01.254230 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:01.253894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b" event={"ID":"b606923a-599a-4678-aeb5-d76f9e43af13","Type":"ContainerStarted","Data":"3cb842ed65df51ee26b8d63862e5f1b414d1805a0820c1f8a876fe4a9d0db410"}
Jul 12 00:45:01.483448 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:01.483362    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-svb77_95925044-5bcf-4650-9c07-0aed31e06b9b/discovery/0.log"
Jul 12 00:45:01.717153 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:01.717121    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-tbdbt_19931f67-b44e-44f5-a72d-3a1dd05e7ad5/kube-auth-proxy/0.log"
Jul 12 00:45:02.381900 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:02.381875    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b"
Jul 12 00:45:02.768838 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:02.768809    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-k7hjq_22af979c-430a-461e-8796-e95bb7a320e8/main/0.log"
Jul 12 00:45:03.264001 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:03.263972    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b"
Jul 12 00:45:03.264001 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:03.263979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730285-bvg7b" event={"ID":"b606923a-599a-4678-aeb5-d76f9e43af13","Type":"ContainerDied","Data":"3cb842ed65df51ee26b8d63862e5f1b414d1805a0820c1f8a876fe4a9d0db410"}
Jul 12 00:45:03.264206 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:03.264022    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb842ed65df51ee26b8d63862e5f1b414d1805a0820c1f8a876fe4a9d0db410"
Jul 12 00:45:07.401526 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:07.401491    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:45:07.501747 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:07.501716    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log" limit=1024
Jul 12 00:45:10.236776 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:10.236718    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vf5b8_cbc41fd4-ede0-4f04-8fdd-198613cee7a3/global-pull-secret-syncer/0.log"
Jul 12 00:45:10.280713 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:10.280683    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ddv5c_64077adb-8560-4a1b-960b-1bf489fe70e7/konnectivity-agent/0.log"
Jul 12 00:45:10.407721 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:10.407692    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-235.ec2.internal_2b2e1ee019fd15bef55bf7af42a95521/haproxy/0.log"
Jul 12 00:45:15.977312 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:15.977283    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2csdf_b29fb729-3862-46b0-b5c7-2dfa8196f627/manager/0.log"
Jul 12 00:45:16.199835 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:16.199805    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ppjc7_abe48adc-0b6f-40cd-b383-9fddeb43b175/manager/0.log"
Jul 12 00:45:16.224876 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:16.224854    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dcrgg_5153660f-3647-49b0-9327-084457e1e118/limitador/0.log"
Jul 12 00:45:18.308240 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:18.308204    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdspb_3a52c465-c9c5-43d5-8449-29dbc67c295b/node-exporter/0.log"
Jul 12 00:45:18.330349 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:18.330329    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdspb_3a52c465-c9c5-43d5-8449-29dbc67c295b/kube-rbac-proxy/0.log"
Jul 12 00:45:18.355713 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:18.355693    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdspb_3a52c465-c9c5-43d5-8449-29dbc67c295b/init-textfile/0.log"
Jul 12 00:45:21.838408 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.838378    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"]
Jul 12 00:45:21.838786 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.838652    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b606923a-599a-4678-aeb5-d76f9e43af13" containerName="cleanup"
Jul 12 00:45:21.838786 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.838662    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b606923a-599a-4678-aeb5-d76f9e43af13" containerName="cleanup"
Jul 12 00:45:21.838786 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.838684    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy"
Jul 12 00:45:21.838786 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.838690    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy"
Jul 12 00:45:21.838786 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.838738    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b606923a-599a-4678-aeb5-d76f9e43af13" containerName="cleanup"
Jul 12 00:45:21.838786 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.838745    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e322e8-508c-4d11-aff6-96a8a42d17fa" containerName="istio-proxy"
Jul 12 00:45:21.841678 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.841662    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:21.844117 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.844095    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kpjgh\"/\"kube-root-ca.crt\""
Jul 12 00:45:21.844248 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.844144    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kpjgh\"/\"openshift-service-ca.crt\""
Jul 12 00:45:21.845377 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.845356    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kpjgh\"/\"default-dockercfg-dbv4n\""
Jul 12 00:45:21.847571 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.847547    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"]
Jul 12 00:45:21.993875 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.993836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-podres\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:21.993875 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.993879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-lib-modules\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:21.994086 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.993899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-sys\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:21.994086 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.993981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-proc\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:21.994086 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:21.994003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfkjg\" (UniqueName: \"kubernetes.io/projected/ccec57de-c90f-4e24-a386-a68042425903-kube-api-access-lfkjg\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.094833 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.094733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-podres\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.094833 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.094788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-lib-modules\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.095054 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.094914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-sys\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.095054 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.094942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-podres\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.095054 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.094975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-proc\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.095054 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.095000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfkjg\" (UniqueName: \"kubernetes.io/projected/ccec57de-c90f-4e24-a386-a68042425903-kube-api-access-lfkjg\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.095054 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.095023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-sys\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.095232 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.095053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-lib-modules\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.095232 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.095062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccec57de-c90f-4e24-a386-a68042425903-proc\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.103257 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.103234    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfkjg\" (UniqueName: \"kubernetes.io/projected/ccec57de-c90f-4e24-a386-a68042425903-kube-api-access-lfkjg\") pod \"perf-node-gather-daemonset-hrsqj\" (UID: \"ccec57de-c90f-4e24-a386-a68042425903\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.152418 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.152391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.276603 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.276576    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"]
Jul 12 00:45:22.278612 ip-10-0-142-235 kubenswrapper[2582]: W0712 00:45:22.278579    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podccec57de_c90f_4e24_a386_a68042425903.slice/crio-a8044b0e7af3284d240e0648b8f84903f0cf3af5fd6e2a697820ce35535bf212 WatchSource:0}: Error finding container a8044b0e7af3284d240e0648b8f84903f0cf3af5fd6e2a697820ce35535bf212: Status 404 returned error can't find the container with id a8044b0e7af3284d240e0648b8f84903f0cf3af5fd6e2a697820ce35535bf212
Jul 12 00:45:22.349457 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.349397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj" event={"ID":"ccec57de-c90f-4e24-a386-a68042425903","Type":"ContainerStarted","Data":"25389112af345ffbb6651f4851f29b28fe0cc5161cd746c1fff64af684f29a5f"}
Jul 12 00:45:22.349457 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.349451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj" event={"ID":"ccec57de-c90f-4e24-a386-a68042425903","Type":"ContainerStarted","Data":"a8044b0e7af3284d240e0648b8f84903f0cf3af5fd6e2a697820ce35535bf212"}
Jul 12 00:45:22.349599 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.349480    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:22.364261 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:22.364207    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj" podStartSLOduration=1.364190289 podStartE2EDuration="1.364190289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 00:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:45:22.363383669 +0000 UTC m=+2901.992491180" watchObservedRunningTime="2026-07-12 00:45:22.364190289 +0000 UTC m=+2901.993297799"
Jul 12 00:45:23.240425 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:23.240395    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9lrsp_d3b9eba7-3853-43e8-9253-74b0c1202e84/dns/0.log"
Jul 12 00:45:23.259190 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:23.259170    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9lrsp_d3b9eba7-3853-43e8-9253-74b0c1202e84/kube-rbac-proxy/0.log"
Jul 12 00:45:23.389827 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:23.389802    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qlnjg_255afcde-e23e-42ef-8761-801ee1c5ce59/dns-node-resolver/0.log"
Jul 12 00:45:23.967730 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:23.967702    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77b84f9b5d-8wkvg_02d3f939-72db-41ac-9dbe-b5a9de6723ad/registry/0.log"
Jul 12 00:45:23.987904 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:23.987884    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5g8rm_8e5d059f-a82f-42a4-8cac-4b9da4527629/node-ca/0.log"
Jul 12 00:45:25.065513 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:25.065482    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-svb77_95925044-5bcf-4650-9c07-0aed31e06b9b/discovery/0.log"
Jul 12 00:45:25.105987 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:25.105945    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-tbdbt_19931f67-b44e-44f5-a72d-3a1dd05e7ad5/kube-auth-proxy/0.log"
Jul 12 00:45:25.998963 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:25.998935    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlt2q_45c77aa9-e858-416e-a02b-5296ec29c02e/serve-healthcheck-canary/0.log"
Jul 12 00:45:26.511166 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:26.511143    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qtkg_49509128-9062-4300-ba3d-75ed41771c7d/kube-rbac-proxy/0.log"
Jul 12 00:45:26.530562 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:26.530538    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qtkg_49509128-9062-4300-ba3d-75ed41771c7d/exporter/0.log"
Jul 12 00:45:26.553679 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:26.553660    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qtkg_49509128-9062-4300-ba3d-75ed41771c7d/extractor/0.log"
Jul 12 00:45:28.363171 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:28.363144    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-hrsqj"
Jul 12 00:45:29.284228 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:29.284201    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-hb25l_a63c3543-0638-4660-a38c-18c339664ea4/manager/0.log"
Jul 12 00:45:29.302504 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:29.302481    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-hb25l_a63c3543-0638-4660-a38c-18c339664ea4/copy-manifests/0.log"
Jul 12 00:45:30.896909 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:30.896887    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dzscp_ef97d5f2-3dd6-40d4-b312-05df5f2c3d69/openshift-lws-operator/0.log"
Jul 12 00:45:33.122955 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:33.122923    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-svb77_95925044-5bcf-4650-9c07-0aed31e06b9b/discovery/0.log"
Jul 12 00:45:33.149949 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:33.149923    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-tbdbt_19931f67-b44e-44f5-a72d-3a1dd05e7ad5/kube-auth-proxy/0.log"
Jul 12 00:45:34.645991 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:34.645956    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-svb77_95925044-5bcf-4650-9c07-0aed31e06b9b/discovery/0.log"
Jul 12 00:45:34.674562 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:34.674534    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-tbdbt_19931f67-b44e-44f5-a72d-3a1dd05e7ad5/kube-auth-proxy/0.log"
Jul 12 00:45:36.091158 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:36.091132    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-vd5l7_77dde842-63a6-45e2-8af3-49ffbb7eb975/migrator/0.log"
Jul 12 00:45:36.109046 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:36.109023    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-vd5l7_77dde842-63a6-45e2-8af3-49ffbb7eb975/graceful-termination/0.log"
Jul 12 00:45:37.877206 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:37.877181    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zksrc_be27a7fc-8795-4c3c-a16c-0b26d71af511/kube-multus-additional-cni-plugins/0.log"
Jul 12 00:45:37.895060 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:37.895035    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zksrc_be27a7fc-8795-4c3c-a16c-0b26d71af511/egress-router-binary-copy/0.log"
Jul 12 00:45:37.912976 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:37.912956    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zksrc_be27a7fc-8795-4c3c-a16c-0b26d71af511/cni-plugins/0.log"
Jul 12 00:45:37.930777 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:37.930744    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zksrc_be27a7fc-8795-4c3c-a16c-0b26d71af511/bond-cni-plugin/0.log"
Jul 12 00:45:37.947901 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:37.947880    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zksrc_be27a7fc-8795-4c3c-a16c-0b26d71af511/routeoverride-cni/0.log"
Jul 12 00:45:37.966869 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:37.966850    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zksrc_be27a7fc-8795-4c3c-a16c-0b26d71af511/whereabouts-cni-bincopy/0.log"
Jul 12 00:45:37.986775 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:37.986745    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zksrc_be27a7fc-8795-4c3c-a16c-0b26d71af511/whereabouts-cni/0.log"
Jul 12 00:45:38.041603 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:38.041582    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dr5r4_0753b88d-a323-48d7-9527-45ce5b216f9f/kube-multus/0.log"
Jul 12 00:45:38.172791 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:38.172697    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hc6sz_77da7a05-68dd-4f37-a0ef-70bc4b3904dc/network-metrics-daemon/0.log"
Jul 12 00:45:38.190497 ip-10-0-142-235 kubenswrapper[2582]: I0712 00:45:38.190476    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hc6sz_77da7a05-68dd-4f37-a0ef-70bc4b3904dc/kube-rbac-proxy/0.log"