Jul 15 18:16:53.260861 ip-10-0-135-84 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 18:16:53.717667 ip-10-0-135-84 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:16:53.717667 ip-10-0-135-84 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 18:16:53.717667 ip-10-0-135-84 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:16:53.717667 ip-10-0-135-84 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 18:16:53.717667 ip-10-0-135-84 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:16:53.717667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.716935    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722106    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722119    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722123    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722126    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722130    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722132    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722136    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722140    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722143    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722146    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722148    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722151    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722154    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722157    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722159    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722162    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722165    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722168    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722170    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722173    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:16:53.733561 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722176    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722178    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722183    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722188    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722192    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722196    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722199    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722202    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722205    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722208    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722211    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722214    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722217    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722219    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722223    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722226    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722228    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722231    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722234    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:16:53.748614 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722237    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722239    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722241    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722244    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722247    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722250    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722252    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722255    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722258    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722261    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722264    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722266    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722268    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722271    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722273    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722276    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722279    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722282    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722285    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722288    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:16:53.750448 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722291    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722293    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722297    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722299    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722302    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722304    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722307    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722310    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722312    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722315    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722317    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722320    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722323    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722325    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722328    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722330    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722333    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722335    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722338    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:16:53.752656 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722340    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722343    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722345    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722348    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722350    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722354    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722357    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722359    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722363    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722366    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722370    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722373    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722376    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722378    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722381    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722383    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722386    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722389    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722391    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:16:53.767928 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722394    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.722396    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725721    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725732    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725735    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725739    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725743    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725746    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725749    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725751    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725754    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725757    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725760    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725762    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725765    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725768    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725770    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725773    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725776    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:16:53.770428 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725779    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725783    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725787    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725790    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725793    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725797    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725801    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725804    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725807    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725809    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725812    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725815    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725818    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725820    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725823    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725826    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725829    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725831    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725834    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725837    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:16:53.772241 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725839    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725841    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725845    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725847    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725850    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725853    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725855    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725858    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725861    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725863    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725866    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725868    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725870    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725873    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725876    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725879    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725881    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725884    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725888    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725892    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:16:53.784408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725895    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725897    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725901    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725905    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725909    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725912    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725915    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725917    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725920    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725922    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725925    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725929    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725932    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725935    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725938    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725940    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725943    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725946    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725948    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:16:53.786354 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725951    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725953    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725956    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725959    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725961    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725964    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725966    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725969    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725971    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725974    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725979    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725981    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725984    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725987    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725990    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725992    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725995    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.725998    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726001    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726003    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:16:53.788647 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726006    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726010    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726013    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726833    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726846    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726851    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726856    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726861    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726866    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726870    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726874    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726879    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726883    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726888    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726897    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726901    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726905    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726909    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726914    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:16:53.804174 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726918    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:16:53.793483 ip-10-0-135-84 systemd[1]: Started Kubernetes Kubelet.
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726922    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726927    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726934    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726938    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726944    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726949    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726953    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726961    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726966    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726972    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726978    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726982    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726986    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.726999    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727004    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727008    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727013    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727017    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727022    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:16:53.806886 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727031    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727035    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727039    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727044    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727049    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727053    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727057    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727062    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727066    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727070    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727074    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727078    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727082    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727091    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727095    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727104    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727110    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727114    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727122    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:16:53.836196 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727126    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727131    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727135    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727139    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727144    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727148    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727157    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727165    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727169    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727173    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727177    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727181    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727185    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727189    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727194    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727199    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727204    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727262    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727270    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727288    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:16:53.839002 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727393    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727403    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727408    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727412    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727416    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727423    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727429    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727434    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727441    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727445    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727450    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727454    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727459    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727463    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727468    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727472    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727477    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727481    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727486    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727489    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:16:54.033593 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727494    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727498    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727502    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.727506    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727613    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727622    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727631    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727636    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727641    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727647    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727653    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727662    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727666    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727669    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727672    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727676    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727679    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727682    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727685    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727688    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727692    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727694    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727699    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 15 18:16:54.053037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727701    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727705    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727708    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727711    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727715    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727718    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727721    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727724    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727727    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727730    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727733    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727736    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727739    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727743    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727746    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727750    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727753    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727756    2563 flags.go:64] FLAG: --enable-server="true"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727759    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727763    2563 flags.go:64] FLAG: --event-burst="100"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727767    2563 flags.go:64] FLAG: --event-qps="50"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727770    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727774    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727777    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 15 18:16:54.057691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727780    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727783    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727787    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727790    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727793    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727796    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727799    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727802    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727805    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727808    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727810    2563 flags.go:64] FLAG: --feature-gates=""
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727814    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727817    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727820    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727823    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727826    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727829    2563 flags.go:64] FLAG: --help="false"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727832    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727835    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727838    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727841    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727844    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727848    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727851    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 18:16:54.058433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727854    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727857    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727860    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727862    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727867    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727870    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727873    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727876    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727879    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727881    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727884    2563 flags.go:64] FLAG: --lock-file=""
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727887    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727890    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727893    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727898    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727901    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727904    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727907    2563 flags.go:64] FLAG: --logging-format="text"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727909    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727912    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727915    2563 flags.go:64] FLAG: --manifest-url=""
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727918    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727923    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727926    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727929    2563 flags.go:64] FLAG: --max-pods="110"
Jul 15 18:16:54.059182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727933    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727935    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727938    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727941    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727944    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727947    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727951    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727958    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727961    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727964    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727967    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727971    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727976    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727979    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727982    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727985    2563 flags.go:64] FLAG: --port="10250"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727988    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727991    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c25ea340a58d9e4"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727994    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.727997    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728000    2563 flags.go:64] FLAG: --register-node="true"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728003    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728006    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728009    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 15 18:16:54.059952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728013    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728016    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728019    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728022    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728025    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728028    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728031    2563 flags.go:64] FLAG: --runonce="false"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728033    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728037    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728040    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728042    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728045    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728048    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728051    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728056    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728058    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728061    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728064    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728067    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728070    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728074    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728077    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728083    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728086    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728088    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 18:16:54.060667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728093    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728096    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728099    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728102    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728105    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728108    2563 flags.go:64] FLAG: --v="2"
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728112    2563 flags.go:64] FLAG: --version="false"
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728116    2563 flags.go:64] FLAG: --vmodule=""
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728120    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.728123    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728232    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728236    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728239    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728242    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728245    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728248    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728251    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728253    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728256    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728260    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728262    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728267    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:16:54.061546 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728269    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728272    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728275    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728277    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728280    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728284    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728286    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728290    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728294    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728297    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728299    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728302    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728305    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728307    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728310    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728312    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728315    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728318    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728320    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:16:54.062202 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728323    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728326    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728328    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728331    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728333    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728336    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728338    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728341    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728343    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728346    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728348    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728351    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728355    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728357    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728360    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728362    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728365    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728367    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728371    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728373    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:16:54.062845 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728376    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728379    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728381    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728385    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728387    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728390    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728392    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728395    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728397    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728400    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728403    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728407    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728410    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728414    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728416    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728419    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728422    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728425    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728428    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:16:54.063505 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728432    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728434    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728437    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728440    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728443    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728447    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728450    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728453    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728456    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728458    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728461    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728465    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728467    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728470    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728473    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728475    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728478    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728481    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728483    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728486    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:16:54.064093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728489    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728491    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728494    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728496    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728499    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728501    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728504    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728507    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.728510    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.729241    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.736538    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.736554    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.736594    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.736602    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 18:16:54.064651 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736656    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736661    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736664    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736667    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736670    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736673    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736676    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736679    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736682    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736685    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736688    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736690    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736693    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736697    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736700    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736704    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736707    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736710    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736712    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:16:54.065093 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736715    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736718    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736721    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736723    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736726    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736728    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736731    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736734    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736736    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736739    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736743    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736746    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736748    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736751    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736754    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736757    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736759    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736762    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736765    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736767    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:16:54.065662 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736769    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736772    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736775    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736777    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736780    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736783    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736785    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736788    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736791    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736794    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736796    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736798    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736801    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736804    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736807    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736809    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736812    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736814    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736817    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736819    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:16:54.066250 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736822    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736824    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736827    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736831    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736834    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736836    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736839    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736841    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736844    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736847    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736850    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736852    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736855    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736857    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736860    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736862    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736865    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736867    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736870    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736873    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:16:54.066828 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736876    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736878    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736881    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736883    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736886    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736888    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736891    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736893    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736896    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736899    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736901    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736905    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736907    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736910    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736914    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736918    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736922    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736926    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736929    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:16:54.199141 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.736932    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.736937    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737055    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737060    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737063    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737067    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737071    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737074    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737077    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737079    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737082    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737086    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737088    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737091    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:16:54.199814 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737094    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737097    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737100    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737103    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737105    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737108    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737111    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737114    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737120    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737122    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737125    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737127    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737130    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737133    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737135    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737138    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737141    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737143    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737146    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737149    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:16:54.200321 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737152    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737154    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737157    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737160    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737162    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737165    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737167    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737170    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737172    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737175    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737177    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737180    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737182    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737185    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737188    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737190    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737193    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737195    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737198    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737200    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:16:54.200888 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737204    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737207    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737210    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737212    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737215    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737217    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737220    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737222    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737225    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737229    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737231    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737234    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737236    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737239    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737241    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737244    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737246    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737249    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737251    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737254    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:16:54.201473 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737256    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737259    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737263    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737266    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737270    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737272    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737275    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737278    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737281    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737283    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737286    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737289    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737293    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737297    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737300    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737302    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737305    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737308    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737312    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:16:54.202343 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737314    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737317    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737319    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737322    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737325    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737327    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737330    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:53.737332    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.737337    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.737451    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.740716    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.742514    2563 server.go:1019] "Starting client certificate rotation"
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.742608    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:16:54.202909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.742668    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:16:54.377822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.745350    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:16:54.377822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.746502    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:16:54.377822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.756590    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 15 18:16:54.377822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.759561    2563 log.go:25] "Validated CRI v1 image API"
Jul 15 18:16:54.377822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.761256    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 18:16:54.377822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.764685    2563 fs.go:135] Filesystem UUIDs: map[08b50278-f359-4fa8-8b6b-fa189579a802:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8540b128-5b6d-4358-a5e0-78133bbfd536:/dev/nvme0n1p4]
Jul 15 18:16:54.377822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.764701    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.769691    2563 manager.go:216] Machine: {Timestamp:2026-07-15 18:16:53.768280902 +0000 UTC m=+0.376391931 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080507 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2168ba457890db867ea757b5e02774 SystemUUID:ec2168ba-4578-90db-867e-a757b5e02774 BootID:4a072248-b8b1-4a99-903e-f357bf54e9cf Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:bf:1d:c3:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:bf:1d:c3:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:ad:4c:d1:52:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.769792    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.769901    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.773743    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.773766    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.775302    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.775313    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.775320    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.775334    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.777145    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781200    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781812    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781918    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781944    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781955    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781978    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 18:16:54.378400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781989    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.781997    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.782279    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.782292    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.784626    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787048    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787076    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787219    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787231    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787237    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787243    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787251    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787256    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787933    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787949    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787960    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787968    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787980    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.787991    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.789621    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.789630    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.792654    2563 server.go:1268] "Started kubelet"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.792745    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.793245    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.793305    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.794845    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.795116    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.796410    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.796504    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.796504    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.800329    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.802550    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.802549    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.802679    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803345    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803425    2563 factory.go:55] Registering systemd factory
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803440    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803524    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803831    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803638    2563 factory.go:153] Registering CRI-O factory
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.802628    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-84.ec2.internal.18c2895814e223c0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-84.ec2.internal,UID:ip-10-0-135-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-84.ec2.internal,},FirstTimestamp:2026-07-15 18:16:53.792629696 +0000 UTC m=+0.400740724,LastTimestamp:2026-07-15 18:16:53.792629696 +0000 UTC m=+0.400740724,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-84.ec2.internal,}"
Jul 15 18:16:54.379021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803901    2563 factory.go:223] Registration of the crio container factory successfully
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803952    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803959    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803967    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803976    2563 factory.go:103] Registering Raw factory
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.803989    2563 manager.go:1196] Started watching for new ooms in manager
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.804375    2563 manager.go:349] Starting recovery of all containers
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.812053    2563 manager.go:354] Recovery completed
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.812703    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.812815    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.815768    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.817879    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.817910    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.817925    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.818339    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.818346    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.818348    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.818406    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.818954    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.818978    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.818994    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.820540    2563 policy_none.go:49] "None policy: Start"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.820553    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.820563    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.821467    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-84.ec2.internal.18c289581663a76e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-84.ec2.internal,UID:ip-10-0-135-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-84.ec2.internal,},FirstTimestamp:2026-07-15 18:16:53.817894766 +0000 UTC m=+0.426005800,LastTimestamp:2026-07-15 18:16:53.817894766 +0000 UTC m=+0.426005800,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-84.ec2.internal,}"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.822653    2563 policy_none.go:47] "Start"
Jul 15 18:16:54.380110 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.831345    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-84.ec2.internal.18c2895816640224  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-84.ec2.internal,UID:ip-10-0-135-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-84.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-84.ec2.internal,},FirstTimestamp:2026-07-15 18:16:53.817917988 +0000 UTC m=+0.426029017,LastTimestamp:2026-07-15 18:16:53.817917988 +0000 UTC m=+0.426029017,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-84.ec2.internal,}"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.842629    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-84.ec2.internal.18c2895816642e14  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-84.ec2.internal,UID:ip-10-0-135-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-84.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-84.ec2.internal,},FirstTimestamp:2026-07-15 18:16:53.817929236 +0000 UTC m=+0.426040265,LastTimestamp:2026-07-15 18:16:53.817929236 +0000 UTC m=+0.426040265,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-84.ec2.internal,}"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.851771    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-84.ec2.internal.18c289581663a76e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-84.ec2.internal.18c289581663a76e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-84.ec2.internal,UID:ip-10-0-135-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-84.ec2.internal,},FirstTimestamp:2026-07-15 18:16:53.817894766 +0000 UTC m=+0.426005800,LastTimestamp:2026-07-15 18:16:53.818964692 +0000 UTC m=+0.427075724,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-84.ec2.internal,}"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.855100    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-47vqb"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.860820    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-84.ec2.internal.18c2895816640224\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-84.ec2.internal.18c2895816640224  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-84.ec2.internal,UID:ip-10-0-135-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-84.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-84.ec2.internal,},FirstTimestamp:2026-07-15 18:16:53.817917988 +0000 UTC m=+0.426029017,LastTimestamp:2026-07-15 18:16:53.818983461 +0000 UTC m=+0.427094491,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-84.ec2.internal,}"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.862976    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-47vqb"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.869563    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-84.ec2.internal.18c2895816642e14\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-84.ec2.internal.18c2895816642e14  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-84.ec2.internal,UID:ip-10-0-135-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-84.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-84.ec2.internal,},FirstTimestamp:2026-07-15 18:16:53.817929236 +0000 UTC m=+0.426040265,LastTimestamp:2026-07-15 18:16:53.818999035 +0000 UTC m=+0.427110063,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-84.ec2.internal,}"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.889311    2563 manager.go:337] "Starting Device Plugin manager"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.889347    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.889357    2563 server.go:87] "Starting device plugin registration server"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.889681    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.889696    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.889812    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.889913    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.889922    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.890767    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.890835    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.967861    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.969112    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.969148    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 18:16:54.380863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.969174    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:53.969214    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.971635    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.990630    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.991520    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.991549    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.991560    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:53.991599    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.003236    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.003253    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-84.ec2.internal\": node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.047218    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.071418    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal"]
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.071496    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.073010    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.073036    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.073046    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075271    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075447    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075940    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075957    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075968    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075981    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.075999    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.076008    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.078108    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.078137    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.079045    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.079067    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.079083    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.105635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af7837592f58bf7188ad520291307120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal\" (UID: \"af7837592f58bf7188ad520291307120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.105655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/996dc6e33536e0334a4ae6997f784794-config\") pod \"kube-apiserver-proxy-ip-10-0-135-84.ec2.internal\" (UID: \"996dc6e33536e0334a4ae6997f784794\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.105672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af7837592f58bf7188ad520291307120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal\" (UID: \"af7837592f58bf7188ad520291307120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.120248    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-84.ec2.internal\" not found" node="ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.381429 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.123799    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-84.ec2.internal\" not found" node="ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.147987    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.206702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/996dc6e33536e0334a4ae6997f784794-config\") pod \"kube-apiserver-proxy-ip-10-0-135-84.ec2.internal\" (UID: \"996dc6e33536e0334a4ae6997f784794\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.206732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af7837592f58bf7188ad520291307120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal\" (UID: \"af7837592f58bf7188ad520291307120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.206748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af7837592f58bf7188ad520291307120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal\" (UID: \"af7837592f58bf7188ad520291307120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.206799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af7837592f58bf7188ad520291307120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal\" (UID: \"af7837592f58bf7188ad520291307120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.206803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/996dc6e33536e0334a4ae6997f784794-config\") pod \"kube-apiserver-proxy-ip-10-0-135-84.ec2.internal\" (UID: \"996dc6e33536e0334a4ae6997f784794\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.206817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af7837592f58bf7188ad520291307120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal\" (UID: \"af7837592f58bf7188ad520291307120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.248948    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.382410 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.349659    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.575181 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.422293    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.575181 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:54.425959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:54.575181 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.450756    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:54.575181 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:54.551317    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:56.113682 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:56.052625    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:56.245813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.142125    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 18:16:56.245813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.142292    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 18:16:56.245813 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:56.153302    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:56.254207    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-84.ec2.internal\" not found"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.269336    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.269788    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 18:11:55 +0000 UTC" deadline="2027-12-30 06:06:46.103470097 +0000 UTC"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.269832    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12779h49m49.833642222s"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.271000    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.271024    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.271036    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:16:56.374351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.343899    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:16:56.515636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.403664    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:56.515636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.416201    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:16:56.515636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.417625    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal"
Jul 15 18:16:56.515636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.426335    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:16:56.515636 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:56.445921    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7837592f58bf7188ad520291307120.slice/crio-941b0f6341b376ea7127962d615a297f5346ca2aee83ae5a6b3e34ac1799ac16 WatchSource:0}: Error finding container 941b0f6341b376ea7127962d615a297f5346ca2aee83ae5a6b3e34ac1799ac16: Status 404 returned error can't find the container with id 941b0f6341b376ea7127962d615a297f5346ca2aee83ae5a6b3e34ac1799ac16
Jul 15 18:16:56.515636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.456690    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:16:56.515636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.475003    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:16:56.819370 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:56.683266    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.183730    2563 apiserver.go:52] "Watching apiserver"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.196603    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.196972    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mkfsd","openshift-network-operator/iptables-alerter-jjljf","openshift-ovn-kubernetes/ovnkube-node-rcsfh","kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal","openshift-cluster-node-tuning-operator/tuned-69hk6","openshift-dns/node-resolver-gppmk","openshift-image-registry/node-ca-slsgg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal","openshift-multus/multus-additional-cni-plugins-lzxlr","openshift-multus/multus-xlvqg","openshift-multus/network-metrics-daemon-qpjch","kube-system/global-pull-secret-syncer-9f264","kube-system/konnectivity-agent-sdpbf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"]
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.199405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.201569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.202172    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.202219    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.202258    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.202398    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ld77f\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.202399    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.203712    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gnk7l\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.203877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.204359    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.204696    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.204742    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.206197    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.206474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.206802    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.207273    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.207297    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.207328    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hvn8q\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.207868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.207919    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.208697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.208830    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pndnw\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.208868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.209051    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.209105    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.210909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.210947    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wvqfk\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.210947    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.211172    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.213113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.213713    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 18:16:57.304506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.213763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4hnhh\""
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.213797    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.215550    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.215587    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.215782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6rc5f\""
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216309    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505-agent-certs\") pod \"konnectivity-agent-sdpbf\" (UID: \"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505\") " pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-ovn\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-env-overrides\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-k8s-cni-cncf-io\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-conf-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-multus-certs\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj5g6\" (UniqueName: \"kubernetes.io/projected/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-kube-api-access-nj5g6\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-etc-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-log-socket\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.216996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-device-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-socket-dir-parent\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.306660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-slash\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-var-lib-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovnkube-config\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-system-cni-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-os-release\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-etc-kubernetes\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-run-netns\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-node-log\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovn-node-metrics-cert\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-registration-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-netns\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-kubelet\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-systemd-units\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-cni-bin\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.217845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnd77\" (UniqueName: \"kubernetes.io/projected/5ff3f969-b923-4621-aa21-3d4744d44c96-kube-api-access-fnd77\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.307672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-cnibin\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-cni-bin\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-cni-multus\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505-konnectivity-ca\") pod \"konnectivity-agent-sdpbf\" (UID: \"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505\") " pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-cni-netd\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovnkube-script-lib\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc968\" (UniqueName: \"kubernetes.io/projected/a6259e05-38dd-498e-8b71-5c65d5ce02ed-kube-api-access-lc968\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-socket-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.218988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-sys-fs\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-cni-binary-copy\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-kubelet\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-hostroot\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-systemd\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-cni-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-daemon-config\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219372    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 18:16:57.308568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhwdl\""
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219670    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.219856    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.220665    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.220814    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.220884    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.222333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.224703    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.225850    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.225968    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.226147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hppx4\""
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.227483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.227590    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:16:57.309568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.308866    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.319913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505-agent-certs\") pod \"konnectivity-agent-sdpbf\" (UID: \"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505\") " pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.319939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-conf-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.319958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.319988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d53a3b94-2590-4925-ba9a-5c729a1e9e27-kubelet-config\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.320025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rvfv\" (UniqueName: \"kubernetes.io/projected/30120d8d-84a9-40ea-b346-a5327afb5299-kube-api-access-5rvfv\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.320054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-conf-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.320102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-socket-dir-parent\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.320242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-socket-dir-parent\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.320341    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.320977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705b5981-93d7-4af4-bbcd-5be67cefd26a-tmp-dir\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.321830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-run\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.321987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-slash\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovnkube-config\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-system-cni-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-slash\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-system-cni-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-os-release\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.405406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-lib-modules\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovn-node-metrics-cert\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-netns\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-modprobe-d\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-netns\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysctl-d\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-sys\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4x96\" (UniqueName: \"kubernetes.io/projected/692cba5d-5f4b-4fde-b399-2ddf16d39905-kube-api-access-g4x96\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-systemd-units\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnd77\" (UniqueName: \"kubernetes.io/projected/5ff3f969-b923-4621-aa21-3d4744d44c96-kube-api-access-fnd77\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-cnibin\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505-konnectivity-ca\") pod \"konnectivity-agent-sdpbf\" (UID: \"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505\") " pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-cnibin\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-cni-netd\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcm98\" (UniqueName: \"kubernetes.io/projected/705b5981-93d7-4af4-bbcd-5be67cefd26a-kube-api-access-gcm98\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-var-lib-kubelet\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-tuned\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-cni-netd\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-socket-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-systemd-units\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-kubelet\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovnkube-config\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysctl-conf\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-daemon-config\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-kubelet\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-cnibin\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-socket-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-kubernetes\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-ovn\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-env-overrides\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.322972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-ovn\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505-konnectivity-ca\") pod \"konnectivity-agent-sdpbf\" (UID: \"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505\") " pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.407723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-k8s-cni-cncf-io\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-k8s-cni-cncf-io\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-multus-certs\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj5g6\" (UniqueName: \"kubernetes.io/projected/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-kube-api-access-nj5g6\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1feb4209-6162-40f0-9da1-de0326d11572-iptables-alerter-script\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-daemon-config\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8734cf12-bfe6-438e-865c-49b06f669d2b-serviceca\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-run-multus-certs\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-etc-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-log-socket\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-etc-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-log-socket\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-device-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-env-overrides\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.408655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-device-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d53a3b94-2590-4925-ba9a-5c729a1e9e27-dbus\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-var-lib-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-os-release\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-var-lib-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-etc-kubernetes\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmzz\" (UniqueName: \"kubernetes.io/projected/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-kube-api-access-vcmzz\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-os-release\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-etc-kubernetes\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-cni-binary-copy\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8734cf12-bfe6-438e-865c-49b06f669d2b-host\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-systemd\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-run-netns\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.409385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-node-log\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-registration-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/705b5981-93d7-4af4-bbcd-5be67cefd26a-hosts-file\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-run-netns\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323952    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-node-log\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1feb4209-6162-40f0-9da1-de0326d11572-host-slash\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-registration-dir\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.323990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrbfx\" (UniqueName: \"kubernetes.io/projected/8734cf12-bfe6-438e-865c-49b06f669d2b-kube-api-access-hrbfx\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/692cba5d-5f4b-4fde-b399-2ddf16d39905-tmp\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-kubelet\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-cni-bin\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505-agent-certs\") pod \"konnectivity-agent-sdpbf\" (UID: \"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505\") " pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-kubelet\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-host-cni-bin\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.410292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-cni-bin\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-cni-bin\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-cni-multus\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-host-var-lib-cni-multus\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovnkube-script-lib\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-openvswitch\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-system-cni-dir\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc968\" (UniqueName: \"kubernetes.io/projected/a6259e05-38dd-498e-8b71-5c65d5ce02ed-kube-api-access-lc968\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-sys-fs\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-cni-binary-copy\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-hostroot\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysconfig\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-systemd\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-cni-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kzsr\" (UniqueName: \"kubernetes.io/projected/1feb4209-6162-40f0-9da1-de0326d11572-kube-api-access-7kzsr\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.411061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-host\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ff3f969-b923-4621-aa21-3d4744d44c96-sys-fs\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-hostroot\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6259e05-38dd-498e-8b71-5c65d5ce02ed-run-systemd\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-multus-cni-dir\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovnkube-script-lib\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.324842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-cni-binary-copy\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.325821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6259e05-38dd-498e-8b71-5c65d5ce02ed-ovn-node-metrics-cert\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.331556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnd77\" (UniqueName: \"kubernetes.io/projected/5ff3f969-b923-4621-aa21-3d4744d44c96-kube-api-access-fnd77\") pod \"aws-ebs-csi-driver-node-5lsxz\" (UID: \"5ff3f969-b923-4621-aa21-3d4744d44c96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.332237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj5g6\" (UniqueName: \"kubernetes.io/projected/edf1cbdf-52b1-46ad-89df-a6c4f3d75c98-kube-api-access-nj5g6\") pod \"multus-xlvqg\" (UID: \"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98\") " pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.332401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc968\" (UniqueName: \"kubernetes.io/projected/a6259e05-38dd-498e-8b71-5c65d5ce02ed-kube-api-access-lc968\") pod \"ovnkube-node-rcsfh\" (UID: \"a6259e05-38dd-498e-8b71-5c65d5ce02ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.343282    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5j2ct"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.348904    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5j2ct"
Jul 15 18:16:57.412096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.378833    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal" event={"ID":"af7837592f58bf7188ad520291307120","Type":"ContainerStarted","Data":"941b0f6341b376ea7127962d615a297f5346ca2aee83ae5a6b3e34ac1799ac16"}
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysconfig\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kzsr\" (UniqueName: \"kubernetes.io/projected/1feb4209-6162-40f0-9da1-de0326d11572-kube-api-access-7kzsr\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-host\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d53a3b94-2590-4925-ba9a-5c729a1e9e27-kubelet-config\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysconfig\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rvfv\" (UniqueName: \"kubernetes.io/projected/30120d8d-84a9-40ea-b346-a5327afb5299-kube-api-access-5rvfv\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705b5981-93d7-4af4-bbcd-5be67cefd26a-tmp-dir\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-run\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-os-release\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-lib-modules\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-modprobe-d\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysctl-d\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-sys\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4x96\" (UniqueName: \"kubernetes.io/projected/692cba5d-5f4b-4fde-b399-2ddf16d39905-kube-api-access-g4x96\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcm98\" (UniqueName: \"kubernetes.io/projected/705b5981-93d7-4af4-bbcd-5be67cefd26a-kube-api-access-gcm98\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.508460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-var-lib-kubelet\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-tuned\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysctl-conf\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-cnibin\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-kubernetes\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1feb4209-6162-40f0-9da1-de0326d11572-iptables-alerter-script\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8734cf12-bfe6-438e-865c-49b06f669d2b-serviceca\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.425910    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d53a3b94-2590-4925-ba9a-5c729a1e9e27-kubelet-config\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-cnibin\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.425989    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs podName:5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d nodeName:}" failed. No retries permitted until 2026-07-15 18:16:57.925962253 +0000 UTC m=+3.133225520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs") pod "network-metrics-daemon-qpjch" (UID: "5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-modprobe-d\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysctl-d\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-kubernetes\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-var-lib-kubelet\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-sys\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.509501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-host\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-run\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.425918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-sysctl-conf\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d53a3b94-2590-4925-ba9a-5c729a1e9e27-dbus\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-os-release\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d53a3b94-2590-4925-ba9a-5c729a1e9e27-dbus\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmzz\" (UniqueName: \"kubernetes.io/projected/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-kube-api-access-vcmzz\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-cni-binary-copy\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-lib-modules\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8734cf12-bfe6-438e-865c-49b06f669d2b-host\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8734cf12-bfe6-438e-865c-49b06f669d2b-host\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-systemd\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/705b5981-93d7-4af4-bbcd-5be67cefd26a-hosts-file\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.510237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1feb4209-6162-40f0-9da1-de0326d11572-host-slash\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-systemd\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.426853    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrbfx\" (UniqueName: \"kubernetes.io/projected/8734cf12-bfe6-438e-865c-49b06f669d2b-kube-api-access-hrbfx\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/692cba5d-5f4b-4fde-b399-2ddf16d39905-tmp\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.426909    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret podName:d53a3b94-2590-4925-ba9a-5c729a1e9e27 nodeName:}" failed. No retries permitted until 2026-07-15 18:16:57.926893387 +0000 UTC m=+3.134156653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret") pod "global-pull-secret-syncer-9f264" (UID: "d53a3b94-2590-4925-ba9a-5c729a1e9e27") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-system-cni-dir\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.427029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30120d8d-84a9-40ea-b346-a5327afb5299-system-cni-dir\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.427068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1feb4209-6162-40f0-9da1-de0326d11572-iptables-alerter-script\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.426904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8734cf12-bfe6-438e-865c-49b06f669d2b-serviceca\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.427071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/705b5981-93d7-4af4-bbcd-5be67cefd26a-hosts-file\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.427099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-cni-binary-copy\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.427198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1feb4209-6162-40f0-9da1-de0326d11572-host-slash\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.427218    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705b5981-93d7-4af4-bbcd-5be67cefd26a-tmp-dir\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.427490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30120d8d-84a9-40ea-b346-a5327afb5299-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.511282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.429482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/692cba5d-5f4b-4fde-b399-2ddf16d39905-tmp\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.429660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/692cba5d-5f4b-4fde-b399-2ddf16d39905-etc-tuned\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.436070    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.436091    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.436107    2563 projected.go:196] Error preparing data for projected volume kube-api-access-68wk2 for pod openshift-network-diagnostics/network-check-target-mkfsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.436210    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2 podName:46115be4-26af-4071-83ce-611250fd6cd4 nodeName:}" failed. No retries permitted until 2026-07-15 18:16:57.936191449 +0000 UTC m=+3.143454712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-68wk2" (UniqueName: "kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2") pod "network-check-target-mkfsd" (UID: "46115be4-26af-4071-83ce-611250fd6cd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.437687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4x96\" (UniqueName: \"kubernetes.io/projected/692cba5d-5f4b-4fde-b399-2ddf16d39905-kube-api-access-g4x96\") pod \"tuned-69hk6\" (UID: \"692cba5d-5f4b-4fde-b399-2ddf16d39905\") " pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.437936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kzsr\" (UniqueName: \"kubernetes.io/projected/1feb4209-6162-40f0-9da1-de0326d11572-kube-api-access-7kzsr\") pod \"iptables-alerter-jjljf\" (UID: \"1feb4209-6162-40f0-9da1-de0326d11572\") " pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.438022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rvfv\" (UniqueName: \"kubernetes.io/projected/30120d8d-84a9-40ea-b346-a5327afb5299-kube-api-access-5rvfv\") pod \"multus-additional-cni-plugins-lzxlr\" (UID: \"30120d8d-84a9-40ea-b346-a5327afb5299\") " pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.438465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcm98\" (UniqueName: \"kubernetes.io/projected/705b5981-93d7-4af4-bbcd-5be67cefd26a-kube-api-access-gcm98\") pod \"node-resolver-gppmk\" (UID: \"705b5981-93d7-4af4-bbcd-5be67cefd26a\") " pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.438847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrbfx\" (UniqueName: \"kubernetes.io/projected/8734cf12-bfe6-438e-865c-49b06f669d2b-kube-api-access-hrbfx\") pod \"node-ca-slsgg\" (UID: \"8734cf12-bfe6-438e-865c-49b06f669d2b\") " pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.439278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmzz\" (UniqueName: \"kubernetes.io/projected/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-kube-api-access-vcmzz\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:57.451199    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996dc6e33536e0334a4ae6997f784794.slice/crio-76eeff9e70b56af3ad90ffc8dd7f2ac0751ad2ea6ce8c9c01e642676c4358bc0 WatchSource:0}: Error finding container 76eeff9e70b56af3ad90ffc8dd7f2ac0751ad2ea6ce8c9c01e642676c4358bc0: Status 404 returned error can't find the container with id 76eeff9e70b56af3ad90ffc8dd7f2ac0751ad2ea6ce8c9c01e642676c4358bc0
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.469860    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:16:57.512123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.512032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlvqg"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.523660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.531758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:57.533035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf1cbdf_52b1_46ad_89df_a6c4f3d75c98.slice/crio-5cf7ff571e1c30dda7d08590b4ec16982830c0754f516605fd0deeb398993db0 WatchSource:0}: Error finding container 5cf7ff571e1c30dda7d08590b4ec16982830c0754f516605fd0deeb398993db0: Status 404 returned error can't find the container with id 5cf7ff571e1c30dda7d08590b4ec16982830c0754f516605fd0deeb398993db0
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.536315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:57.536641    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8cb2cb_be58_4fa5_8a2b_26fc9cc03505.slice/crio-ea24f8f842afa16a6fcc25e237d097351fa7e1144b36b3607479c084880631ee WatchSource:0}: Error finding container ea24f8f842afa16a6fcc25e237d097351fa7e1144b36b3607479c084880631ee: Status 404 returned error can't find the container with id ea24f8f842afa16a6fcc25e237d097351fa7e1144b36b3607479c084880631ee
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:57.541191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6259e05_38dd_498e_8b71_5c65d5ce02ed.slice/crio-f6a894897b760a1d961e450fb5e7a3a25722a0a556d9569bbc76cd8a247c72f7 WatchSource:0}: Error finding container f6a894897b760a1d961e450fb5e7a3a25722a0a556d9569bbc76cd8a247c72f7: Status 404 returned error can't find the container with id f6a894897b760a1d961e450fb5e7a3a25722a0a556d9569bbc76cd8a247c72f7
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.542453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69hk6"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.550492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gppmk"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:57.552228    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692cba5d_5f4b_4fde_b399_2ddf16d39905.slice/crio-86b87f3168b06ab9d7b4fa4b67fdd7cf29423e2430e1a2e96769b81b7e5824c5 WatchSource:0}: Error finding container 86b87f3168b06ab9d7b4fa4b67fdd7cf29423e2430e1a2e96769b81b7e5824c5: Status 404 returned error can't find the container with id 86b87f3168b06ab9d7b4fa4b67fdd7cf29423e2430e1a2e96769b81b7e5824c5
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.556214    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lzxlr"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.563262    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slsgg"
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:57.570904    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705b5981_93d7_4af4_bbcd_5be67cefd26a.slice/crio-32ab97601f067e7ebf63480ae52d7f0ae3b636be0b6a65d84fa2ea7b3b7a7753 WatchSource:0}: Error finding container 32ab97601f067e7ebf63480ae52d7f0ae3b636be0b6a65d84fa2ea7b3b7a7753: Status 404 returned error can't find the container with id 32ab97601f067e7ebf63480ae52d7f0ae3b636be0b6a65d84fa2ea7b3b7a7753
Jul 15 18:16:57.583583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.574008    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jjljf"
Jul 15 18:16:57.930524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.930477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:57.930709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:57.930539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:57.930709 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.930659    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:16:57.930816 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.930661    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:16:57.930816 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.930739    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret podName:d53a3b94-2590-4925-ba9a-5c729a1e9e27 nodeName:}" failed. No retries permitted until 2026-07-15 18:16:58.930717071 +0000 UTC m=+4.137980343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret") pod "global-pull-secret-syncer-9f264" (UID: "d53a3b94-2590-4925-ba9a-5c729a1e9e27") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:16:57.930816 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:57.930769    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs podName:5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d nodeName:}" failed. No retries permitted until 2026-07-15 18:16:58.930747212 +0000 UTC m=+4.138010485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs") pod "network-metrics-daemon-qpjch" (UID: "5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:16:57.976611 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:16:57.976591    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8734cf12_bfe6_438e_865c_49b06f669d2b.slice/crio-a555214236dad79b3cfd6977727a4bf996fc3face65c7063484f35873ea7ae7c WatchSource:0}: Error finding container a555214236dad79b3cfd6977727a4bf996fc3face65c7063484f35873ea7ae7c: Status 404 returned error can't find the container with id a555214236dad79b3cfd6977727a4bf996fc3face65c7063484f35873ea7ae7c
Jul 15 18:16:58.031396 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.031375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:16:58.031578 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.031557    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:16:58.031623 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.031589    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:16:58.031623 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.031604    2563 projected.go:196] Error preparing data for projected volume kube-api-access-68wk2 for pod openshift-network-diagnostics/network-check-target-mkfsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:16:58.031684 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.031659    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2 podName:46115be4-26af-4071-83ce-611250fd6cd4 nodeName:}" failed. No retries permitted until 2026-07-15 18:16:59.03164101 +0000 UTC m=+4.238904287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-68wk2" (UniqueName: "kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2") pod "network-check-target-mkfsd" (UID: "46115be4-26af-4071-83ce-611250fd6cd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:16:58.354995 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.354894    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:11:57 +0000 UTC" deadline="2028-04-20 08:14:03.373660796 +0000 UTC"
Jul 15 18:16:58.354995 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.354938    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15469h57m5.018727253s"
Jul 15 18:16:58.371276 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.370496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:16:58.371276 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.370896    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:16:58.389551 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.389510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slsgg" event={"ID":"8734cf12-bfe6-438e-865c-49b06f669d2b","Type":"ContainerStarted","Data":"a555214236dad79b3cfd6977727a4bf996fc3face65c7063484f35873ea7ae7c"}
Jul 15 18:16:58.407096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.407065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jjljf" event={"ID":"1feb4209-6162-40f0-9da1-de0326d11572","Type":"ContainerStarted","Data":"c8540c820dd964f4c586857cbd28ad36d3f43898013c21f41f64a1cd6f0c45ba"}
Jul 15 18:16:58.425215 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.425182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerStarted","Data":"f77b86e40afecb1c9f0d9114548901be40495398e261727bf91029f48aa9930d"}
Jul 15 18:16:58.431067 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.431037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69hk6" event={"ID":"692cba5d-5f4b-4fde-b399-2ddf16d39905","Type":"ContainerStarted","Data":"86b87f3168b06ab9d7b4fa4b67fdd7cf29423e2430e1a2e96769b81b7e5824c5"}
Jul 15 18:16:58.440714 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.440682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz" event={"ID":"5ff3f969-b923-4621-aa21-3d4744d44c96","Type":"ContainerStarted","Data":"e670ddaebe9a21c178c865904b6fd23a1a6f7c097ca75e9d19cbead9ee4bf164"}
Jul 15 18:16:58.453020 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.452991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"f6a894897b760a1d961e450fb5e7a3a25722a0a556d9569bbc76cd8a247c72f7"}
Jul 15 18:16:58.459613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.459334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdpbf" event={"ID":"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505","Type":"ContainerStarted","Data":"ea24f8f842afa16a6fcc25e237d097351fa7e1144b36b3607479c084880631ee"}
Jul 15 18:16:58.460807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.460779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal" event={"ID":"996dc6e33536e0334a4ae6997f784794","Type":"ContainerStarted","Data":"76eeff9e70b56af3ad90ffc8dd7f2ac0751ad2ea6ce8c9c01e642676c4358bc0"}
Jul 15 18:16:58.463937 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.463872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gppmk" event={"ID":"705b5981-93d7-4af4-bbcd-5be67cefd26a","Type":"ContainerStarted","Data":"32ab97601f067e7ebf63480ae52d7f0ae3b636be0b6a65d84fa2ea7b3b7a7753"}
Jul 15 18:16:58.469371 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.469320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlvqg" event={"ID":"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98","Type":"ContainerStarted","Data":"5cf7ff571e1c30dda7d08590b4ec16982830c0754f516605fd0deeb398993db0"}
Jul 15 18:16:58.938485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.938448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:58.938673 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:58.938508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:58.938673 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.938633    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:16:58.938786 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.938690    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs podName:5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d nodeName:}" failed. No retries permitted until 2026-07-15 18:17:00.938669964 +0000 UTC m=+6.145933225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs") pod "network-metrics-daemon-qpjch" (UID: "5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:16:58.939203 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.939106    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:16:58.939203 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:58.939161    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret podName:d53a3b94-2590-4925-ba9a-5c729a1e9e27 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:00.939146868 +0000 UTC m=+6.146410136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret") pod "global-pull-secret-syncer-9f264" (UID: "d53a3b94-2590-4925-ba9a-5c729a1e9e27") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:16:59.039815 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:59.039780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:16:59.040007 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:59.039968    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:16:59.040007 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:59.039987    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:16:59.040007 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:59.039999    2563 projected.go:196] Error preparing data for projected volume kube-api-access-68wk2 for pod openshift-network-diagnostics/network-check-target-mkfsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:16:59.040152 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:59.040057    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2 podName:46115be4-26af-4071-83ce-611250fd6cd4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:01.040038456 +0000 UTC m=+6.247301721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-68wk2" (UniqueName: "kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2") pod "network-check-target-mkfsd" (UID: "46115be4-26af-4071-83ce-611250fd6cd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:16:59.356168 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:59.356040    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:11:57 +0000 UTC" deadline="2028-03-24 15:06:04.314540614 +0000 UTC"
Jul 15 18:16:59.356168 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:59.356115    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14828h49m4.958430571s"
Jul 15 18:16:59.370287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:59.370258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:16:59.370472 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:59.370445    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:16:59.370837 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:59.370818    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:16:59.370933 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:16:59.370913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:16:59.491486 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:59.491447    2563 generic.go:356] "Generic (PLEG): container finished" podID="af7837592f58bf7188ad520291307120" containerID="f64ec9de83afd9ac04ff079c59c9b99c716ed51da1253beda91469aaeee311b4" exitCode=0
Jul 15 18:16:59.491679 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:16:59.491510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal" event={"ID":"af7837592f58bf7188ad520291307120","Type":"ContainerDied","Data":"f64ec9de83afd9ac04ff079c59c9b99c716ed51da1253beda91469aaeee311b4"}
Jul 15 18:17:00.370638 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:00.370597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:00.371157 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:00.370728    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:00.509644 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:00.509562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal" event={"ID":"af7837592f58bf7188ad520291307120","Type":"ContainerStarted","Data":"af94bfd0e08882abf2730f81c054f48940d4f015a7c897318b5b32abf16c4bec"}
Jul 15 18:17:00.525812 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:00.525749    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-84.ec2.internal" podStartSLOduration=4.525730328 podStartE2EDuration="4.525730328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:00.525285891 +0000 UTC m=+5.732549175" watchObservedRunningTime="2026-07-15 18:17:00.525730328 +0000 UTC m=+5.732993614"
Jul 15 18:17:00.960268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:00.959450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:00.960268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:00.959511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:00.960268 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:00.959639    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:00.960268 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:00.959701    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs podName:5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d nodeName:}" failed. No retries permitted until 2026-07-15 18:17:04.959680816 +0000 UTC m=+10.166944100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs") pod "network-metrics-daemon-qpjch" (UID: "5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:00.960268 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:00.959769    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:00.960268 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:00.959801    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret podName:d53a3b94-2590-4925-ba9a-5c729a1e9e27 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:04.959791099 +0000 UTC m=+10.167054367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret") pod "global-pull-secret-syncer-9f264" (UID: "d53a3b94-2590-4925-ba9a-5c729a1e9e27") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:01.062012 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:01.061326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:01.062012 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:01.061636    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:01.062012 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:01.061696    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:01.062012 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:01.061717    2563 projected.go:196] Error preparing data for projected volume kube-api-access-68wk2 for pod openshift-network-diagnostics/network-check-target-mkfsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:01.062012 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:01.061776    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2 podName:46115be4-26af-4071-83ce-611250fd6cd4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:05.061757706 +0000 UTC m=+10.269020970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-68wk2" (UniqueName: "kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2") pod "network-check-target-mkfsd" (UID: "46115be4-26af-4071-83ce-611250fd6cd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:01.371449 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:01.370885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:01.371449 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:01.371036    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:01.372045 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:01.371573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:01.372045 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:01.371677    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:02.371855 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:02.371268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:02.371855 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:02.371394    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:03.370706 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:03.370635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:03.370903 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:03.370763    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:03.371220 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:03.371052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:03.371220 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:03.371178    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:04.370406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:04.370376    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:04.370982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:04.370513    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:04.994080 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:04.993969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:04.994080 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:04.994043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:04.994321 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:04.994190    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:04.994321 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:04.994274    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret podName:d53a3b94-2590-4925-ba9a-5c729a1e9e27 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:12.994259939 +0000 UTC m=+18.201523200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret") pod "global-pull-secret-syncer-9f264" (UID: "d53a3b94-2590-4925-ba9a-5c729a1e9e27") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:04.994595 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:04.994204    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:04.994595 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:04.994567    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs podName:5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d nodeName:}" failed. No retries permitted until 2026-07-15 18:17:12.994546466 +0000 UTC m=+18.201809728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs") pod "network-metrics-daemon-qpjch" (UID: "5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:05.094622 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:05.094468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:05.094622 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:05.094627    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:05.094846 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:05.094651    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:05.094846 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:05.094663    2563 projected.go:196] Error preparing data for projected volume kube-api-access-68wk2 for pod openshift-network-diagnostics/network-check-target-mkfsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:05.094846 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:05.094725    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2 podName:46115be4-26af-4071-83ce-611250fd6cd4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:13.094705553 +0000 UTC m=+18.301968817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-68wk2" (UniqueName: "kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2") pod "network-check-target-mkfsd" (UID: "46115be4-26af-4071-83ce-611250fd6cd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:05.371339 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:05.371258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:05.371339 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:05.371258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:05.372962 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:05.372488    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:05.372962 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:05.372913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:06.370555 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:06.370517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:06.370752 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:06.370649    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:07.371089 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:07.371055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:07.371524 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:07.371191    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:07.371524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:07.371056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:07.371524 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:07.371481    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:08.370687 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:08.370643    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:08.370869 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:08.370780    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:09.371019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:09.370986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:09.371465 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:09.370989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:09.371465 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:09.371131    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:09.371465 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:09.371212    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:10.371257 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:10.371225    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:10.371702 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:10.371339    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:11.370742 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:11.370706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:11.370927 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:11.370759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:11.370927 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:11.370853    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:11.371042 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:11.370979    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:12.370894 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:12.370858    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:12.371316 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:12.370985    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:13.058922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:13.058886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:13.058922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:13.058935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:13.059222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.059045    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:13.059222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.059045    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:13.059222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.059111    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs podName:5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d nodeName:}" failed. No retries permitted until 2026-07-15 18:17:29.059093643 +0000 UTC m=+34.266356908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs") pod "network-metrics-daemon-qpjch" (UID: "5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:13.059222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.059130    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret podName:d53a3b94-2590-4925-ba9a-5c729a1e9e27 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:29.059121324 +0000 UTC m=+34.266384585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret") pod "global-pull-secret-syncer-9f264" (UID: "d53a3b94-2590-4925-ba9a-5c729a1e9e27") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:13.159441 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:13.159390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:13.159602 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.159583    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:13.159685 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.159609    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:13.159685 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.159622    2563 projected.go:196] Error preparing data for projected volume kube-api-access-68wk2 for pod openshift-network-diagnostics/network-check-target-mkfsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:13.159781 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.159686    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2 podName:46115be4-26af-4071-83ce-611250fd6cd4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:29.159666448 +0000 UTC m=+34.366929708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-68wk2" (UniqueName: "kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2") pod "network-check-target-mkfsd" (UID: "46115be4-26af-4071-83ce-611250fd6cd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:13.371196 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:13.371121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:13.371570 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.371266    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:13.371570 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:13.371313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:13.371570 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:13.371405    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:14.370709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:14.370670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:14.370886 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:14.370784    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:15.372171 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:15.372133    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:15.372613 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:15.372262    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:15.372613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:15.372313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:15.372613 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:15.372413    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:16.370608 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:16.370565    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:16.370781 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:16.370695    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:17.370298 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:17.370263    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:17.370895 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:17.370402    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:17.370895 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:17.370469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:17.370895 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:17.370588    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:17.554112 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:17.554073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal" event={"ID":"996dc6e33536e0334a4ae6997f784794","Type":"ContainerStarted","Data":"ab595d9aa412bf859a751e7f99dd2f8d86cef17f3d6c8607ad8f2808249b232f"}
Jul 15 18:17:18.371594 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.371173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:18.372361 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:18.371748    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:18.557326 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.557295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlvqg" event={"ID":"edf1cbdf-52b1-46ad-89df-a6c4f3d75c98","Type":"ContainerStarted","Data":"bd994c17b6f06627680733ee369ad1ae2d87403b8eafcea31586d89f08fac2bf"}
Jul 15 18:17:18.558728 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.558701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slsgg" event={"ID":"8734cf12-bfe6-438e-865c-49b06f669d2b","Type":"ContainerStarted","Data":"b86ddc193aeb55da65a1e346e8c45506f041f194e38fb99f252f238084d5cb2c"}
Jul 15 18:17:18.559930 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.559909    2563 generic.go:356] "Generic (PLEG): container finished" podID="30120d8d-84a9-40ea-b346-a5327afb5299" containerID="1c8bdb48b0f2ebc0bf3f2b04ca0c87c8a444908b9be3b684d9b9ee4d753a89c5" exitCode=0
Jul 15 18:17:18.560028 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.559953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerDied","Data":"1c8bdb48b0f2ebc0bf3f2b04ca0c87c8a444908b9be3b684d9b9ee4d753a89c5"}
Jul 15 18:17:18.563901 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.562209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69hk6" event={"ID":"692cba5d-5f4b-4fde-b399-2ddf16d39905","Type":"ContainerStarted","Data":"531f28eb5eaaf83dc84458fc4f2a522f39ac7e42aaf3b071b413f3554c1d4d76"}
Jul 15 18:17:18.565544 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.565524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz" event={"ID":"5ff3f969-b923-4621-aa21-3d4744d44c96","Type":"ContainerStarted","Data":"e0aec887c49adb26ce87bee17a04306eada91a5447819ef5217fae326ea797f8"}
Jul 15 18:17:18.568008 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.567992    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:17:18.568315 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.568298    2563 generic.go:356] "Generic (PLEG): container finished" podID="a6259e05-38dd-498e-8b71-5c65d5ce02ed" containerID="8cc0256b910b44a610c9fa42e1d7e9369db2de8646e93a64f82b23360cce06f1" exitCode=1
Jul 15 18:17:18.568408 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.568362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"3ac43be12e68f99ed5bc9ae75c54072910df4f9dbb1c55a9df813cb0f4b4e60c"}
Jul 15 18:17:18.568473 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.568442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"c0e548406a8be31323cd598500874b853c387390579b60d86d1dd223ec048597"}
Jul 15 18:17:18.568529 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.568495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"3f424144f2c7ce51171d4fbb9c7ab3e77f1ed6a4cbbd9b09338d0e80aceb1045"}
Jul 15 18:17:18.568581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.568541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"a69e653cce00f84ea425c89ddad0ebdd0d3214afdcf9f254e639fdcdde062526"}
Jul 15 18:17:18.568581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.568570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerDied","Data":"8cc0256b910b44a610c9fa42e1d7e9369db2de8646e93a64f82b23360cce06f1"}
Jul 15 18:17:18.568680 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.568605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"8d553e461cb54f391ef3c8496cf115f91c9f4649bed8d48d41c4227b4f1a1691"}
Jul 15 18:17:18.569666 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.569640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdpbf" event={"ID":"ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505","Type":"ContainerStarted","Data":"3ac9eca2702c40cfb04cb4fdb025d6a2dd917ee376316eba40a6f31f8ce17503"}
Jul 15 18:17:18.570882 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.570859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gppmk" event={"ID":"705b5981-93d7-4af4-bbcd-5be67cefd26a","Type":"ContainerStarted","Data":"379fca51af8fe9012ec1aa13e45553308e7fc76c6de9972e5b09af5962bf166b"}
Jul 15 18:17:18.576775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.576742    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-84.ec2.internal" podStartSLOduration=22.576729254 podStartE2EDuration="22.576729254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:17.596592766 +0000 UTC m=+22.803856050" watchObservedRunningTime="2026-07-15 18:17:18.576729254 +0000 UTC m=+23.783992531"
Jul 15 18:17:18.577070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.577042    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xlvqg" podStartSLOduration=3.56807526 podStartE2EDuration="23.577033863s" totalImagesPullingTime="20.008958603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:18.57680601 +0000 UTC m=+23.784069294" watchObservedRunningTime="2026-07-15 18:17:18.577033863 +0000 UTC m=+23.784297147"
Jul 15 18:17:18.590580 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.590547    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gppmk" podStartSLOduration=3.731069461 podStartE2EDuration="23.590535828s" totalImagesPullingTime="19.859466367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:18.590251027 +0000 UTC m=+23.797514310" watchObservedRunningTime="2026-07-15 18:17:18.590535828 +0000 UTC m=+23.797799111"
Jul 15 18:17:18.604125 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.604088    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sdpbf" podStartSLOduration=3.703005354 podStartE2EDuration="23.604076093s" totalImagesPullingTime="19.901070739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:18.60363292 +0000 UTC m=+23.810896203" watchObservedRunningTime="2026-07-15 18:17:18.604076093 +0000 UTC m=+23.811339375"
Jul 15 18:17:18.634508 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.634470    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-slsgg" podStartSLOduration=4.170115037 podStartE2EDuration="23.63445695s" totalImagesPullingTime="19.464341913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:18.634344598 +0000 UTC m=+23.841607880" watchObservedRunningTime="2026-07-15 18:17:18.63445695 +0000 UTC m=+23.841720233"
Jul 15 18:17:18.649400 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.649368    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-69hk6" podStartSLOduration=3.754047273 podStartE2EDuration="23.649354668s" totalImagesPullingTime="19.895307395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:18.649329522 +0000 UTC m=+23.856592817" watchObservedRunningTime="2026-07-15 18:17:18.649354668 +0000 UTC m=+23.856618330"
Jul 15 18:17:18.995692 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:18.995632    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 18:17:19.304208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.304106    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T18:17:18.995649939Z","UUID":"03cac111-2cd9-45dd-83fd-e26713787c51","Handler":null,"Name":"","Endpoint":""}
Jul 15 18:17:19.305764 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.305744    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 18:17:19.305874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.305780    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 18:17:19.370340 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.370309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:19.370574 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.370309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:19.370574 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:19.370455    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:19.370574 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:19.370538    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:19.576275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.576123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jjljf" event={"ID":"1feb4209-6162-40f0-9da1-de0326d11572","Type":"ContainerStarted","Data":"22e789b5ac9abf1667e4079ef638d3d349edbe67bef8497df7adcf6e8d146ecb"}
Jul 15 18:17:19.578806 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.578781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz" event={"ID":"5ff3f969-b923-4621-aa21-3d4744d44c96","Type":"ContainerStarted","Data":"7d6808d0a0611e35b7e4b185b3222d67c6445b80759195529ecea557f883b437"}
Jul 15 18:17:19.593806 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:19.591943    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jjljf" podStartSLOduration=5.12705457 podStartE2EDuration="24.591922448s" totalImagesPullingTime="19.464867878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:19.590240377 +0000 UTC m=+24.797503662" watchObservedRunningTime="2026-07-15 18:17:19.591922448 +0000 UTC m=+24.799185734"
Jul 15 18:17:20.370435 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:20.370250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:20.370659 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:20.370533    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:20.570392 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:20.570307    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:17:20.570928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:20.570907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:17:20.583631 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:20.583601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz" event={"ID":"5ff3f969-b923-4621-aa21-3d4744d44c96","Type":"ContainerStarted","Data":"b73c4c5378aa1b1ee0a1fa9125f34a9ac55a6f22bab64ac4e77d61d2967dc04a"}
Jul 15 18:17:20.584122 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:20.584103    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:17:20.584589 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:20.584564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sdpbf"
Jul 15 18:17:20.613021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:20.612966    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lsxz" podStartSLOduration=3.357255093 podStartE2EDuration="25.612945507s" totalImagesPullingTime="22.255690414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:20.612308583 +0000 UTC m=+25.819571867" watchObservedRunningTime="2026-07-15 18:17:20.612945507 +0000 UTC m=+25.820208791"
Jul 15 18:17:21.370553 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:21.370524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:21.370781 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:21.370522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:21.370781 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:21.370657    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:21.370781 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:21.370708    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:21.589874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:21.589846    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:17:21.590344 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:21.590285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"93a1d5bc266cc744da89262673e5def88ec4a447f3e7abcd2b00dbe84cb1cc4d"}
Jul 15 18:17:22.370732 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:22.370697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:22.370923 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:22.370808    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:23.373193 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.373024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:23.373805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.373081    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:23.373805 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:23.373266    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:23.373805 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:23.373346    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:23.596066 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.596035    2563 generic.go:356] "Generic (PLEG): container finished" podID="30120d8d-84a9-40ea-b346-a5327afb5299" containerID="e300df1c613dcbfb52c40697f16dbcfdb2f4d9e07413db3cdb279c98816c2660" exitCode=0
Jul 15 18:17:23.596259 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.596124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerDied","Data":"e300df1c613dcbfb52c40697f16dbcfdb2f4d9e07413db3cdb279c98816c2660"}
Jul 15 18:17:23.599605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.599588    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:17:23.599930 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.599912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"87b91caf7274121387bcb6a80b698136d073ae249220fb37917931b0a1a10f03"}
Jul 15 18:17:23.600131 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.600118    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:17:23.600191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.600173    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:17:23.600357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.600342    2563 scope.go:117] "RemoveContainer" containerID="8cc0256b910b44a610c9fa42e1d7e9369db2de8646e93a64f82b23360cce06f1"
Jul 15 18:17:23.615529 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:23.615510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:17:24.370296 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:24.370269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:24.370545 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:24.370354    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:24.606626 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:24.606602    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:17:24.607030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:24.607004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" event={"ID":"a6259e05-38dd-498e-8b71-5c65d5ce02ed","Type":"ContainerStarted","Data":"651381cda4717088f40dd5a997ed3a24b7f573b41145e158f8672dbf8ac577bd"}
Jul 15 18:17:24.607201 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:24.607186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:17:24.622037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:24.621959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:17:24.635738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:24.635689    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh" podStartSLOduration=9.6793277 podStartE2EDuration="29.635670451s" totalImagesPullingTime="19.956342751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:24.635285239 +0000 UTC m=+29.842548533" watchObservedRunningTime="2026-07-15 18:17:24.635670451 +0000 UTC m=+29.842933734"
Jul 15 18:17:25.028820 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:25.028738    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9f264"]
Jul 15 18:17:25.028978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:25.028876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:25.029039 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:25.028988    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:25.032041 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:25.032014    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mkfsd"]
Jul 15 18:17:25.032179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:25.032107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:25.032226 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:25.032201    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:25.032837 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:25.032817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qpjch"]
Jul 15 18:17:25.032930 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:25.032919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:25.033009 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:25.032994    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:26.371021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:26.370827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:26.371398 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:26.370892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:26.371398 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:26.371106    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:26.371398 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:26.371168    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:26.613528 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:26.613492    2563 generic.go:356] "Generic (PLEG): container finished" podID="30120d8d-84a9-40ea-b346-a5327afb5299" containerID="2dc2e3a104f419f16e1f4f2306fe87b8aece6b4d672720faf9f19394b8cbc1d0" exitCode=0
Jul 15 18:17:26.613675 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:26.613572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerDied","Data":"2dc2e3a104f419f16e1f4f2306fe87b8aece6b4d672720faf9f19394b8cbc1d0"}
Jul 15 18:17:27.370914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:27.370864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:27.371090 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:27.371002    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:28.371019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:28.370984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:28.371202 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:28.370984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:28.371202 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:28.371113    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:28.371202 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:28.371154    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:28.620356 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:28.620324    2563 generic.go:356] "Generic (PLEG): container finished" podID="30120d8d-84a9-40ea-b346-a5327afb5299" containerID="e61359b96bccebfc40700df504d4a4780a1df343d501303a4f3b354e19dc8616" exitCode=0
Jul 15 18:17:28.620555 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:28.620389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerDied","Data":"e61359b96bccebfc40700df504d4a4780a1df343d501303a4f3b354e19dc8616"}
Jul 15 18:17:29.080202 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:29.080174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:29.080337 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:29.080214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:29.080337 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.080306    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:29.080337 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.080315    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:29.080450 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.080357    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs podName:5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d nodeName:}" failed. No retries permitted until 2026-07-15 18:18:01.080341162 +0000 UTC m=+66.287604422 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs") pod "network-metrics-daemon-qpjch" (UID: "5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:29.080450 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.080369    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret podName:d53a3b94-2590-4925-ba9a-5c729a1e9e27 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:01.080363626 +0000 UTC m=+66.287626887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret") pod "global-pull-secret-syncer-9f264" (UID: "d53a3b94-2590-4925-ba9a-5c729a1e9e27") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:29.181095 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:29.181064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:29.181241 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.181222    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:29.181288 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.181247    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:29.181288 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.181265    2563 projected.go:196] Error preparing data for projected volume kube-api-access-68wk2 for pod openshift-network-diagnostics/network-check-target-mkfsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:29.181347 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.181312    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2 podName:46115be4-26af-4071-83ce-611250fd6cd4 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:01.181299531 +0000 UTC m=+66.388562794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-68wk2" (UniqueName: "kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2") pod "network-check-target-mkfsd" (UID: "46115be4-26af-4071-83ce-611250fd6cd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:29.370702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:29.370674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:29.370853 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:29.370805    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:30.370579 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:30.370371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:30.371037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:30.370404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:30.371037 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:30.370698    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpjch" podUID="5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d"
Jul 15 18:17:30.371037 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:30.370745    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkfsd" podUID="46115be4-26af-4071-83ce-611250fd6cd4"
Jul 15 18:17:31.371199 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.371086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:31.371644 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.371238    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f264" podUID="d53a3b94-2590-4925-ba9a-5c729a1e9e27"
Jul 15 18:17:31.583743 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.583711    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-84.ec2.internal" event="NodeReady"
Jul 15 18:17:31.583915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.583886    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 18:17:31.618073 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.618039    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-848dbd79f-tvt7g"]
Jul 15 18:17:31.621765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.621692    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"]
Jul 15 18:17:31.621908 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.621823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.623958 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.623931    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 18:17:31.624339 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.624321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 18:17:31.624883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.624744    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 18:17:31.624883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.624785    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cknmp\""
Jul 15 18:17:31.625455 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.625408    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-747c86b468-tkw4q"]
Jul 15 18:17:31.625556 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.625505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.627839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.627816    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 18:17:31.628518 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.628499    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 18:17:31.628747 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.628729    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7fzfw"]
Jul 15 18:17:31.628873 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.628852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.630352 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.630192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 18:17:31.630352 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.630270    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 18:17:31.630537 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.630519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g88sr\""
Jul 15 18:17:31.631457 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.631435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 18:17:31.631667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.631631    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 18:17:31.632147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.631665    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 18:17:31.632147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.631707    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 18:17:31.632147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.631631    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 18:17:31.632147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.631973    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 18:17:31.632147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.631973    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 18:17:31.632560 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.632221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hpjp\""
Jul 15 18:17:31.632767 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.632749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.634108 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.634055    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"]
Jul 15 18:17:31.635547 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.635527    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 18:17:31.638022 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.637721    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 18:17:31.638022 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.637939    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 18:17:31.638374 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.638350    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xrtjb\""
Jul 15 18:17:31.638660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.638497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 18:17:31.639580 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.639494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-848dbd79f-tvt7g"]
Jul 15 18:17:31.640804 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.640412    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7fzfw"]
Jul 15 18:17:31.642895 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.642876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-747c86b468-tkw4q"]
Jul 15 18:17:31.643606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.643586    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 18:17:31.643796 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.643776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x5ssz"]
Jul 15 18:17:31.649377 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.649358    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nmh4k"]
Jul 15 18:17:31.649551 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.649481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.651985 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.651960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 18:17:31.652088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.652009    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 18:17:31.652164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.651965    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42x79\""
Jul 15 18:17:31.652817 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.652798    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:31.655248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.655230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmh4k"]
Jul 15 18:17:31.656261 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.656230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 18:17:31.656452 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.656416    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 18:17:31.656564 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.656472    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 18:17:31.656564 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.656367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4vnzq\""
Jul 15 18:17:31.657037 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.657021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x5ssz"]
Jul 15 18:17:31.797871 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.797837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfa7522-42d5-41a3-aa9d-6902aa7db748-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.797871 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.797878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78be1337-2cdd-4cad-a905-9294a39e76e2-ca-trust-extracted\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.797902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-certificates\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb2wp\" (UniqueName: \"kubernetes.io/projected/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-kube-api-access-vb2wp\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.798096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.798096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7522-42d5-41a3-aa9d-6902aa7db748-tmp\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.798096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gws56\" (UniqueName: \"kubernetes.io/projected/3dfa7522-42d5-41a3-aa9d-6902aa7db748-kube-api-access-gws56\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.798275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7522-42d5-41a3-aa9d-6902aa7db748-snapshots\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.798275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcwv\" (UniqueName: \"kubernetes.io/projected/8baba4c0-1b57-495f-8d85-ed87c1299bcd-kube-api-access-7kcwv\") pod \"ingress-canary-nmh4k\" (UID: \"8baba4c0-1b57-495f-8d85-ed87c1299bcd\") " pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:31.798275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.798275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8baba4c0-1b57-495f-8d85-ed87c1299bcd-cert\") pod \"ingress-canary-nmh4k\" (UID: \"8baba4c0-1b57-495f-8d85-ed87c1299bcd\") " pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:31.798275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8ct\" (UniqueName: \"kubernetes.io/projected/906bf707-f2cb-4427-a5ec-31ecae5c73e4-kube-api-access-8d8ct\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.798275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-trusted-ca\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-tmp-dir\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.798521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/906bf707-f2cb-4427-a5ec-31ecae5c73e4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.798521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzkl4\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-kube-api-access-pzkl4\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dfa7522-42d5-41a3-aa9d-6902aa7db748-serving-cert\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.798521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-bound-sa-token\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfa7522-42d5-41a3-aa9d-6902aa7db748-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.798758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-config-volume\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.798758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-image-registry-private-configuration\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-stats-auth\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.798758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.798758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-installation-pull-secrets\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.798984 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.798984 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-default-certificate\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.798984 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.798834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rzw\" (UniqueName: \"kubernetes.io/projected/1ee39a41-b482-41df-bf00-531086353273-kube-api-access-d8rzw\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.900307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78be1337-2cdd-4cad-a905-9294a39e76e2-ca-trust-extracted\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.900307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-certificates\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb2wp\" (UniqueName: \"kubernetes.io/projected/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-kube-api-access-vb2wp\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7522-42d5-41a3-aa9d-6902aa7db748-tmp\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gws56\" (UniqueName: \"kubernetes.io/projected/3dfa7522-42d5-41a3-aa9d-6902aa7db748-kube-api-access-gws56\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7522-42d5-41a3-aa9d-6902aa7db748-snapshots\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcwv\" (UniqueName: \"kubernetes.io/projected/8baba4c0-1b57-495f-8d85-ed87c1299bcd-kube-api-access-7kcwv\") pod \"ingress-canary-nmh4k\" (UID: \"8baba4c0-1b57-495f-8d85-ed87c1299bcd\") " pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.900497    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8baba4c0-1b57-495f-8d85-ed87c1299bcd-cert\") pod \"ingress-canary-nmh4k\" (UID: \"8baba4c0-1b57-495f-8d85-ed87c1299bcd\") " pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:31.900563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8ct\" (UniqueName: \"kubernetes.io/projected/906bf707-f2cb-4427-a5ec-31ecae5c73e4-kube-api-access-8d8ct\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.900601    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls podName:906bf707-f2cb-4427-a5ec-31ecae5c73e4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:32.400578716 +0000 UTC m=+37.607841980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hd2k" (UID: "906bf707-f2cb-4427-a5ec-31ecae5c73e4") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78be1337-2cdd-4cad-a905-9294a39e76e2-ca-trust-extracted\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-trusted-ca\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-tmp-dir\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/906bf707-f2cb-4427-a5ec-31ecae5c73e4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzkl4\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-kube-api-access-pzkl4\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7522-42d5-41a3-aa9d-6902aa7db748-tmp\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dfa7522-42d5-41a3-aa9d-6902aa7db748-serving-cert\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-bound-sa-token\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.900843    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfa7522-42d5-41a3-aa9d-6902aa7db748-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-config-volume\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.900903    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls podName:ae976dd6-1554-48b9-b47e-0cf4c16aa1fb nodeName:}" failed. No retries permitted until 2026-07-15 18:17:32.400886489 +0000 UTC m=+37.608149769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls") pod "dns-default-x5ssz" (UID: "ae976dd6-1554-48b9-b47e-0cf4c16aa1fb") : secret "dns-default-metrics-tls" not found
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-image-registry-private-configuration\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.900994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-certificates\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-stats-auth\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-installation-pull-secrets\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-default-certificate\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rzw\" (UniqueName: \"kubernetes.io/projected/1ee39a41-b482-41df-bf00-531086353273-kube-api-access-d8rzw\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfa7522-42d5-41a3-aa9d-6902aa7db748-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7522-42d5-41a3-aa9d-6902aa7db748-snapshots\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.901335    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:32.401320469 +0000 UTC m=+37.608583751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : configmap references non-existent config key: service-ca.crt
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.901400    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.901459    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:32.401444844 +0000 UTC m=+37.608708106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : secret "router-metrics-certs-default" not found
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-config-volume\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-trusted-ca\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/906bf707-f2cb-4427-a5ec-31ecae5c73e4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.901802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-tmp-dir\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.902614 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.901783    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:17:31.902614 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.901801    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848dbd79f-tvt7g: secret "image-registry-tls" not found
Jul 15 18:17:31.902614 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.901802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfa7522-42d5-41a3-aa9d-6902aa7db748-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.902614 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:31.901858    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls podName:78be1337-2cdd-4cad-a905-9294a39e76e2 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:32.401840912 +0000 UTC m=+37.609104173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls") pod "image-registry-848dbd79f-tvt7g" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2") : secret "image-registry-tls" not found
Jul 15 18:17:31.902614 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.902491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfa7522-42d5-41a3-aa9d-6902aa7db748-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.906188 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.906100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dfa7522-42d5-41a3-aa9d-6902aa7db748-serving-cert\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.906188 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.906119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-image-registry-private-configuration\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.906188 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.906136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-default-certificate\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.906188 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.906164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8baba4c0-1b57-495f-8d85-ed87c1299bcd-cert\") pod \"ingress-canary-nmh4k\" (UID: \"8baba4c0-1b57-495f-8d85-ed87c1299bcd\") " pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:31.906188 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.906177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-stats-auth\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.906769 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.906747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-installation-pull-secrets\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.909561 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.909511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb2wp\" (UniqueName: \"kubernetes.io/projected/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-kube-api-access-vb2wp\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:31.909749 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.909730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8ct\" (UniqueName: \"kubernetes.io/projected/906bf707-f2cb-4427-a5ec-31ecae5c73e4-kube-api-access-8d8ct\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:31.910630 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.910568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-bound-sa-token\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.911001 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.910948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzkl4\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-kube-api-access-pzkl4\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:31.911199 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.911173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcwv\" (UniqueName: \"kubernetes.io/projected/8baba4c0-1b57-495f-8d85-ed87c1299bcd-kube-api-access-7kcwv\") pod \"ingress-canary-nmh4k\" (UID: \"8baba4c0-1b57-495f-8d85-ed87c1299bcd\") " pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:31.911551 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.911532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rzw\" (UniqueName: \"kubernetes.io/projected/1ee39a41-b482-41df-bf00-531086353273-kube-api-access-d8rzw\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:31.912293 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.912270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gws56\" (UniqueName: \"kubernetes.io/projected/3dfa7522-42d5-41a3-aa9d-6902aa7db748-kube-api-access-gws56\") pod \"insights-operator-68d9dd94cf-7fzfw\" (UID: \"3dfa7522-42d5-41a3-aa9d-6902aa7db748\") " pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.964532 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.964486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw"
Jul 15 18:17:31.976728 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:31.976704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmh4k"
Jul 15 18:17:32.370954 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.370921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:17:32.371129 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.370921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:17:32.373668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.373645    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 18:17:32.374683 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.374661    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7m6p\""
Jul 15 18:17:32.374790 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.374718    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 18:17:32.374790 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.374730    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:17:32.374790 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.374739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rzhtl\""
Jul 15 18:17:32.404919 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.404898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:32.405059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.404956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:32.405122 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405070    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:17:32.405122 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.405084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:32.405218 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405129    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls podName:ae976dd6-1554-48b9-b47e-0cf4c16aa1fb nodeName:}" failed. No retries permitted until 2026-07-15 18:17:33.405111171 +0000 UTC m=+38.612374437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls") pod "dns-default-x5ssz" (UID: "ae976dd6-1554-48b9-b47e-0cf4c16aa1fb") : secret "dns-default-metrics-tls" not found
Jul 15 18:17:32.405218 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405156    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:32.405218 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405173    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:17:32.405218 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405187    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848dbd79f-tvt7g: secret "image-registry-tls" not found
Jul 15 18:17:32.405407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.405213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:32.405407 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405230    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls podName:78be1337-2cdd-4cad-a905-9294a39e76e2 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:33.405215297 +0000 UTC m=+38.612478562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls") pod "image-registry-848dbd79f-tvt7g" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2") : secret "image-registry-tls" not found
Jul 15 18:17:32.405407 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405251    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls podName:906bf707-f2cb-4427-a5ec-31ecae5c73e4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:33.405240942 +0000 UTC m=+38.612504206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hd2k" (UID: "906bf707-f2cb-4427-a5ec-31ecae5c73e4") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:32.405407 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405258    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:17:32.405407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:32.405289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:32.405407 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405299    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:33.405284836 +0000 UTC m=+38.612548102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : secret "router-metrics-certs-default" not found
Jul 15 18:17:32.405407 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:32.405355    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:33.405345376 +0000 UTC m=+38.612608643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : configmap references non-existent config key: service-ca.crt
Jul 15 18:17:33.372033 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.371991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:17:33.375101 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.375074    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.414900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.414941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.414999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.415062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.415125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415279    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415340    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls podName:ae976dd6-1554-48b9-b47e-0cf4c16aa1fb nodeName:}" failed. No retries permitted until 2026-07-15 18:17:35.415322469 +0000 UTC m=+40.622585734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls") pod "dns-default-x5ssz" (UID: "ae976dd6-1554-48b9-b47e-0cf4c16aa1fb") : secret "dns-default-metrics-tls" not found
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415837    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415857    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415878    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848dbd79f-tvt7g: secret "image-registry-tls" not found
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415889    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:35.41587308 +0000 UTC m=+40.623136342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : secret "router-metrics-certs-default" not found
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415931    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls podName:78be1337-2cdd-4cad-a905-9294a39e76e2 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:35.415913813 +0000 UTC m=+40.623177096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls") pod "image-registry-848dbd79f-tvt7g" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2") : secret "image-registry-tls" not found
Jul 15 18:17:33.415982 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.415957    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:35.415946622 +0000 UTC m=+40.623209883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : configmap references non-existent config key: service-ca.crt
Jul 15 18:17:33.416775 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.416008    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:33.416775 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:33.416044    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls podName:906bf707-f2cb-4427-a5ec-31ecae5c73e4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:35.416032106 +0000 UTC m=+40.623295374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hd2k" (UID: "906bf707-f2cb-4427-a5ec-31ecae5c73e4") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:33.482711 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.482549    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7fzfw"]
Jul 15 18:17:33.486535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.486517    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmh4k"]
Jul 15 18:17:33.487579 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:17:33.487561    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfa7522_42d5_41a3_aa9d_6902aa7db748.slice/crio-952b21d485267755bf3bd116bf88d026ae48cc6a465569184ed2e15cc50318f2 WatchSource:0}: Error finding container 952b21d485267755bf3bd116bf88d026ae48cc6a465569184ed2e15cc50318f2: Status 404 returned error can't find the container with id 952b21d485267755bf3bd116bf88d026ae48cc6a465569184ed2e15cc50318f2
Jul 15 18:17:33.490875 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:17:33.490845    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8baba4c0_1b57_495f_8d85_ed87c1299bcd.slice/crio-7dac2b1f9316d4ae3ecbe3ca8f64badf916d2093a1dbab0e8af86742be1443b2 WatchSource:0}: Error finding container 7dac2b1f9316d4ae3ecbe3ca8f64badf916d2093a1dbab0e8af86742be1443b2: Status 404 returned error can't find the container with id 7dac2b1f9316d4ae3ecbe3ca8f64badf916d2093a1dbab0e8af86742be1443b2
Jul 15 18:17:33.632659 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.632622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmh4k" event={"ID":"8baba4c0-1b57-495f-8d85-ed87c1299bcd","Type":"ContainerStarted","Data":"7dac2b1f9316d4ae3ecbe3ca8f64badf916d2093a1dbab0e8af86742be1443b2"}
Jul 15 18:17:33.633640 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.633615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw" event={"ID":"3dfa7522-42d5-41a3-aa9d-6902aa7db748","Type":"ContainerStarted","Data":"952b21d485267755bf3bd116bf88d026ae48cc6a465569184ed2e15cc50318f2"}
Jul 15 18:17:33.635913 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.635892    2563 generic.go:356] "Generic (PLEG): container finished" podID="30120d8d-84a9-40ea-b346-a5327afb5299" containerID="f93349e1ce7ebaaf3e99875bf22275af42f53156a0464b8a7e2333b46858c874" exitCode=0
Jul 15 18:17:33.635991 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:33.635930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerDied","Data":"f93349e1ce7ebaaf3e99875bf22275af42f53156a0464b8a7e2333b46858c874"}
Jul 15 18:17:34.645027 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:34.644932    2563 generic.go:356] "Generic (PLEG): container finished" podID="30120d8d-84a9-40ea-b346-a5327afb5299" containerID="5b90f216f0665f33c8050aa6cfef99147feeb98b3f6d12536c40e63edc55edac" exitCode=0
Jul 15 18:17:34.645027 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:34.644993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerDied","Data":"5b90f216f0665f33c8050aa6cfef99147feeb98b3f6d12536c40e63edc55edac"}
Jul 15 18:17:34.784805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:34.784723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:34.867389 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:34.867348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:35.379151 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.379122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:35.439722 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.439660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:35.447862 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.447830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:35.448024 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.447874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:35.448024 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.447915    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:35.448024 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.447975    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:17:35.448024 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.447989    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848dbd79f-tvt7g: secret "image-registry-tls" not found
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448043    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls podName:78be1337-2cdd-4cad-a905-9294a39e76e2 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.44802599 +0000 UTC m=+44.655289264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls") pod "image-registry-848dbd79f-tvt7g" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2") : secret "image-registry-tls" not found
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448049    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.448065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448100    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.448085081 +0000 UTC m=+44.655348342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : secret "router-metrics-certs-default" not found
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.448109906 +0000 UTC m=+44.655373172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : configmap references non-existent config key: service-ca.crt
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448149    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.448168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448189    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls podName:906bf707-f2cb-4427-a5ec-31ecae5c73e4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.448177563 +0000 UTC m=+44.655440834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hd2k" (UID: "906bf707-f2cb-4427-a5ec-31ecae5c73e4") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:35.448222 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448228    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:17:35.448633 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:35.448262    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls podName:ae976dd6-1554-48b9-b47e-0cf4c16aa1fb nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.448252699 +0000 UTC m=+44.655515963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls") pod "dns-default-x5ssz" (UID: "ae976dd6-1554-48b9-b47e-0cf4c16aa1fb") : secret "dns-default-metrics-tls" not found
Jul 15 18:17:35.653156 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.653072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" event={"ID":"30120d8d-84a9-40ea-b346-a5327afb5299","Type":"ContainerStarted","Data":"968347c01cd198bc6aa504f7fe01d5cb792fd13d9ffc9c271af31ba320269642"}
Jul 15 18:17:35.681883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.681822    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lzxlr" podStartSLOduration=9.053655732 podStartE2EDuration="40.681801115s" totalImagesPullingTime="31.628145383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:35.67992618 +0000 UTC m=+40.887189465" watchObservedRunningTime="2026-07-15 18:17:35.681801115 +0000 UTC m=+40.889064398"
Jul 15 18:17:35.807738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.807699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:35.866962 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:35.866930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:37.658846 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:37.658810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw" event={"ID":"3dfa7522-42d5-41a3-aa9d-6902aa7db748","Type":"ContainerStarted","Data":"bd6bf32d32451057852fcc1a350cf5176e3ddd7c8bf32f7a248e53f0fc48462d"}
Jul 15 18:17:37.660295 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:37.660268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmh4k" event={"ID":"8baba4c0-1b57-495f-8d85-ed87c1299bcd","Type":"ContainerStarted","Data":"9003bc9e4611effa2c55468372eaff013f63bf4b6a73c0f385356276a76c4cd7"}
Jul 15 18:17:37.675202 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:37.675156    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw" podStartSLOduration=10.110492043 podStartE2EDuration="13.675139979s" totalImagesPullingTime="3.564647936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:37.67468716 +0000 UTC m=+42.881950444" watchObservedRunningTime="2026-07-15 18:17:37.675139979 +0000 UTC m=+42.882403262"
Jul 15 18:17:37.689999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:37.689962    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nmh4k" podStartSLOduration=3.121478986 podStartE2EDuration="6.689948047s" totalImagesPullingTime="3.568469061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:37.689165594 +0000 UTC m=+42.896429084" watchObservedRunningTime="2026-07-15 18:17:37.689948047 +0000 UTC m=+42.897211330"
Jul 15 18:17:38.344121 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.344094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:38.444686 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.444659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:38.562207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.562176    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9nr7b"]
Jul 15 18:17:38.575471 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.575442    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nr7b"]
Jul 15 18:17:38.575616 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.575551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.578023 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.578004    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 18:17:38.578141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.578110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bvrpn\""
Jul 15 18:17:38.578202 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.578109    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 18:17:38.585021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.585002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:38.642097 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.642028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:38.674744 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.674713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-crio-socket\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.675105 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.674827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-data-volume\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.675105 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.674845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ldpd\" (UniqueName: \"kubernetes.io/projected/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-api-access-2ldpd\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.675105 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.674895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.675105 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.674930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.775387 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.775349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.775602 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.775404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-crio-socket\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.775602 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:38.775497    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:17:38.775602 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:38.775579    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.275558976 +0000 UTC m=+44.482822250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : configmap "kube-rbac-proxy" not found
Jul 15 18:17:38.775775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.775634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-crio-socket\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.775775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.775719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-data-volume\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.775775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.775749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ldpd\" (UniqueName: \"kubernetes.io/projected/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-api-access-2ldpd\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.775923 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.775865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.775975 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:38.775943    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:38.776024 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:38.775985    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.275968948 +0000 UTC m=+44.483232209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:38.776118 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.776099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-data-volume\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:38.786268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:38.786246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ldpd\" (UniqueName: \"kubernetes.io/projected/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-api-access-2ldpd\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:39.279931 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.279898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:39.280076 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.279946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:39.280076 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.280017    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:17:39.280076 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.280049    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:39.280076 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.280075    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:40.280057405 +0000 UTC m=+45.487320669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : configmap "kube-rbac-proxy" not found
Jul 15 18:17:39.280218 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.280106    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:40.280092392 +0000 UTC m=+45.487355653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:39.372898 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.372851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:39.473201 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.473166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:39.481691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.481670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:39.481818 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.481718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:39.481818 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.481757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:39.481929 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481819    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:47.481802715 +0000 UTC m=+52.689065976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : configmap references non-existent config key: service-ca.crt
Jul 15 18:17:39.481929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.481848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:39.481929 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481863    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:17:39.481929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:39.481871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:39.481929 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481872    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:39.481929 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481907    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls podName:ae976dd6-1554-48b9-b47e-0cf4c16aa1fb nodeName:}" failed. No retries permitted until 2026-07-15 18:17:47.481894148 +0000 UTC m=+52.689157412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls") pod "dns-default-x5ssz" (UID: "ae976dd6-1554-48b9-b47e-0cf4c16aa1fb") : secret "dns-default-metrics-tls" not found
Jul 15 18:17:39.481929 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481928    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls podName:906bf707-f2cb-4427-a5ec-31ecae5c73e4 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:47.481920926 +0000 UTC m=+52.689184187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hd2k" (UID: "906bf707-f2cb-4427-a5ec-31ecae5c73e4") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:39.482173 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481932    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:17:39.482173 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481946    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:17:39.482173 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481949    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848dbd79f-tvt7g: secret "image-registry-tls" not found
Jul 15 18:17:39.482173 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.481978    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:47.481969184 +0000 UTC m=+52.689232448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : secret "router-metrics-certs-default" not found
Jul 15 18:17:39.482173 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:39.482057    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls podName:78be1337-2cdd-4cad-a905-9294a39e76e2 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:47.482029431 +0000 UTC m=+52.689292697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls") pod "image-registry-848dbd79f-tvt7g" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2") : secret "image-registry-tls" not found
Jul 15 18:17:40.288817 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:40.288783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:40.289224 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:40.288834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:40.289224 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:40.288938    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:40.289224 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:40.288958    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:17:40.289224 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:40.289001    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:42.288988021 +0000 UTC m=+47.496251282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : configmap "kube-rbac-proxy" not found
Jul 15 18:17:40.289224 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:40.289018    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:42.289009555 +0000 UTC m=+47.496272819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:40.438768 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:40.438741    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gppmk_705b5981-93d7-4af4-bbcd-5be67cefd26a/dns-node-resolver/0.log"
Jul 15 18:17:40.635238 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:40.635211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:40.697057 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:40.697028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.037441 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.037346    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slsgg_8734cf12-bfe6-438e-865c-49b06f669d2b/node-ca/0.log"
Jul 15 18:17:41.076970 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.076942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.130905 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.130872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.343328 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.343296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.443682 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.443653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.651880 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.651779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.720959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.720908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.779735 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.779685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:41.838040 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:41.838022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmh4k_8baba4c0-1b57-495f-8d85-ed87c1299bcd/serve-healthcheck-canary/0.log"
Jul 15 18:17:42.305704 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.305670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:42.305869 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.305722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:42.305869 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:42.305827    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:42.305957 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:42.305888    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:46.305873979 +0000 UTC m=+51.513137244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:42.305957 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:42.305827    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:17:42.305957 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:42.305955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:46.305944872 +0000 UTC m=+51.513208135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : configmap "kube-rbac-proxy" not found
Jul 15 18:17:42.972081 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.972052    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8qstg"]
Jul 15 18:17:42.993814 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.993783    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8qstg"]
Jul 15 18:17:42.993959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.993876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:42.996479 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.996460    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 18:17:42.997444 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.997409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6dfd6\""
Jul 15 18:17:42.997542 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.997481    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 18:17:42.997542 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.997497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 18:17:42.997644 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:42.997542    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 18:17:43.005775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.005755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:43.012115 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.012093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zr9v\" (UniqueName: \"kubernetes.io/projected/9e433866-c85d-4e94-918e-9ea2f3a1cbed-kube-api-access-9zr9v\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.012224 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.012200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e433866-c85d-4e94-918e-9ea2f3a1cbed-signing-cabundle\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.012284 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.012233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e433866-c85d-4e94-918e-9ea2f3a1cbed-signing-key\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.061214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.061183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:43.112695 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.112652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e433866-c85d-4e94-918e-9ea2f3a1cbed-signing-cabundle\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.112883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.112717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e433866-c85d-4e94-918e-9ea2f3a1cbed-signing-key\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.112883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.112779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr9v\" (UniqueName: \"kubernetes.io/projected/9e433866-c85d-4e94-918e-9ea2f3a1cbed-kube-api-access-9zr9v\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.113324 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.113299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e433866-c85d-4e94-918e-9ea2f3a1cbed-signing-cabundle\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.115210 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.115186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e433866-c85d-4e94-918e-9ea2f3a1cbed-signing-key\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.121134 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.121109    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zr9v\" (UniqueName: \"kubernetes.io/projected/9e433866-c85d-4e94-918e-9ea2f3a1cbed-kube-api-access-9zr9v\") pod \"service-ca-79f68b9f4f-8qstg\" (UID: \"9e433866-c85d-4e94-918e-9ea2f3a1cbed\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.303016 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.302986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg"
Jul 15 18:17:43.445373 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.445343    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8qstg"]
Jul 15 18:17:43.449259 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:17:43.449232    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e433866_c85d_4e94_918e_9ea2f3a1cbed.slice/crio-ec8191358890497dba6d6b9cc37c45b532e24f9af0e32a91ba759ac3ac0f8993 WatchSource:0}: Error finding container ec8191358890497dba6d6b9cc37c45b532e24f9af0e32a91ba759ac3ac0f8993: Status 404 returned error can't find the container with id ec8191358890497dba6d6b9cc37c45b532e24f9af0e32a91ba759ac3ac0f8993
Jul 15 18:17:43.678009 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.677927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg" event={"ID":"9e433866-c85d-4e94-918e-9ea2f3a1cbed","Type":"ContainerStarted","Data":"ec8191358890497dba6d6b9cc37c45b532e24f9af0e32a91ba759ac3ac0f8993"}
Jul 15 18:17:43.881869 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:43.881836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:46.341782 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:46.341751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:46.342252 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:46.341808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:46.342252 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:46.341906    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:46.342252 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:46.341980    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:17:46.342252 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:46.341988    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:54.341966884 +0000 UTC m=+59.549230237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:17:46.342252 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:46.342055    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm podName:ac81d8a2-2a17-4c71-894e-ce7dc9cd8752 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:54.342037223 +0000 UTC m=+59.549300497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nr7b" (UID: "ac81d8a2-2a17-4c71-894e-ce7dc9cd8752") : configmap "kube-rbac-proxy" not found
Jul 15 18:17:46.948196 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:46.948095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.050874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.050836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.243050 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.242955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.394281 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.394224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.529059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.528967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.550762 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.550733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:17:47.550999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.550809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:17:47.550999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.550829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:47.550999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.550855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:17:47.550999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.550893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:17:47.550999 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.550995    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:47.551241 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551056    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls podName:906bf707-f2cb-4427-a5ec-31ecae5c73e4 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:03.551043608 +0000 UTC m=+68.758306869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hd2k" (UID: "906bf707-f2cb-4427-a5ec-31ecae5c73e4") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:17:47.551415 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551396    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:17:47.551556 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551476    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls podName:ae976dd6-1554-48b9-b47e-0cf4c16aa1fb nodeName:}" failed. No retries permitted until 2026-07-15 18:18:03.551460368 +0000 UTC m=+68.758723634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls") pod "dns-default-x5ssz" (UID: "ae976dd6-1554-48b9-b47e-0cf4c16aa1fb") : secret "dns-default-metrics-tls" not found
Jul 15 18:17:47.551556 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551413    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:17:47.551556 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551525    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:03.551507448 +0000 UTC m=+68.758770714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : configmap references non-existent config key: service-ca.crt
Jul 15 18:17:47.551556 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551553    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs podName:1ee39a41-b482-41df-bf00-531086353273 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:03.551542428 +0000 UTC m=+68.758805693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs") pod "router-default-747c86b468-tkw4q" (UID: "1ee39a41-b482-41df-bf00-531086353273") : secret "router-metrics-certs-default" not found
Jul 15 18:17:47.551767 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551611    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:17:47.551767 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551623    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848dbd79f-tvt7g: secret "image-registry-tls" not found
Jul 15 18:17:47.551767 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:17:47.551671    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls podName:78be1337-2cdd-4cad-a905-9294a39e76e2 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:03.551658994 +0000 UTC m=+68.758922258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls") pod "image-registry-848dbd79f-tvt7g" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2") : secret "image-registry-tls" not found
Jul 15 18:17:47.630113 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.630077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.690393 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.690358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg" event={"ID":"9e433866-c85d-4e94-918e-9ea2f3a1cbed","Type":"ContainerStarted","Data":"9e8ceec0f9a33fff4efc2932c9bf5c7410d9a1f74225382984d939288f34a8e2"}
Jul 15 18:17:47.708854 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.708799    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-8qstg" podStartSLOduration=2.514277464 podStartE2EDuration="5.708783845s" totalImagesPullingTime="3.194506381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:47.708247277 +0000 UTC m=+52.915510557" watchObservedRunningTime="2026-07-15 18:17:47.708783845 +0000 UTC m=+52.916047127"
Jul 15 18:17:47.713161 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.713133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.867772 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.867738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:47.931395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:47.931354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:48.089709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:48.089672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:48.191094 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:48.191008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:49.100364 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:49.100328    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:49.291722 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:49.291691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:49.692604 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:49.692564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:49.891412 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:49.891380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:50.293898 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:50.293870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:51.091375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:51.091347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:51.145010 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:51.144968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:51.289824 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:51.289791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:51.686394 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:51.686364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:51.883676 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:51.883637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:51.939164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:51.939077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:52.288340 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:52.288256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:52.893544 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:52.893512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:52.992732 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:52.992699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:53.048524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:53.048490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:53.489445 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:53.489398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:53.590541 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:53.590513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:53.693351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:53.693323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:54.089532 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.089500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:54.286999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.286968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:54.414484 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.414377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:54.414484 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.414443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:54.414951 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.414923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:54.416726 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.416705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac81d8a2-2a17-4c71-894e-ce7dc9cd8752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nr7b\" (UID: \"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752\") " pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:54.484938 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.484904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nr7b"
Jul 15 18:17:54.613524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.613494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nr7b"]
Jul 15 18:17:54.707531 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:54.707452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nr7b" event={"ID":"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752","Type":"ContainerStarted","Data":"c42b0d95666af92d85ab1f334c92e9c762e1f34eee0943b11581d193d6ade932"}
Jul 15 18:17:55.459146 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:55.459107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:55.514699 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:55.514659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:55.620152 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:55.620121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:55.892352 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:55.892281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:56.087322 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:56.087292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:56.293610 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:56.293498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:56.624702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:56.624671    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcsfh"
Jul 15 18:17:56.689620 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:56.689588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:57.291680 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:57.291649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:57.695691 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:57.695651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:57.888333 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:57.888302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:58.090282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:58.090250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:58.415191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:58.415109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:58.515717 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:58.515684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:58.617080 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:58.617041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:58.718190 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:58.718099    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.091700 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.091665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.165061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.165023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.287773 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.287741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.388813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.388722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.506685 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.506639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.563314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.563275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.902396 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.902353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:17:59.957128 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:17:59.957100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:00.102121 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:00.102068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:00.313510 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:00.313476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:00.726477 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:00.726438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nr7b" event={"ID":"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752","Type":"ContainerStarted","Data":"f5b8f8adc3b4f10288dff342fdea269817357831735eca5453945f9ffc6ad200"}
Jul 15 18:18:01.177095 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.177061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:18:01.177579 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.177120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:18:01.180056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.180033    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:18:01.180167 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.180061    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:18:01.189605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.189584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d-metrics-certs\") pod \"network-metrics-daemon-qpjch\" (UID: \"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d\") " pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:18:01.189788 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.189770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d53a3b94-2590-4925-ba9a-5c729a1e9e27-original-pull-secret\") pod \"global-pull-secret-syncer-9f264\" (UID: \"d53a3b94-2590-4925-ba9a-5c729a1e9e27\") " pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:18:01.278242 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.278205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:18:01.281203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.281172    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 18:18:01.283206 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.283185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f264"
Jul 15 18:18:01.291316 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.291296    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 18:18:01.301807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.301788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68wk2\" (UniqueName: \"kubernetes.io/projected/46115be4-26af-4071-83ce-611250fd6cd4-kube-api-access-68wk2\") pod \"network-check-target-mkfsd\" (UID: \"46115be4-26af-4071-83ce-611250fd6cd4\") " pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:18:01.408651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.408621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9f264"]
Jul 15 18:18:01.485643 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.485565    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rzhtl\""
Jul 15 18:18:01.490292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.490271    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7m6p\""
Jul 15 18:18:01.493605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.493585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpjch"
Jul 15 18:18:01.498771 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.498735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:18:01.720275 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.720239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:01.821575 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.821538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:01.945702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:01.945667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:02.005027 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:02.004991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:02.591235 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:02.591207    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53a3b94_2590_4925_ba9a_5c729a1e9e27.slice/crio-44d19d698641e14b8621e0ae979f94e77294b02fbb925884c1e7b1c1c4c76bd7 WatchSource:0}: Error finding container 44d19d698641e14b8621e0ae979f94e77294b02fbb925884c1e7b1c1c4c76bd7: Status 404 returned error can't find the container with id 44d19d698641e14b8621e0ae979f94e77294b02fbb925884c1e7b1c1c4c76bd7
Jul 15 18:18:02.639601 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:02.639565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:02.734458 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:02.734407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9f264" event={"ID":"d53a3b94-2590-4925-ba9a-5c729a1e9e27","Type":"ContainerStarted","Data":"44d19d698641e14b8621e0ae979f94e77294b02fbb925884c1e7b1c1c4c76bd7"}
Jul 15 18:18:02.740282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:02.740251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:03.345494 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.345292    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"]
Jul 15 18:18:03.348786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.348761    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"]
Jul 15 18:18:03.348917 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.348882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"
Jul 15 18:18:03.354778 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.354755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p9wj9\""
Jul 15 18:18:03.355191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.355173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.359096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.359075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 18:18:03.359651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.359416    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 18:18:03.359651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.359564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 18:18:03.360072 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.360044    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 18:18:03.371711 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.371660    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"]
Jul 15 18:18:03.378580 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.378558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"]
Jul 15 18:18:03.392102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.392084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:03.394460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.394387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qpjch"]
Jul 15 18:18:03.395541 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.395523    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mkfsd"]
Jul 15 18:18:03.397574 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:03.397550    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8ab412_0f60_48f6_8e5a_0ce7a509dd9d.slice/crio-5053b1b17b158a06323a1df3f802db9a20448f16137debcb2c5a3d3c71bd2b60 WatchSource:0}: Error finding container 5053b1b17b158a06323a1df3f802db9a20448f16137debcb2c5a3d3c71bd2b60: Status 404 returned error can't find the container with id 5053b1b17b158a06323a1df3f802db9a20448f16137debcb2c5a3d3c71bd2b60
Jul 15 18:18:03.399707 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:03.399684    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46115be4_26af_4071_83ce_611250fd6cd4.slice/crio-5f48ae29cf24be0b0408e59f3506923bc8d57d6a67e08fabd9d81fceab83cf34 WatchSource:0}: Error finding container 5f48ae29cf24be0b0408e59f3506923bc8d57d6a67e08fabd9d81fceab83cf34: Status 404 returned error can't find the container with id 5f48ae29cf24be0b0408e59f3506923bc8d57d6a67e08fabd9d81fceab83cf34
Jul 15 18:18:03.443241 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.443213    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-nxvwr"]
Jul 15 18:18:03.447167 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.447147    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-nxvwr"
Jul 15 18:18:03.449479 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.449457    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 18:18:03.449549 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.449510    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 18:18:03.449861 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.449846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hdv6x\""
Jul 15 18:18:03.464306 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.464275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-nxvwr"]
Jul 15 18:18:03.498279 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.498196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkqgx\" (UniqueName: \"kubernetes.io/projected/89e238d8-ba8a-4bf3-a481-9e9594cadb5d-kube-api-access-wkqgx\") pod \"network-check-source-869dcfcdcd-b44fh\" (UID: \"89e238d8-ba8a-4bf3-a481-9e9594cadb5d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"
Jul 15 18:18:03.498402 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.498316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19f56811-f95c-48d7-ace3-d38c48f81e0f-tmp\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.498402 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.498351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/19f56811-f95c-48d7-ace3-d38c48f81e0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.498402 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.498391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8mwn\" (UniqueName: \"kubernetes.io/projected/19f56811-f95c-48d7-ace3-d38c48f81e0f-kube-api-access-g8mwn\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.502042 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.502014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:03.593029 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.592986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:03.599256 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:18:03.599401 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:18:03.599401 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:03.599401 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19f56811-f95c-48d7-ace3-d38c48f81e0f-tmp\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.599401 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/19f56811-f95c-48d7-ace3-d38c48f81e0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.599637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:03.599637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8mwn\" (UniqueName: \"kubernetes.io/projected/19f56811-f95c-48d7-ace3-d38c48f81e0f-kube-api-access-g8mwn\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.599637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:18:03.599637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlzz\" (UniqueName: \"kubernetes.io/projected/f411633c-6b26-4345-bd15-3a70f9a3c7e1-kube-api-access-phlzz\") pod \"downloads-68c9cbb497-nxvwr\" (UID: \"f411633c-6b26-4345-bd15-3a70f9a3c7e1\") " pod="openshift-console/downloads-68c9cbb497-nxvwr"
Jul 15 18:18:03.599637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkqgx\" (UniqueName: \"kubernetes.io/projected/89e238d8-ba8a-4bf3-a481-9e9594cadb5d-kube-api-access-wkqgx\") pod \"network-check-source-869dcfcdcd-b44fh\" (UID: \"89e238d8-ba8a-4bf3-a481-9e9594cadb5d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"
Jul 15 18:18:03.599876 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.599789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19f56811-f95c-48d7-ace3-d38c48f81e0f-tmp\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.600259 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.600205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee39a41-b482-41df-bf00-531086353273-service-ca-bundle\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:03.602395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.602370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"image-registry-848dbd79f-tvt7g\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") " pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:18:03.602893 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.602872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee39a41-b482-41df-bf00-531086353273-metrics-certs\") pod \"router-default-747c86b468-tkw4q\" (UID: \"1ee39a41-b482-41df-bf00-531086353273\") " pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:03.602963 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.602895    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/906bf707-f2cb-4427-a5ec-31ecae5c73e4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hd2k\" (UID: \"906bf707-f2cb-4427-a5ec-31ecae5c73e4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:18:03.602963 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.602942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/19f56811-f95c-48d7-ace3-d38c48f81e0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.603148 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.603131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae976dd6-1554-48b9-b47e-0cf4c16aa1fb-metrics-tls\") pod \"dns-default-x5ssz\" (UID: \"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb\") " pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:18:03.610346 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.610300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkqgx\" (UniqueName: \"kubernetes.io/projected/89e238d8-ba8a-4bf3-a481-9e9594cadb5d-kube-api-access-wkqgx\") pod \"network-check-source-869dcfcdcd-b44fh\" (UID: \"89e238d8-ba8a-4bf3-a481-9e9594cadb5d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"
Jul 15 18:18:03.611471 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.611413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8mwn\" (UniqueName: \"kubernetes.io/projected/19f56811-f95c-48d7-ace3-d38c48f81e0f-kube-api-access-g8mwn\") pod \"klusterlet-addon-workmgr-745fcd6859-mhlgn\" (UID: \"19f56811-f95c-48d7-ace3-d38c48f81e0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.669890 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.669857    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"
Jul 15 18:18:03.681190 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.681160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:03.693141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.693113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:03.700772 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.700742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phlzz\" (UniqueName: \"kubernetes.io/projected/f411633c-6b26-4345-bd15-3a70f9a3c7e1-kube-api-access-phlzz\") pod \"downloads-68c9cbb497-nxvwr\" (UID: \"f411633c-6b26-4345-bd15-3a70f9a3c7e1\") " pod="openshift-console/downloads-68c9cbb497-nxvwr"
Jul 15 18:18:03.714945 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.714908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlzz\" (UniqueName: \"kubernetes.io/projected/f411633c-6b26-4345-bd15-3a70f9a3c7e1-kube-api-access-phlzz\") pod \"downloads-68c9cbb497-nxvwr\" (UID: \"f411633c-6b26-4345-bd15-3a70f9a3c7e1\") " pod="openshift-console/downloads-68c9cbb497-nxvwr"
Jul 15 18:18:03.738577 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.738192    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cknmp\""
Jul 15 18:18:03.743235 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.743163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mkfsd" event={"ID":"46115be4-26af-4071-83ce-611250fd6cd4","Type":"ContainerStarted","Data":"5f48ae29cf24be0b0408e59f3506923bc8d57d6a67e08fabd9d81fceab83cf34"}
Jul 15 18:18:03.745939 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.745714    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:18:03.747541 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.747498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nr7b" event={"ID":"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752","Type":"ContainerStarted","Data":"dcb48b750b878dbb8b238c682dbb64c8cd7ae848299f064e24de14d50b6cd3d6"}
Jul 15 18:18:03.748755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.748456    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g88sr\""
Jul 15 18:18:03.749361 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.749312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpjch" event={"ID":"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d","Type":"ContainerStarted","Data":"5053b1b17b158a06323a1df3f802db9a20448f16137debcb2c5a3d3c71bd2b60"}
Jul 15 18:18:03.756475 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.755934    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-nxvwr"
Jul 15 18:18:03.756657 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.756619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"
Jul 15 18:18:03.758578 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.758368    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hpjp\""
Jul 15 18:18:03.768508 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.768362    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:03.773223 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.773005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42x79\""
Jul 15 18:18:03.781597 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.781325    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:18:03.852115 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.852016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"]
Jul 15 18:18:03.874724 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.874597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:03.889255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.889192    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh"]
Jul 15 18:18:03.912881 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:03.911943    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e238d8_ba8a_4bf3_a481_9e9594cadb5d.slice/crio-d3f4b168895f67acb3c90447377381e442ff47b1f68bd500e5033e51539c643c WatchSource:0}: Error finding container d3f4b168895f67acb3c90447377381e442ff47b1f68bd500e5033e51539c643c: Status 404 returned error can't find the container with id d3f4b168895f67acb3c90447377381e442ff47b1f68bd500e5033e51539c643c
Jul 15 18:18:03.944522 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:03.944404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:04.009815 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.009695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-848dbd79f-tvt7g"]
Jul 15 18:18:04.029522 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:04.029491    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf411633c_6b26_4345_bd15_3a70f9a3c7e1.slice/crio-83cb005d69dedaf85a689336b8a46c07a3cb6f30875cb512d4245f7edf0f2422 WatchSource:0}: Error finding container 83cb005d69dedaf85a689336b8a46c07a3cb6f30875cb512d4245f7edf0f2422: Status 404 returned error can't find the container with id 83cb005d69dedaf85a689336b8a46c07a3cb6f30875cb512d4245f7edf0f2422
Jul 15 18:18:04.031146 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.031079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-nxvwr"]
Jul 15 18:18:04.045550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.045468    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x5ssz"]
Jul 15 18:18:04.053182 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:04.053116    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae976dd6_1554_48b9_b47e_0cf4c16aa1fb.slice/crio-0ae1acdfe3b6e536707e9eb1880a4f6bcf53ad66c3aedd8f0c35003127d25813 WatchSource:0}: Error finding container 0ae1acdfe3b6e536707e9eb1880a4f6bcf53ad66c3aedd8f0c35003127d25813: Status 404 returned error can't find the container with id 0ae1acdfe3b6e536707e9eb1880a4f6bcf53ad66c3aedd8f0c35003127d25813
Jul 15 18:18:04.066981 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.066842    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k"]
Jul 15 18:18:04.066981 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.066912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-747c86b468-tkw4q"]
Jul 15 18:18:04.071232 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:04.071186    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906bf707_f2cb_4427_a5ec_31ecae5c73e4.slice/crio-45706d8d597204a8cc040b04b9e6822bb904b7c0b28c95bed72df5780633b0fb WatchSource:0}: Error finding container 45706d8d597204a8cc040b04b9e6822bb904b7c0b28c95bed72df5780633b0fb: Status 404 returned error can't find the container with id 45706d8d597204a8cc040b04b9e6822bb904b7c0b28c95bed72df5780633b0fb
Jul 15 18:18:04.075077 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:04.075046    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee39a41_b482_41df_bf00_531086353273.slice/crio-b16bc73a6512618843e6db5335c8bfc085fccb2e54eb280b77dcaba6c77f773a WatchSource:0}: Error finding container b16bc73a6512618843e6db5335c8bfc085fccb2e54eb280b77dcaba6c77f773a: Status 404 returned error can't find the container with id b16bc73a6512618843e6db5335c8bfc085fccb2e54eb280b77dcaba6c77f773a
Jul 15 18:18:04.767165 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.766237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" event={"ID":"78be1337-2cdd-4cad-a905-9294a39e76e2","Type":"ContainerStarted","Data":"1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8"}
Jul 15 18:18:04.767165 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.766299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" event={"ID":"78be1337-2cdd-4cad-a905-9294a39e76e2","Type":"ContainerStarted","Data":"78380d2673af34d9e44236f5f3295cb02694cd0a72e661f2129cb39d556e7236"}
Jul 15 18:18:04.767165 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.767104    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:18:04.768946 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.768868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn" event={"ID":"19f56811-f95c-48d7-ace3-d38c48f81e0f","Type":"ContainerStarted","Data":"a04324db9ca6770ffc7c5f3c8f143814f7f8c269512a6379ea002e4d6043f97f"}
Jul 15 18:18:04.773548 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.772989    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-747c86b468-tkw4q" event={"ID":"1ee39a41-b482-41df-bf00-531086353273","Type":"ContainerStarted","Data":"dad1f4f95108fc03b64fddc9ea3c1c72a77ed369ceb4722117c7c6e85b2d428a"}
Jul 15 18:18:04.773548 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.773033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-747c86b468-tkw4q" event={"ID":"1ee39a41-b482-41df-bf00-531086353273","Type":"ContainerStarted","Data":"b16bc73a6512618843e6db5335c8bfc085fccb2e54eb280b77dcaba6c77f773a"}
Jul 15 18:18:04.775808 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.775740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x5ssz" event={"ID":"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb","Type":"ContainerStarted","Data":"0ae1acdfe3b6e536707e9eb1880a4f6bcf53ad66c3aedd8f0c35003127d25813"}
Jul 15 18:18:04.777212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.777141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k" event={"ID":"906bf707-f2cb-4427-a5ec-31ecae5c73e4","Type":"ContainerStarted","Data":"45706d8d597204a8cc040b04b9e6822bb904b7c0b28c95bed72df5780633b0fb"}
Jul 15 18:18:04.779760 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.779686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-nxvwr" event={"ID":"f411633c-6b26-4345-bd15-3a70f9a3c7e1","Type":"ContainerStarted","Data":"83cb005d69dedaf85a689336b8a46c07a3cb6f30875cb512d4245f7edf0f2422"}
Jul 15 18:18:04.781333 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.781312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh" event={"ID":"89e238d8-ba8a-4bf3-a481-9e9594cadb5d","Type":"ContainerStarted","Data":"d3f4b168895f67acb3c90447377381e442ff47b1f68bd500e5033e51539c643c"}
Jul 15 18:18:04.812801 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.811895    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" podStartSLOduration=69.811873296 podStartE2EDuration="1m9.811873296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:04.810612996 +0000 UTC m=+70.017876283" watchObservedRunningTime="2026-07-15 18:18:04.811873296 +0000 UTC m=+70.019136581"
Jul 15 18:18:04.830451 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:04.830337    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-747c86b468-tkw4q" podStartSLOduration=40.83031627 podStartE2EDuration="40.83031627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:04.828667886 +0000 UTC m=+70.035931170" watchObservedRunningTime="2026-07-15 18:18:04.83031627 +0000 UTC m=+70.037579555"
Jul 15 18:18:05.770552 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:05.769317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:05.773486 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:05.773287    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:05.799106 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:05.798913    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:05.800582 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:05.800390    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-747c86b468-tkw4q"
Jul 15 18:18:06.813451 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:06.812884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpjch" event={"ID":"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d","Type":"ContainerStarted","Data":"3e03a1addf585abab9c14f7a2741dfe08e6572bb19ecf04b06f39c95217ec254"}
Jul 15 18:18:06.813451 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:06.812940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpjch" event={"ID":"5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d","Type":"ContainerStarted","Data":"e01163edda408813cc734c0892f3a53876a56c6f3ae01608901b3cf4ea495879"}
Jul 15 18:18:06.951061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:06.950997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:07.051318 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:07.051244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:08.872801 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:08.872770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:08.931806 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:08.931758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:12.341185 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:12.341144    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:12.442842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:12.442810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:12.543341 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:12.543306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:12.644016 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:12.643880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:15.530866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:15.530830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:15.631141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:15.631106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.298636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.298561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.396763 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.396673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.470234 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.470202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.636771 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.636735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.737662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.737579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.839112 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.839077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.863005 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.862971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn" event={"ID":"19f56811-f95c-48d7-ace3-d38c48f81e0f","Type":"ContainerStarted","Data":"944ec4ed67261fad1e936145881a97369b30cf67425df3686e60d5b3328acfc1"}
Jul 15 18:18:16.863174 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.863159    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:16.864794 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.864762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mkfsd" event={"ID":"46115be4-26af-4071-83ce-611250fd6cd4","Type":"ContainerStarted","Data":"42781adf3df0b19eed5c01b6ca7745b893d348af2e897c39a8339dfbe652a01a"}
Jul 15 18:18:16.864916 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.864852    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:18:16.865248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.865221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn"
Jul 15 18:18:16.866853 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.866827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nr7b" event={"ID":"ac81d8a2-2a17-4c71-894e-ce7dc9cd8752","Type":"ContainerStarted","Data":"9d93a9e75b98923e94be91867201aefd5dd92e7b8e0a44e5d28d748a2725c0e2"}
Jul 15 18:18:16.868296 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.868276    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9f264" event={"ID":"d53a3b94-2590-4925-ba9a-5c729a1e9e27","Type":"ContainerStarted","Data":"156339b7971925ee14860dd59c0f4bcf8fa7951605a24545b5bf085acc668080"}
Jul 15 18:18:16.869923 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.869899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x5ssz" event={"ID":"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb","Type":"ContainerStarted","Data":"75abb6643b922305d6cc0895d2536186132029202b51abedc4dfabe1840d0046"}
Jul 15 18:18:16.870028 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.869945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x5ssz" event={"ID":"ae976dd6-1554-48b9-b47e-0cf4c16aa1fb","Type":"ContainerStarted","Data":"df83c15980fe51e0e6e79ca1228e0e06d621a8fc2d5c125f43895d6ec95dbfaa"}
Jul 15 18:18:16.870028 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.869988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:18:16.871439 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.871409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k" event={"ID":"906bf707-f2cb-4427-a5ec-31ecae5c73e4","Type":"ContainerStarted","Data":"18ac6a93fc8b99131423feb1f51756aceecde65964c0d3c3fdcc64367cdc6526"}
Jul 15 18:18:16.872806 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.872789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh" event={"ID":"89e238d8-ba8a-4bf3-a481-9e9594cadb5d","Type":"ContainerStarted","Data":"1004f20e9862c136cbeb13fb90935ca8c983721d8566955c5d5d95d87433f73c"}
Jul 15 18:18:16.880962 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.880917    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qpjch" podStartSLOduration=79.746170179 podStartE2EDuration="1m21.880900905s" totalImagesPullingTime="2.134730726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:06.831322066 +0000 UTC m=+72.038585351" watchObservedRunningTime="2026-07-15 18:18:16.880900905 +0000 UTC m=+82.088164189"
Jul 15 18:18:16.881939 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.881902    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-745fcd6859-mhlgn" podStartSLOduration=1.887242982 podStartE2EDuration="13.881892945s" totalImagesPullingTime="11.994649963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.879699769 +0000 UTC m=+82.086963052" watchObservedRunningTime="2026-07-15 18:18:16.881892945 +0000 UTC m=+82.089156230"
Jul 15 18:18:16.895805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.895753    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hd2k" podStartSLOduration=41.106575568 podStartE2EDuration="52.89573936s" totalImagesPullingTime="11.789163792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.89525947 +0000 UTC m=+82.102522754" watchObservedRunningTime="2026-07-15 18:18:16.89573936 +0000 UTC m=+82.103002643"
Jul 15 18:18:16.899816 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.899761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.910193 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.910143    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-b44fh" podStartSLOduration=1.956227652 podStartE2EDuration="13.910122883s" totalImagesPullingTime="11.953895231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.909488228 +0000 UTC m=+82.116751513" watchObservedRunningTime="2026-07-15 18:18:16.910122883 +0000 UTC m=+82.117386167"
Jul 15 18:18:16.924596 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.924548    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mkfsd" podStartSLOduration=69.46333881 podStartE2EDuration="1m21.924529146s" totalImagesPullingTime="12.461190336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.923654236 +0000 UTC m=+82.130917519" watchObservedRunningTime="2026-07-15 18:18:16.924529146 +0000 UTC m=+82.131792430"
Jul 15 18:18:16.943335 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.943287    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x5ssz" podStartSLOduration=34.135500682 podStartE2EDuration="45.943268529s" totalImagesPullingTime="11.807767847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.942881651 +0000 UTC m=+82.150144935" watchObservedRunningTime="2026-07-15 18:18:16.943268529 +0000 UTC m=+82.150531814"
Jul 15 18:18:16.958694 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.958642    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9f264" podStartSLOduration=68.688176089 podStartE2EDuration="1m21.958626594s" totalImagesPullingTime="13.270450505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.956989179 +0000 UTC m=+82.164252463" watchObservedRunningTime="2026-07-15 18:18:16.958626594 +0000 UTC m=+82.165889879"
Jul 15 18:18:16.969114 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.969087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:16.973334 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:16.973283    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9nr7b" podStartSLOduration=17.876534468 podStartE2EDuration="38.973264681s" totalImagesPullingTime="21.096730213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.972348599 +0000 UTC m=+82.179611883" watchObservedRunningTime="2026-07-15 18:18:16.973264681 +0000 UTC m=+82.180527966"
Jul 15 18:18:17.074731 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:17.074699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:18.259542 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:18.259502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:18.323749 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:18.323712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:18.722699 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:18.722671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:22.493204 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:22.493170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:22.584282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:22.584247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:23.206814 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:23.206778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:23.503236 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:23.503158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:23.559795 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:23.559762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:23.618142 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:23.618110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:23.751412 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:23.751374    2563 patch_prober.go:28] interesting pod/image-registry-848dbd79f-tvt7g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 18:18:23.751674 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:23.751445    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:18:23.928203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:23.928165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:25.211023 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:25.210973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:25.263761 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:25.263724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:26.632455 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.632403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:26.816791 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.816758    2563 patch_prober.go:28] interesting pod/image-registry-848dbd79f-tvt7g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 18:18:26.816986 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.816821    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:18:26.884119 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.884046    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x5ssz"
Jul 15 18:18:26.916319 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.916286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-nxvwr" event={"ID":"f411633c-6b26-4345-bd15-3a70f9a3c7e1","Type":"ContainerStarted","Data":"a07647a06efc4fa223060a25987a2099ef546884cfbc50c61166f73712d1f28e"}
Jul 15 18:18:26.916496 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.916455    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-nxvwr"
Jul 15 18:18:26.917703 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.917682    2563 patch_prober.go:28] interesting pod/downloads-68c9cbb497-nxvwr container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused" start-of-body=
Jul 15 18:18:26.917823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.917725    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-nxvwr" podUID="f411633c-6b26-4345-bd15-3a70f9a3c7e1" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused"
Jul 15 18:18:26.933554 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:26.933515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-nxvwr" podStartSLOduration=1.32861645 podStartE2EDuration="23.933501382s" totalImagesPullingTime="22.604884932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:26.932805487 +0000 UTC m=+92.140068782" watchObservedRunningTime="2026-07-15 18:18:26.933501382 +0000 UTC m=+92.140764664"
Jul 15 18:18:27.942982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:27.942952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-nxvwr"
Jul 15 18:18:28.634410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.634367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:28.837494 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.837447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:28.927236 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.927164    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r9prz"]
Jul 15 18:18:28.936209 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.936166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:28.964492 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.964460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:28.967286 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.967263    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 18:18:28.968188 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.968172    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wmw6k\""
Jul 15 18:18:28.968584 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.968569    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 18:18:28.968883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.968871    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 18:18:28.969197 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:28.969184    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 18:18:29.019044 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.018979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.028922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.028891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-tls\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029094 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.028939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-textfile\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029094 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.028970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029094 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.029011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-root\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029094 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.029047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-metrics-client-ca\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.029071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dpwb\" (UniqueName: \"kubernetes.io/projected/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-kube-api-access-4dpwb\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.029156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-sys\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.029189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.029313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.029221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-wtmp\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.120137 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.120089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.130021 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.129989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-tls\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.130261 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.130224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-textfile\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.130399 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.130384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.130540 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.130527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-root\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.130645 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.130634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-metrics-client-ca\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.130719 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.130670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-textfile\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.131347 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:18:29.130332    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 18:18:29.131539 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:18:29.131528    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-tls podName:27b75cc7-5411-4ffd-9ef6-f0c51befacf7 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:29.631505212 +0000 UTC m=+94.838768479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-tls") pod "node-exporter-r9prz" (UID: "27b75cc7-5411-4ffd-9ef6-f0c51befacf7") : secret "node-exporter-tls" not found
Jul 15 18:18:29.131627 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.131052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dpwb\" (UniqueName: \"kubernetes.io/projected/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-kube-api-access-4dpwb\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.131739 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.131727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-sys\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.131838 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.131824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.131940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.131921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-wtmp\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.132154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.132141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-wtmp\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.132234 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.130829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-root\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.132510 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.131160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.132663 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.132649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-sys\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.132743 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.131296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-metrics-client-ca\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.142439 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.142396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.144700 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.144615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dpwb\" (UniqueName: \"kubernetes.io/projected/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-kube-api-access-4dpwb\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.357865 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.357831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.454506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.454464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.525478 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.525441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.583922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.583883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.636334 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.636243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-tls\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.639033 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.639006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27b75cc7-5411-4ffd-9ef6-f0c51befacf7-node-exporter-tls\") pod \"node-exporter-r9prz\" (UID: \"27b75cc7-5411-4ffd-9ef6-f0c51befacf7\") " pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.712749 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.712700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.865724 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.865668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:29.879595 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.879562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r9prz"
Jul 15 18:18:29.922558 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:29.922507    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b75cc7_5411_4ffd_9ef6_f0c51befacf7.slice/crio-3e3fecf50866bff634ab747105e89b2b0d1901d6e2550a16af2438ba0b09188d WatchSource:0}: Error finding container 3e3fecf50866bff634ab747105e89b2b0d1901d6e2550a16af2438ba0b09188d: Status 404 returned error can't find the container with id 3e3fecf50866bff634ab747105e89b2b0d1901d6e2550a16af2438ba0b09188d
Jul 15 18:18:29.930736 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.930697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9prz" event={"ID":"27b75cc7-5411-4ffd-9ef6-f0c51befacf7","Type":"ContainerStarted","Data":"3e3fecf50866bff634ab747105e89b2b0d1901d6e2550a16af2438ba0b09188d"}
Jul 15 18:18:29.961951 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:29.961922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:30.056587 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:30.056548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:30.703152 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:30.703116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:30.797524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:30.797489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:30.864413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:30.864374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:31.864437 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:31.864364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:31.929365 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:31.929327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:31.942997 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:31.942522    2563 generic.go:356] "Generic (PLEG): container finished" podID="27b75cc7-5411-4ffd-9ef6-f0c51befacf7" containerID="dfd079659783b35ecf0a94dd17115003f535fcbdaad5d9d79cf6dc4162e47798" exitCode=0
Jul 15 18:18:31.942997 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:31.942611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9prz" event={"ID":"27b75cc7-5411-4ffd-9ef6-f0c51befacf7","Type":"ContainerDied","Data":"dfd079659783b35ecf0a94dd17115003f535fcbdaad5d9d79cf6dc4162e47798"}
Jul 15 18:18:32.173286 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:32.173208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:32.797837 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:32.797797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:32.949627 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:32.949589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9prz" event={"ID":"27b75cc7-5411-4ffd-9ef6-f0c51befacf7","Type":"ContainerStarted","Data":"80ad5092d2fb97904fb083e3ca719a8cbaf0410026b0f5abedf28c530ca9cea8"}
Jul 15 18:18:32.950067 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:32.949702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9prz" event={"ID":"27b75cc7-5411-4ffd-9ef6-f0c51befacf7","Type":"ContainerStarted","Data":"f0b8f705453495b67130b889d99dc69aee1e759dd4d68ca0a67f9730c2e51225"}
Jul 15 18:18:32.969648 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:32.969584    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r9prz" podStartSLOduration=3.146635539 podStartE2EDuration="4.969561137s" totalImagesPullingTime="1.695783508s" totalInitContainerRuntime="127.14209ms" isStatefulPod=true podCreationTimestamp="2026-07-15 18:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:32.967490674 +0000 UTC m=+98.174753960" watchObservedRunningTime="2026-07-15 18:18:32.969561137 +0000 UTC m=+98.176824420"
Jul 15 18:18:33.674235 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:33.674186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:33.738765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:33.738728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:33.751370 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:33.751339    2563 patch_prober.go:28] interesting pod/image-registry-848dbd79f-tvt7g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 18:18:33.751535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:33.751398    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:18:33.833902 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:33.833864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:34.119922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.119879    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-87c97d87-gc8hq"]
Jul 15 18:18:34.152778 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.152745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-87c97d87-gc8hq"]
Jul 15 18:18:34.152943 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.152884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.155998 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.155954    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 18:18:34.156141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.155956    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fqd7h\""
Jul 15 18:18:34.156141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.155958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 18:18:34.156288 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.156269    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 18:18:34.156411 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.156361    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 18:18:34.156695 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.156672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 18:18:34.161682 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.161564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 18:18:34.240535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.240503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:34.277756 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.277720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-telemeter-client-tls\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.277934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.277782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-secret-telemeter-client\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.277934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.277805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b6wl\" (UniqueName: \"kubernetes.io/projected/f7d0cdc6-664a-46f9-876a-30348099e5a5-kube-api-access-8b6wl\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.277934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.277836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-federate-client-tls\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.277934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.277857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-metrics-client-ca\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.277934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.277879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.278156 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.277968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-serving-certs-ca-bundle\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.278156 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.278019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.378978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.378889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-telemeter-client-tls\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.378978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.378956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-secret-telemeter-client\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.378978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.378981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b6wl\" (UniqueName: \"kubernetes.io/projected/f7d0cdc6-664a-46f9-876a-30348099e5a5-kube-api-access-8b6wl\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.379248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.379006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-federate-client-tls\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.379248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.379034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-metrics-client-ca\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.379248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.379069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.379248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.379118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-serving-certs-ca-bundle\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.379248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.379163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.380259 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.380231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.380647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.380052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-metrics-client-ca\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.380790 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.380675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d0cdc6-664a-46f9-876a-30348099e5a5-serving-certs-ca-bundle\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.382226 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.382201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-secret-telemeter-client\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.382662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.382643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.382843 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.382822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-federate-client-tls\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.382985 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.382964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7d0cdc6-664a-46f9-876a-30348099e5a5-telemeter-client-tls\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.387104 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.387082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b6wl\" (UniqueName: \"kubernetes.io/projected/f7d0cdc6-664a-46f9-876a-30348099e5a5-kube-api-access-8b6wl\") pod \"telemeter-client-87c97d87-gc8hq\" (UID: \"f7d0cdc6-664a-46f9-876a-30348099e5a5\") " pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.465288 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.465250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq"
Jul 15 18:18:34.654062 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.653952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:34.654785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.654760    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-87c97d87-gc8hq"]
Jul 15 18:18:34.657672 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:18:34.657642    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d0cdc6_664a_46f9_876a_30348099e5a5.slice/crio-ceea152e4045c5668003356f823efdaff3c7ee41ecfa2d22a312710a74cc2957 WatchSource:0}: Error finding container ceea152e4045c5668003356f823efdaff3c7ee41ecfa2d22a312710a74cc2957: Status 404 returned error can't find the container with id ceea152e4045c5668003356f823efdaff3c7ee41ecfa2d22a312710a74cc2957
Jul 15 18:18:34.753526 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.753490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:34.958880 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:34.958800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq" event={"ID":"f7d0cdc6-664a-46f9-876a-30348099e5a5","Type":"ContainerStarted","Data":"ceea152e4045c5668003356f823efdaff3c7ee41ecfa2d22a312710a74cc2957"}
Jul 15 18:18:35.135020 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:35.134985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:35.208214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:35.208179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:35.571583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:35.571543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:35.632465 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:35.632404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:35.923409 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:35.923330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:36.024466 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:36.024411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:36.817009 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:36.816983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:18:36.992557 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:36.992526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:37.066207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:37.066175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:37.502787 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:37.502761    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-848dbd79f-tvt7g"]
Jul 15 18:18:37.572385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:37.572349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:37.972074 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:37.972026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq" event={"ID":"f7d0cdc6-664a-46f9-876a-30348099e5a5","Type":"ContainerStarted","Data":"507eb763e3cc346032072ba51e059153aed546641d4eec239cbfa4daa9f47b2f"}
Jul 15 18:18:38.189632 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:38.189596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:38.244257 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:38.244177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:39.276270 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:39.276239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:39.395086 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:39.395052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:39.490492 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:39.490389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:39.981791 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:39.981749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq" event={"ID":"f7d0cdc6-664a-46f9-876a-30348099e5a5","Type":"ContainerStarted","Data":"166e0974ed00987a6c0b0a3602a7f3e34dcd510d19d3bc57d02351a57c654288"}
Jul 15 18:18:39.982052 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:39.981823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq" event={"ID":"f7d0cdc6-664a-46f9-876a-30348099e5a5","Type":"ContainerStarted","Data":"67d7cda8f7bf68282f29a52cf4d6cfabac21e9bb8a08937f239dae0abdee8d99"}
Jul 15 18:18:40.007415 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:40.006455    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-87c97d87-gc8hq" podStartSLOduration=1.8738454390000001 podStartE2EDuration="6.006435522s" totalImagesPullingTime="4.132590083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:40.004773376 +0000 UTC m=+105.212036659" watchObservedRunningTime="2026-07-15 18:18:40.006435522 +0000 UTC m=+105.213698801"
Jul 15 18:18:43.742378 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:43.742342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:44.596736 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:44.596697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:44.653022 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:44.652991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:44.953648 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:44.953558    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:45.060618 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:45.060581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:47.883489 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:47.883456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mkfsd"
Jul 15 18:18:51.863748 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:51.863708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:52.064301 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:52.064270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:52.123269 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:52.123179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:18:53.029350 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:53.029319    2563 generic.go:356] "Generic (PLEG): container finished" podID="3dfa7522-42d5-41a3-aa9d-6902aa7db748" containerID="bd6bf32d32451057852fcc1a350cf5176e3ddd7c8bf32f7a248e53f0fc48462d" exitCode=0
Jul 15 18:18:53.029746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:53.029390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw" event={"ID":"3dfa7522-42d5-41a3-aa9d-6902aa7db748","Type":"ContainerDied","Data":"bd6bf32d32451057852fcc1a350cf5176e3ddd7c8bf32f7a248e53f0fc48462d"}
Jul 15 18:18:53.029746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:53.029736    2563 scope.go:117] "RemoveContainer" containerID="bd6bf32d32451057852fcc1a350cf5176e3ddd7c8bf32f7a248e53f0fc48462d"
Jul 15 18:18:54.034231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:18:54.034199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7fzfw" event={"ID":"3dfa7522-42d5-41a3-aa9d-6902aa7db748","Type":"ContainerStarted","Data":"81e14c178a0e98a818c857e1a6f884db8b7c936409f4680199e4bc1b63714bd0"}
Jul 15 18:19:01.947174 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:01.947141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:02.000149 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.000122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:02.522320 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.522282    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerName="registry" containerID="cri-o://1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8" gracePeriod=30
Jul 15 18:19:02.799648 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.799552    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:19:02.911273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-bound-sa-token\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911280    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-certificates\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911304    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911332    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzkl4\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-kube-api-access-pzkl4\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-trusted-ca\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911458    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-image-registry-private-configuration\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911519    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-installation-pull-secrets\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911787 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911549    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78be1337-2cdd-4cad-a905-9294a39e76e2-ca-trust-extracted\") pod \"78be1337-2cdd-4cad-a905-9294a39e76e2\" (UID: \"78be1337-2cdd-4cad-a905-9294a39e76e2\") "
Jul 15 18:19:02.911842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911796    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:02.912009 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.911980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:02.913920 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.913890    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-kube-api-access-pzkl4" (OuterVolumeSpecName: "kube-api-access-pzkl4") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "kube-api-access-pzkl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:19:02.914055 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.913993    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:19:02.914132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.914085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:19:02.914222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.914197    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:19:02.914293 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.914268    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:19:02.920373 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:02.920350    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78be1337-2cdd-4cad-a905-9294a39e76e2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "78be1337-2cdd-4cad-a905-9294a39e76e2" (UID: "78be1337-2cdd-4cad-a905-9294a39e76e2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:19:03.012179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012144    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-trusted-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.012179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012171    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-image-registry-private-configuration\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.012179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012181    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78be1337-2cdd-4cad-a905-9294a39e76e2-installation-pull-secrets\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.012179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012190    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78be1337-2cdd-4cad-a905-9294a39e76e2-ca-trust-extracted\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.012655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012199    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-bound-sa-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.012655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012207    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-certificates\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.012655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012215    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-registry-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.012655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.012224    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzkl4\" (UniqueName: \"kubernetes.io/projected/78be1337-2cdd-4cad-a905-9294a39e76e2-kube-api-access-pzkl4\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:19:03.066557 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.066524    2563 generic.go:356] "Generic (PLEG): container finished" podID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerID="1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8" exitCode=0
Jul 15 18:19:03.066711 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.066569    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g"
Jul 15 18:19:03.066711 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.066573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" event={"ID":"78be1337-2cdd-4cad-a905-9294a39e76e2","Type":"ContainerDied","Data":"1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8"}
Jul 15 18:19:03.066711 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.066682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848dbd79f-tvt7g" event={"ID":"78be1337-2cdd-4cad-a905-9294a39e76e2","Type":"ContainerDied","Data":"78380d2673af34d9e44236f5f3295cb02694cd0a72e661f2129cb39d556e7236"}
Jul 15 18:19:03.066711 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.066708    2563 scope.go:117] "RemoveContainer" containerID="1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8"
Jul 15 18:19:03.075046 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.075027    2563 scope.go:117] "RemoveContainer" containerID="1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8"
Jul 15 18:19:03.075285 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:19:03.075264    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8\": container with ID starting with 1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8 not found: ID does not exist" containerID="1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8"
Jul 15 18:19:03.075339 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.075293    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8"} err="failed to get container status \"1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8\": rpc error: code = NotFound desc = could not find container \"1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8\": container with ID starting with 1dca904ad505a2bf7e32bc1ddf0df72df9c950e5ada66a676571c84d102102b8 not found: ID does not exist"
Jul 15 18:19:03.086210 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.086187    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-848dbd79f-tvt7g"]
Jul 15 18:19:03.090235 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.090214    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-848dbd79f-tvt7g"]
Jul 15 18:19:03.375091 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:03.375016    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" path="/var/lib/kubelet/pods/78be1337-2cdd-4cad-a905-9294a39e76e2/volumes"
Jul 15 18:19:31.577013 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:31.576980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:32.061884 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:32.061849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:39.375216 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:39.375183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:45.025051 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:45.025017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:45.085679 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:45.085642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:56.922035 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:56.921990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:57.023155 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:57.023116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:19:58.508724 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:19:58.508683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:01.953697 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:01.953661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:02.054231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:02.054200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:02.346265 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:02.346215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:09.248139 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:09.248107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:09.349460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:09.349415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:09.448878 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:09.448840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:50.483656 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:50.483619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:50.578243 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:50.578210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:20:51.127383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.127347    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"]
Jul 15 18:20:51.127682 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.127669    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerName="registry"
Jul 15 18:20:51.127725 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.127684    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerName="registry"
Jul 15 18:20:51.127758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.127733    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78be1337-2cdd-4cad-a905-9294a39e76e2" containerName="registry"
Jul 15 18:20:51.130745 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.130728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.133398 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.133373    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 18:20:51.133544 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.133434    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzz8m\""
Jul 15 18:20:51.133544 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.133435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 18:20:51.139240 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.139217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"]
Jul 15 18:20:51.272798 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.272761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dp4d\" (UniqueName: \"kubernetes.io/projected/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-kube-api-access-7dp4d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.272976 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.272810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.272976 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.272874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.373276 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.373249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dp4d\" (UniqueName: \"kubernetes.io/projected/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-kube-api-access-7dp4d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.373414 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.373289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.373414 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.373338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.373741 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.373720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.373813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.373747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.381408 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.381359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dp4d\" (UniqueName: \"kubernetes.io/projected/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-kube-api-access-7dp4d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.440138 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.440100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:20:51.566912 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:51.566830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"]
Jul 15 18:20:51.569087 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:20:51.569059    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b963d8_00e1_456e_8a16_cb0f3a8a10a3.slice/crio-86bb581b70c3b24a94e667c11cb7081126c06dd6cd4d5453625cc81fbefe2b2c WatchSource:0}: Error finding container 86bb581b70c3b24a94e667c11cb7081126c06dd6cd4d5453625cc81fbefe2b2c: Status 404 returned error can't find the container with id 86bb581b70c3b24a94e667c11cb7081126c06dd6cd4d5453625cc81fbefe2b2c
Jul 15 18:20:52.455056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:52.455016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq" event={"ID":"19b963d8-00e1-456e-8a16-cb0f3a8a10a3","Type":"ContainerStarted","Data":"86bb581b70c3b24a94e667c11cb7081126c06dd6cd4d5453625cc81fbefe2b2c"}
Jul 15 18:20:59.485715 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:59.485676    2563 generic.go:356] "Generic (PLEG): container finished" podID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerID="f01278857f08bc76d7ce3e135fb913947c49149fe378d0c83c41a697ab3f526b" exitCode=0
Jul 15 18:20:59.486083 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:20:59.485745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq" event={"ID":"19b963d8-00e1-456e-8a16-cb0f3a8a10a3","Type":"ContainerDied","Data":"f01278857f08bc76d7ce3e135fb913947c49149fe378d0c83c41a697ab3f526b"}
Jul 15 18:21:01.496116 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:01.496079    2563 generic.go:356] "Generic (PLEG): container finished" podID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerID="2a0537877d2eaeccfa6e06063ed9ca6b6656c23bc245667ba6de01993a3fb21b" exitCode=0
Jul 15 18:21:01.496535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:01.496123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq" event={"ID":"19b963d8-00e1-456e-8a16-cb0f3a8a10a3","Type":"ContainerDied","Data":"2a0537877d2eaeccfa6e06063ed9ca6b6656c23bc245667ba6de01993a3fb21b"}
Jul 15 18:21:10.534986 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:10.534949    2563 generic.go:356] "Generic (PLEG): container finished" podID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerID="0df7f40a7c1e39774d2fa1edc987a155b8f54c5a5fd15afb43f7f44a8792678a" exitCode=0
Jul 15 18:21:10.535398 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:10.534994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq" event={"ID":"19b963d8-00e1-456e-8a16-cb0f3a8a10a3","Type":"ContainerDied","Data":"0df7f40a7c1e39774d2fa1edc987a155b8f54c5a5fd15afb43f7f44a8792678a"}
Jul 15 18:21:11.658772 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.658745    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:21:11.736222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.736187    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-util\") pod \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") "
Jul 15 18:21:11.736445 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.736254    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-bundle\") pod \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") "
Jul 15 18:21:11.736445 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.736288    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dp4d\" (UniqueName: \"kubernetes.io/projected/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-kube-api-access-7dp4d\") pod \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\" (UID: \"19b963d8-00e1-456e-8a16-cb0f3a8a10a3\") "
Jul 15 18:21:11.737016 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.736992    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-bundle" (OuterVolumeSpecName: "bundle") pod "19b963d8-00e1-456e-8a16-cb0f3a8a10a3" (UID: "19b963d8-00e1-456e-8a16-cb0f3a8a10a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:21:11.738479 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.738454    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-kube-api-access-7dp4d" (OuterVolumeSpecName: "kube-api-access-7dp4d") pod "19b963d8-00e1-456e-8a16-cb0f3a8a10a3" (UID: "19b963d8-00e1-456e-8a16-cb0f3a8a10a3"). InnerVolumeSpecName "kube-api-access-7dp4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:21:11.741487 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.741466    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-util" (OuterVolumeSpecName: "util") pod "19b963d8-00e1-456e-8a16-cb0f3a8a10a3" (UID: "19b963d8-00e1-456e-8a16-cb0f3a8a10a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:21:11.837662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.837635    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-bundle\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:11.837662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.837662    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dp4d\" (UniqueName: \"kubernetes.io/projected/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-kube-api-access-7dp4d\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:11.837843 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:11.837672    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b963d8-00e1-456e-8a16-cb0f3a8a10a3-util\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:12.543368 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:12.543339    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq"
Jul 15 18:21:12.543368 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:12.543350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dlhjq" event={"ID":"19b963d8-00e1-456e-8a16-cb0f3a8a10a3","Type":"ContainerDied","Data":"86bb581b70c3b24a94e667c11cb7081126c06dd6cd4d5453625cc81fbefe2b2c"}
Jul 15 18:21:12.543640 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:12.543390    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86bb581b70c3b24a94e667c11cb7081126c06dd6cd4d5453625cc81fbefe2b2c"
Jul 15 18:21:16.979901 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:16.979865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:18.394746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.394670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:18.944938 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.944903    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"]
Jul 15 18:21:18.945238 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.945221    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerName="pull"
Jul 15 18:21:18.945314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.945240    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerName="pull"
Jul 15 18:21:18.945314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.945253    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerName="extract"
Jul 15 18:21:18.945314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.945261    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerName="extract"
Jul 15 18:21:18.945314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.945274    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerName="util"
Jul 15 18:21:18.945314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.945282    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerName="util"
Jul 15 18:21:18.945586 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.945343    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b963d8-00e1-456e-8a16-cb0f3a8a10a3" containerName="extract"
Jul 15 18:21:18.948160 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.948140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:18.950882 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.950860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xch8m\""
Jul 15 18:21:18.951005 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.950903    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 18:21:18.951005 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.950949    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:21:18.961553 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.961531    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"]
Jul 15 18:21:18.979723 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.979693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d4a2ec-eb81-4dff-b48e-fda657314501-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hg4hw\" (UID: \"d7d4a2ec-eb81-4dff-b48e-fda657314501\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:18.979843 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:18.979731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5ff8\" (UniqueName: \"kubernetes.io/projected/d7d4a2ec-eb81-4dff-b48e-fda657314501-kube-api-access-t5ff8\") pod \"cert-manager-operator-controller-manager-55c444bf86-hg4hw\" (UID: \"d7d4a2ec-eb81-4dff-b48e-fda657314501\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:19.081108 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:19.081058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d4a2ec-eb81-4dff-b48e-fda657314501-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hg4hw\" (UID: \"d7d4a2ec-eb81-4dff-b48e-fda657314501\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:19.081108 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:19.081119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5ff8\" (UniqueName: \"kubernetes.io/projected/d7d4a2ec-eb81-4dff-b48e-fda657314501-kube-api-access-t5ff8\") pod \"cert-manager-operator-controller-manager-55c444bf86-hg4hw\" (UID: \"d7d4a2ec-eb81-4dff-b48e-fda657314501\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:19.081464 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:19.081418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d4a2ec-eb81-4dff-b48e-fda657314501-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hg4hw\" (UID: \"d7d4a2ec-eb81-4dff-b48e-fda657314501\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:19.089453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:19.089408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5ff8\" (UniqueName: \"kubernetes.io/projected/d7d4a2ec-eb81-4dff-b48e-fda657314501-kube-api-access-t5ff8\") pod \"cert-manager-operator-controller-manager-55c444bf86-hg4hw\" (UID: \"d7d4a2ec-eb81-4dff-b48e-fda657314501\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:19.256439 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:19.256332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"
Jul 15 18:21:19.407588 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:19.407555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw"]
Jul 15 18:21:19.410628 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:21:19.410598    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d4a2ec_eb81_4dff_b48e_fda657314501.slice/crio-15acba65fe88816a51acaf7cbaa413110be01bf825639b8fd993f4312ec2ec41 WatchSource:0}: Error finding container 15acba65fe88816a51acaf7cbaa413110be01bf825639b8fd993f4312ec2ec41: Status 404 returned error can't find the container with id 15acba65fe88816a51acaf7cbaa413110be01bf825639b8fd993f4312ec2ec41
Jul 15 18:21:19.568659 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:19.568626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw" event={"ID":"d7d4a2ec-eb81-4dff-b48e-fda657314501","Type":"ContainerStarted","Data":"15acba65fe88816a51acaf7cbaa413110be01bf825639b8fd993f4312ec2ec41"}
Jul 15 18:21:20.589599 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:20.589561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:20.688541 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:20.688492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:21.578517 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:21.578476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw" event={"ID":"d7d4a2ec-eb81-4dff-b48e-fda657314501","Type":"ContainerStarted","Data":"d72b22cc4cf5163c051668528923101d187bc8b86c9c25b8436e7b90d59ab850"}
Jul 15 18:21:21.601929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:21.601875    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hg4hw" podStartSLOduration=2.120756986 podStartE2EDuration="3.601860193s" totalImagesPullingTime="1.481103207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:21:21.600789898 +0000 UTC m=+266.808053183" watchObservedRunningTime="2026-07-15 18:21:21.601860193 +0000 UTC m=+266.809123476"
Jul 15 18:21:22.010546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.010460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:22.115925 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.115886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:22.619938 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.619898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:22.723143 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.723107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:22.875196 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.875115    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"]
Jul 15 18:21:22.878475 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.878459    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:22.881085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.881067    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 18:21:22.881266 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.881253    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 18:21:22.882107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.882088    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzz8m\""
Jul 15 18:21:22.886918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.886897    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"]
Jul 15 18:21:22.912921 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.912890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:22.912921 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.912921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:22.913124 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.912940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wgz7\" (UniqueName: \"kubernetes.io/projected/bb383684-b4fa-479d-b8db-a75e501b0a8b-kube-api-access-8wgz7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:22.926375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.926347    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4wrqn"]
Jul 15 18:21:22.929365 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.929350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:22.932138 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.932117    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 18:21:22.932234 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.932122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 18:21:22.932234 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.932203    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-srw49\""
Jul 15 18:21:22.940166 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:22.940145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4wrqn"]
Jul 15 18:21:23.013554 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.013512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:23.013554 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.013553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:23.013796 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.013578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wgz7\" (UniqueName: \"kubernetes.io/projected/bb383684-b4fa-479d-b8db-a75e501b0a8b-kube-api-access-8wgz7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:23.013796 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.013610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ms8j\" (UniqueName: \"kubernetes.io/projected/788f046b-8ce8-4432-b3de-d5286d8f295e-kube-api-access-6ms8j\") pod \"cert-manager-webhook-6486ffd997-4wrqn\" (UID: \"788f046b-8ce8-4432-b3de-d5286d8f295e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:23.013796 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.013636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/788f046b-8ce8-4432-b3de-d5286d8f295e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4wrqn\" (UID: \"788f046b-8ce8-4432-b3de-d5286d8f295e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:23.013952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.013920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:23.013989 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.013941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:23.022062 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.022031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wgz7\" (UniqueName: \"kubernetes.io/projected/bb383684-b4fa-479d-b8db-a75e501b0a8b-kube-api-access-8wgz7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:23.114236 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.114195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ms8j\" (UniqueName: \"kubernetes.io/projected/788f046b-8ce8-4432-b3de-d5286d8f295e-kube-api-access-6ms8j\") pod \"cert-manager-webhook-6486ffd997-4wrqn\" (UID: \"788f046b-8ce8-4432-b3de-d5286d8f295e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:23.114236 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.114234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/788f046b-8ce8-4432-b3de-d5286d8f295e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4wrqn\" (UID: \"788f046b-8ce8-4432-b3de-d5286d8f295e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:23.124064 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.124031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/788f046b-8ce8-4432-b3de-d5286d8f295e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4wrqn\" (UID: \"788f046b-8ce8-4432-b3de-d5286d8f295e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:23.124174 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.124135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ms8j\" (UniqueName: \"kubernetes.io/projected/788f046b-8ce8-4432-b3de-d5286d8f295e-kube-api-access-6ms8j\") pod \"cert-manager-webhook-6486ffd997-4wrqn\" (UID: \"788f046b-8ce8-4432-b3de-d5286d8f295e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:23.187988 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.187898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:23.256417 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.256390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:23.319874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.319854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"]
Jul 15 18:21:23.322689 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:21:23.322663    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb383684_b4fa_479d_b8db_a75e501b0a8b.slice/crio-bfa5cb70a987c0d1495c13b557f5b5237a872f481137b4b045b51a5aa0af6771 WatchSource:0}: Error finding container bfa5cb70a987c0d1495c13b557f5b5237a872f481137b4b045b51a5aa0af6771: Status 404 returned error can't find the container with id bfa5cb70a987c0d1495c13b557f5b5237a872f481137b4b045b51a5aa0af6771
Jul 15 18:21:23.389510 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.389483    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4wrqn"]
Jul 15 18:21:23.391050 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:21:23.391022    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod788f046b_8ce8_4432_b3de_d5286d8f295e.slice/crio-6a1e80954d0bba9da16530d2940f338c2aee036c22346584fac95c71ef8aa56a WatchSource:0}: Error finding container 6a1e80954d0bba9da16530d2940f338c2aee036c22346584fac95c71ef8aa56a: Status 404 returned error can't find the container with id 6a1e80954d0bba9da16530d2940f338c2aee036c22346584fac95c71ef8aa56a
Jul 15 18:21:23.587659 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.587627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn" event={"ID":"788f046b-8ce8-4432-b3de-d5286d8f295e","Type":"ContainerStarted","Data":"6a1e80954d0bba9da16530d2940f338c2aee036c22346584fac95c71ef8aa56a"}
Jul 15 18:21:23.589181 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.589156    2563 generic.go:356] "Generic (PLEG): container finished" podID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerID="5d55905d44fb5193cc03676cad0cc7adbc74adbe6c2de2f27a68eada6f68a20e" exitCode=0
Jul 15 18:21:23.589291 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.589210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7" event={"ID":"bb383684-b4fa-479d-b8db-a75e501b0a8b","Type":"ContainerDied","Data":"5d55905d44fb5193cc03676cad0cc7adbc74adbe6c2de2f27a68eada6f68a20e"}
Jul 15 18:21:23.589291 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:23.589270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7" event={"ID":"bb383684-b4fa-479d-b8db-a75e501b0a8b","Type":"ContainerStarted","Data":"bfa5cb70a987c0d1495c13b557f5b5237a872f481137b4b045b51a5aa0af6771"}
Jul 15 18:21:24.845603 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:24.845567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:25.035073 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:25.035038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:27.381604 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:27.381569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:27.438946 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:27.438906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:27.608798 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:27.608762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn" event={"ID":"788f046b-8ce8-4432-b3de-d5286d8f295e","Type":"ContainerStarted","Data":"2756dc38fbc1278974f112818221adb3df9f4a2e0bf9bd6bf27e317ddcd2c09c"}
Jul 15 18:21:27.608973 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:27.608830    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:27.610524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:27.610501    2563 generic.go:356] "Generic (PLEG): container finished" podID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerID="6a9f0d9a8f8e8b2e1b50527544ed73548428180e229a072413041d780a885ed3" exitCode=0
Jul 15 18:21:27.610651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:27.610557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7" event={"ID":"bb383684-b4fa-479d-b8db-a75e501b0a8b","Type":"ContainerDied","Data":"6a9f0d9a8f8e8b2e1b50527544ed73548428180e229a072413041d780a885ed3"}
Jul 15 18:21:27.625250 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:27.625187    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn" podStartSLOduration=2.389079458 podStartE2EDuration="5.625164523s" totalImagesPullingTime="3.236085065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:21:27.624286448 +0000 UTC m=+272.831549731" watchObservedRunningTime="2026-07-15 18:21:27.625164523 +0000 UTC m=+272.832427838"
Jul 15 18:21:28.616550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:28.616514    2563 generic.go:356] "Generic (PLEG): container finished" podID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerID="ed9e7069d64ed26c518299296e5f9ed7aa0e716fb6f2e24672748ba94bef5159" exitCode=0
Jul 15 18:21:28.616934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:28.616583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7" event={"ID":"bb383684-b4fa-479d-b8db-a75e501b0a8b","Type":"ContainerDied","Data":"ed9e7069d64ed26c518299296e5f9ed7aa0e716fb6f2e24672748ba94bef5159"}
Jul 15 18:21:29.745704 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.745677    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:29.770195 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.770166    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wgz7\" (UniqueName: \"kubernetes.io/projected/bb383684-b4fa-479d-b8db-a75e501b0a8b-kube-api-access-8wgz7\") pod \"bb383684-b4fa-479d-b8db-a75e501b0a8b\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") "
Jul 15 18:21:29.770361 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.770233    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-util\") pod \"bb383684-b4fa-479d-b8db-a75e501b0a8b\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") "
Jul 15 18:21:29.770361 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.770276    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-bundle\") pod \"bb383684-b4fa-479d-b8db-a75e501b0a8b\" (UID: \"bb383684-b4fa-479d-b8db-a75e501b0a8b\") "
Jul 15 18:21:29.770774 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.770742    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-bundle" (OuterVolumeSpecName: "bundle") pod "bb383684-b4fa-479d-b8db-a75e501b0a8b" (UID: "bb383684-b4fa-479d-b8db-a75e501b0a8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:21:29.772314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.772282    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb383684-b4fa-479d-b8db-a75e501b0a8b-kube-api-access-8wgz7" (OuterVolumeSpecName: "kube-api-access-8wgz7") pod "bb383684-b4fa-479d-b8db-a75e501b0a8b" (UID: "bb383684-b4fa-479d-b8db-a75e501b0a8b"). InnerVolumeSpecName "kube-api-access-8wgz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:21:29.775125 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.775090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-util" (OuterVolumeSpecName: "util") pod "bb383684-b4fa-479d-b8db-a75e501b0a8b" (UID: "bb383684-b4fa-479d-b8db-a75e501b0a8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:21:29.870825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.870788    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-util\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:29.870986 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.870842    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb383684-b4fa-479d-b8db-a75e501b0a8b-bundle\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:29.870986 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.870852    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wgz7\" (UniqueName: \"kubernetes.io/projected/bb383684-b4fa-479d-b8db-a75e501b0a8b-kube-api-access-8wgz7\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:29.983280 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:29.983190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:30.034785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:30.034754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:30.626300 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:30.626270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7" event={"ID":"bb383684-b4fa-479d-b8db-a75e501b0a8b","Type":"ContainerDied","Data":"bfa5cb70a987c0d1495c13b557f5b5237a872f481137b4b045b51a5aa0af6771"}
Jul 15 18:21:30.626468 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:30.626309    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2flz7"
Jul 15 18:21:30.626468 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:30.626314    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfa5cb70a987c0d1495c13b557f5b5237a872f481137b4b045b51a5aa0af6771"
Jul 15 18:21:33.034599 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:33.034554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:33.618681 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:33.618655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4wrqn"
Jul 15 18:21:37.199342 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:37.199307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:37.299899 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:37.299870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:38.885495 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885463    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"]
Jul 15 18:21:38.885842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885730    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerName="pull"
Jul 15 18:21:38.885842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885741    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerName="pull"
Jul 15 18:21:38.885842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885754    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerName="extract"
Jul 15 18:21:38.885842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885761    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerName="extract"
Jul 15 18:21:38.885842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885768    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerName="util"
Jul 15 18:21:38.885842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885774    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerName="util"
Jul 15 18:21:38.885842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.885818    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb383684-b4fa-479d-b8db-a75e501b0a8b" containerName="extract"
Jul 15 18:21:38.927806 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.927781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"]
Jul 15 18:21:38.927956 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.927868    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:38.930977 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.930950    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 18:21:38.931798 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.931781    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:21:38.931868 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:38.931803    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gcfkg\""
Jul 15 18:21:39.035098 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.035074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d46d0af-f380-4aa6-b05f-4d83b00287f8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9jx2r\" (UID: \"4d46d0af-f380-4aa6-b05f-4d83b00287f8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:39.035185 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.035108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjqjf\" (UniqueName: \"kubernetes.io/projected/4d46d0af-f380-4aa6-b05f-4d83b00287f8-kube-api-access-vjqjf\") pod \"openshift-lws-operator-fd8ccff4c-9jx2r\" (UID: \"4d46d0af-f380-4aa6-b05f-4d83b00287f8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:39.135650 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.135583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d46d0af-f380-4aa6-b05f-4d83b00287f8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9jx2r\" (UID: \"4d46d0af-f380-4aa6-b05f-4d83b00287f8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:39.135650 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.135627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjqjf\" (UniqueName: \"kubernetes.io/projected/4d46d0af-f380-4aa6-b05f-4d83b00287f8-kube-api-access-vjqjf\") pod \"openshift-lws-operator-fd8ccff4c-9jx2r\" (UID: \"4d46d0af-f380-4aa6-b05f-4d83b00287f8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:39.135992 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.135971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d46d0af-f380-4aa6-b05f-4d83b00287f8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9jx2r\" (UID: \"4d46d0af-f380-4aa6-b05f-4d83b00287f8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:39.144209 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.144189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjqjf\" (UniqueName: \"kubernetes.io/projected/4d46d0af-f380-4aa6-b05f-4d83b00287f8-kube-api-access-vjqjf\") pod \"openshift-lws-operator-fd8ccff4c-9jx2r\" (UID: \"4d46d0af-f380-4aa6-b05f-4d83b00287f8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:39.235988 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.235965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"
Jul 15 18:21:39.376260 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:21:39.376233    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d46d0af_f380_4aa6_b05f_4d83b00287f8.slice/crio-05d93e953d18698c815a008a356babdff555457fee37b7fcc85366888e23510f WatchSource:0}: Error finding container 05d93e953d18698c815a008a356babdff555457fee37b7fcc85366888e23510f: Status 404 returned error can't find the container with id 05d93e953d18698c815a008a356babdff555457fee37b7fcc85366888e23510f
Jul 15 18:21:39.376388 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.376324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r"]
Jul 15 18:21:39.661353 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:39.661321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r" event={"ID":"4d46d0af-f380-4aa6-b05f-4d83b00287f8","Type":"ContainerStarted","Data":"05d93e953d18698c815a008a356babdff555457fee37b7fcc85366888e23510f"}
Jul 15 18:21:42.675746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:42.675716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r" event={"ID":"4d46d0af-f380-4aa6-b05f-4d83b00287f8","Type":"ContainerStarted","Data":"b4235cc0d18bbee4229bcaf936bd37c2cd9cf058ea2f4870269da215cacf5055"}
Jul 15 18:21:42.691651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:42.691606    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jx2r" podStartSLOduration=2.211792165 podStartE2EDuration="4.691591506s" totalImagesPullingTime="2.479799341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:21:42.691272003 +0000 UTC m=+287.898535287" watchObservedRunningTime="2026-07-15 18:21:42.691591506 +0000 UTC m=+287.898854788"
Jul 15 18:21:43.183165 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.183136    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tdxxv"]
Jul 15 18:21:43.206628 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.206601    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tdxxv"]
Jul 15 18:21:43.206775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.206680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.209446 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.209405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c6lm7\""
Jul 15 18:21:43.266584 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.266561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d4b3f12-3f77-45f5-b56c-125ae51fc218-bound-sa-token\") pod \"cert-manager-55b4d954d5-tdxxv\" (UID: \"0d4b3f12-3f77-45f5-b56c-125ae51fc218\") " pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.266677 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.266608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npp4m\" (UniqueName: \"kubernetes.io/projected/0d4b3f12-3f77-45f5-b56c-125ae51fc218-kube-api-access-npp4m\") pod \"cert-manager-55b4d954d5-tdxxv\" (UID: \"0d4b3f12-3f77-45f5-b56c-125ae51fc218\") " pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.352776 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.352744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:43.367791 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.367768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npp4m\" (UniqueName: \"kubernetes.io/projected/0d4b3f12-3f77-45f5-b56c-125ae51fc218-kube-api-access-npp4m\") pod \"cert-manager-55b4d954d5-tdxxv\" (UID: \"0d4b3f12-3f77-45f5-b56c-125ae51fc218\") " pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.367881 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.367819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d4b3f12-3f77-45f5-b56c-125ae51fc218-bound-sa-token\") pod \"cert-manager-55b4d954d5-tdxxv\" (UID: \"0d4b3f12-3f77-45f5-b56c-125ae51fc218\") " pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.376235 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.376208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d4b3f12-3f77-45f5-b56c-125ae51fc218-bound-sa-token\") pod \"cert-manager-55b4d954d5-tdxxv\" (UID: \"0d4b3f12-3f77-45f5-b56c-125ae51fc218\") " pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.376328 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.376269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npp4m\" (UniqueName: \"kubernetes.io/projected/0d4b3f12-3f77-45f5-b56c-125ae51fc218-kube-api-access-npp4m\") pod \"cert-manager-55b4d954d5-tdxxv\" (UID: \"0d4b3f12-3f77-45f5-b56c-125ae51fc218\") " pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.456351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.456290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:43.515174 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.515154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tdxxv"
Jul 15 18:21:43.634527 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.634500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tdxxv"]
Jul 15 18:21:43.636782 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:21:43.636748    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d4b3f12_3f77_45f5_b56c_125ae51fc218.slice/crio-bfa4e83f29b00ae69394077c00d99c4b3f16f585cb1e54ff961d35a757592a91 WatchSource:0}: Error finding container bfa4e83f29b00ae69394077c00d99c4b3f16f585cb1e54ff961d35a757592a91: Status 404 returned error can't find the container with id bfa4e83f29b00ae69394077c00d99c4b3f16f585cb1e54ff961d35a757592a91
Jul 15 18:21:43.681673 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:43.681649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tdxxv" event={"ID":"0d4b3f12-3f77-45f5-b56c-125ae51fc218","Type":"ContainerStarted","Data":"bfa4e83f29b00ae69394077c00d99c4b3f16f585cb1e54ff961d35a757592a91"}
Jul 15 18:21:44.687333 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.687302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tdxxv" event={"ID":"0d4b3f12-3f77-45f5-b56c-125ae51fc218","Type":"ContainerStarted","Data":"d705b0dd4351b43d4d2a8d70dae77447935d9845e176368dec34d6c9f5065633"}
Jul 15 18:21:44.703845 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.703799    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tdxxv" podStartSLOduration=1.7037840210000001 podStartE2EDuration="1.703784021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:21:44.702470854 +0000 UTC m=+289.909734137" watchObservedRunningTime="2026-07-15 18:21:44.703784021 +0000 UTC m=+289.911047304"
Jul 15 18:21:44.850411 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.850382    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"]
Jul 15 18:21:44.853516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.853499    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:44.856120 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.856099    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 18:21:44.856252 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.856124    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzz8m\""
Jul 15 18:21:44.856252 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.856199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 18:21:44.862145 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.862123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"]
Jul 15 18:21:44.980800 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.980723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:44.980800 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.980792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:44.980970 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:44.980834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4drt\" (UniqueName: \"kubernetes.io/projected/40d6d67d-e937-4505-9e2e-570feb14d387-kube-api-access-r4drt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.081486 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.081451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.081626 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.081498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4drt\" (UniqueName: \"kubernetes.io/projected/40d6d67d-e937-4505-9e2e-570feb14d387-kube-api-access-r4drt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.081626 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.081526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.081825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.081804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.081892 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.081825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.090016 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.089993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4drt\" (UniqueName: \"kubernetes.io/projected/40d6d67d-e937-4505-9e2e-570feb14d387-kube-api-access-r4drt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.162835 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.162808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:45.284366 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.284270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"]
Jul 15 18:21:45.286443 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:21:45.286393    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d6d67d_e937_4505_9e2e_570feb14d387.slice/crio-9025e83b418d45b8bd8e5ad5b4bcd0cee33aa076e89675679da5be26cc904956 WatchSource:0}: Error finding container 9025e83b418d45b8bd8e5ad5b4bcd0cee33aa076e89675679da5be26cc904956: Status 404 returned error can't find the container with id 9025e83b418d45b8bd8e5ad5b4bcd0cee33aa076e89675679da5be26cc904956
Jul 15 18:21:45.555147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.555122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:45.692237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.692206    2563 generic.go:356] "Generic (PLEG): container finished" podID="40d6d67d-e937-4505-9e2e-570feb14d387" containerID="ae2c0eab77476b77b012377d44be611d5ac1eec7db5472eecbe3636cb531a8d1" exitCode=0
Jul 15 18:21:45.692610 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.692293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq" event={"ID":"40d6d67d-e937-4505-9e2e-570feb14d387","Type":"ContainerDied","Data":"ae2c0eab77476b77b012377d44be611d5ac1eec7db5472eecbe3636cb531a8d1"}
Jul 15 18:21:45.692610 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:45.692345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq" event={"ID":"40d6d67d-e937-4505-9e2e-570feb14d387","Type":"ContainerStarted","Data":"9025e83b418d45b8bd8e5ad5b4bcd0cee33aa076e89675679da5be26cc904956"}
Jul 15 18:21:46.698321 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:46.698244    2563 generic.go:356] "Generic (PLEG): container finished" podID="40d6d67d-e937-4505-9e2e-570feb14d387" containerID="f236cbd4fc7ec70aaee1bbfd64d6f891389e042b60a48c277fa1418212768c5b" exitCode=0
Jul 15 18:21:46.698679 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:46.698339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq" event={"ID":"40d6d67d-e937-4505-9e2e-570feb14d387","Type":"ContainerDied","Data":"f236cbd4fc7ec70aaee1bbfd64d6f891389e042b60a48c277fa1418212768c5b"}
Jul 15 18:21:47.704642 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:47.704607    2563 generic.go:356] "Generic (PLEG): container finished" podID="40d6d67d-e937-4505-9e2e-570feb14d387" containerID="2ca81c8a57bd0a4f1321513c115075c1f61edc891a89cf2265bfb14e76475da9" exitCode=0
Jul 15 18:21:47.704973 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:47.704684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq" event={"ID":"40d6d67d-e937-4505-9e2e-570feb14d387","Type":"ContainerDied","Data":"2ca81c8a57bd0a4f1321513c115075c1f61edc891a89cf2265bfb14e76475da9"}
Jul 15 18:21:48.830382 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:48.830359    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:48.907244 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:48.907220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4drt\" (UniqueName: \"kubernetes.io/projected/40d6d67d-e937-4505-9e2e-570feb14d387-kube-api-access-r4drt\") pod \"40d6d67d-e937-4505-9e2e-570feb14d387\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") "
Jul 15 18:21:48.907381 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:48.907255    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-bundle\") pod \"40d6d67d-e937-4505-9e2e-570feb14d387\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") "
Jul 15 18:21:48.907381 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:48.907273    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-util\") pod \"40d6d67d-e937-4505-9e2e-570feb14d387\" (UID: \"40d6d67d-e937-4505-9e2e-570feb14d387\") "
Jul 15 18:21:48.907986 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:48.907960    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-bundle" (OuterVolumeSpecName: "bundle") pod "40d6d67d-e937-4505-9e2e-570feb14d387" (UID: "40d6d67d-e937-4505-9e2e-570feb14d387"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:21:48.909508 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:48.909482    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d6d67d-e937-4505-9e2e-570feb14d387-kube-api-access-r4drt" (OuterVolumeSpecName: "kube-api-access-r4drt") pod "40d6d67d-e937-4505-9e2e-570feb14d387" (UID: "40d6d67d-e937-4505-9e2e-570feb14d387"). InnerVolumeSpecName "kube-api-access-r4drt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:21:48.915494 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:48.915469    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-util" (OuterVolumeSpecName: "util") pod "40d6d67d-e937-4505-9e2e-570feb14d387" (UID: "40d6d67d-e937-4505-9e2e-570feb14d387"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:21:49.008753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:49.008698    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4drt\" (UniqueName: \"kubernetes.io/projected/40d6d67d-e937-4505-9e2e-570feb14d387-kube-api-access-r4drt\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:49.008753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:49.008722    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-bundle\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:49.008753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:49.008732    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40d6d67d-e937-4505-9e2e-570feb14d387-util\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:21:49.716113 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:49.716038    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq"
Jul 15 18:21:49.716113 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:49.716044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4q7rq" event={"ID":"40d6d67d-e937-4505-9e2e-570feb14d387","Type":"ContainerDied","Data":"9025e83b418d45b8bd8e5ad5b4bcd0cee33aa076e89675679da5be26cc904956"}
Jul 15 18:21:49.716113 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:49.716085    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9025e83b418d45b8bd8e5ad5b4bcd0cee33aa076e89675679da5be26cc904956"
Jul 15 18:21:55.227980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:55.227949    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:21:55.228883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:55.228862    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:21:55.231452 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:55.231435    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 18:21:57.795709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:57.795675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:59.020852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.020815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:59.030710 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.030673    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"]
Jul 15 18:21:59.030995 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.030979    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d6d67d-e937-4505-9e2e-570feb14d387" containerName="pull"
Jul 15 18:21:59.031040 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.030996    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d6d67d-e937-4505-9e2e-570feb14d387" containerName="pull"
Jul 15 18:21:59.031040 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.031005    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d6d67d-e937-4505-9e2e-570feb14d387" containerName="extract"
Jul 15 18:21:59.031040 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.031011    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d6d67d-e937-4505-9e2e-570feb14d387" containerName="extract"
Jul 15 18:21:59.031040 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.031019    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d6d67d-e937-4505-9e2e-570feb14d387" containerName="util"
Jul 15 18:21:59.031040 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.031025    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d6d67d-e937-4505-9e2e-570feb14d387" containerName="util"
Jul 15 18:21:59.031189 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.031079    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d6d67d-e937-4505-9e2e-570feb14d387" containerName="extract"
Jul 15 18:21:59.034079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.034058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.037352 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.037321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-555sq\""
Jul 15 18:21:59.037642 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.037618    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 18:21:59.037824 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.037740    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 18:21:59.037824 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.037772    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 18:21:59.037936 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.037914    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 18:21:59.057395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.057372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"]
Jul 15 18:21:59.078864 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.078835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wnbq\" (UniqueName: \"kubernetes.io/projected/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-kube-api-access-4wnbq\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.078971 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.078898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.078971 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.078920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-webhook-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.078971 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.078948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-manifests\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.079110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.079001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-tmp\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.179881 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.179853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.179996 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.179892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-webhook-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.179996 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.179929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-manifests\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.179996 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.179959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-tmp\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.180161 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.180030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wnbq\" (UniqueName: \"kubernetes.io/projected/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-kube-api-access-4wnbq\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.180404 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.180377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-manifests\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.182172 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.182142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-tmp\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.182442 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.182400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.182512 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.182469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-webhook-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.186107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.186086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:59.188379 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.188361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wnbq\" (UniqueName: \"kubernetes.io/projected/a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb-kube-api-access-4wnbq\") pod \"opendatahub-operator-controller-manager-5664889d69-m2pzc\" (UID: \"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.286159 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.286103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:59.345918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.345895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:21:59.387836 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.387803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:59.480079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.480054    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"]
Jul 15 18:21:59.482474 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:21:59.482445    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c8fd63_d18a_46f7_826f_9f9f5e2ebbfb.slice/crio-821db91c278d305bd573e4d4fdb34b95e09ce9c9cf965ada02774b697d4baec4 WatchSource:0}: Error finding container 821db91c278d305bd573e4d4fdb34b95e09ce9c9cf965ada02774b697d4baec4: Status 404 returned error can't find the container with id 821db91c278d305bd573e4d4fdb34b95e09ce9c9cf965ada02774b697d4baec4
Jul 15 18:21:59.484798 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.484781    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:21:59.490059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.490035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:59.616291 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.616266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:21:59.763593 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:21:59.763565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc" event={"ID":"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb","Type":"ContainerStarted","Data":"821db91c278d305bd573e4d4fdb34b95e09ce9c9cf965ada02774b697d4baec4"}
Jul 15 18:22:02.780998 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:02.780939    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc" event={"ID":"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb","Type":"ContainerStarted","Data":"28162533cb642262983756da525ffba0e5f8b855a718c0ed3fca8459ca22c4fc"}
Jul 15 18:22:03.787729 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:03.787651    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb" containerID="28162533cb642262983756da525ffba0e5f8b855a718c0ed3fca8459ca22c4fc" exitCode=0
Jul 15 18:22:03.788056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:03.787737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc" event={"ID":"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb","Type":"ContainerDied","Data":"28162533cb642262983756da525ffba0e5f8b855a718c0ed3fca8459ca22c4fc"}
Jul 15 18:22:04.795068 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:04.794987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc" event={"ID":"a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb","Type":"ContainerStarted","Data":"e1b2d43e773618d09cdff07201e50f3e33f286f4e64895c8fce34e1f6dd30933"}
Jul 15 18:22:04.795496 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:04.795137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:22:04.816876 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:04.816830    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc" podStartSLOduration=1.089206082 podStartE2EDuration="5.816814383s" totalImagesPullingTime="3.699838185s" totalInitContainerRuntime="1.027770116s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:21:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:04.814467327 +0000 UTC m=+310.021730606" watchObservedRunningTime="2026-07-15 18:22:04.816814383 +0000 UTC m=+310.024077665"
Jul 15 18:22:15.802837 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:15.802806    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-m2pzc"
Jul 15 18:22:18.330087 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:18.330038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:18.483450 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:18.483388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:19.081587 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.081552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:19.099706 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.099671    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"]
Jul 15 18:22:19.103684 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.103662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.108944 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.108919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 18:22:19.111613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.111596    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 18:22:19.129856 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.129826    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"]
Jul 15 18:22:19.233576 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.233543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eae91f25-0b21-4d81-9c36-8b87f0f7a838-tmp\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.233758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.233587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae91f25-0b21-4d81-9c36-8b87f0f7a838-tls-certs\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.233758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.233613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-579gc\" (UniqueName: \"kubernetes.io/projected/eae91f25-0b21-4d81-9c36-8b87f0f7a838-kube-api-access-579gc\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.259605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.259571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:19.334900 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.334795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae91f25-0b21-4d81-9c36-8b87f0f7a838-tls-certs\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.334900 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.334844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-579gc\" (UniqueName: \"kubernetes.io/projected/eae91f25-0b21-4d81-9c36-8b87f0f7a838-kube-api-access-579gc\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.335412 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.334924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eae91f25-0b21-4d81-9c36-8b87f0f7a838-tmp\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.337177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.337152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eae91f25-0b21-4d81-9c36-8b87f0f7a838-tmp\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.337354 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.337334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae91f25-0b21-4d81-9c36-8b87f0f7a838-tls-certs\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.361964 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.361930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-579gc\" (UniqueName: \"kubernetes.io/projected/eae91f25-0b21-4d81-9c36-8b87f0f7a838-kube-api-access-579gc\") pod \"kube-auth-proxy-6b5bc7bcd6-c757l\" (UID: \"eae91f25-0b21-4d81-9c36-8b87f0f7a838\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.413845 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.413812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"
Jul 15 18:22:19.419593 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.419555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:19.572556 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.572521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:19.586031 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.585668    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l"]
Jul 15 18:22:19.589097 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:22:19.589065    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae91f25_0b21_4d81_9c36_8b87f0f7a838.slice/crio-0f53629892c2ec761b7129e4e32a3d1302e65a080cf3f6b704b25f5d0ba337e5 WatchSource:0}: Error finding container 0f53629892c2ec761b7129e4e32a3d1302e65a080cf3f6b704b25f5d0ba337e5: Status 404 returned error can't find the container with id 0f53629892c2ec761b7129e4e32a3d1302e65a080cf3f6b704b25f5d0ba337e5
Jul 15 18:22:19.721972 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.721938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:19.811660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.811631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:19.864686 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:19.864604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l" event={"ID":"eae91f25-0b21-4d81-9c36-8b87f0f7a838","Type":"ContainerStarted","Data":"0f53629892c2ec761b7129e4e32a3d1302e65a080cf3f6b704b25f5d0ba337e5"}
Jul 15 18:22:20.119774 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.119647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:20.634875 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.634835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:20.703379 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.703342    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s859k"]
Jul 15 18:22:20.706856 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.706831    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:20.711349 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.711320    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wwflt\""
Jul 15 18:22:20.711562 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.711541    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 18:22:20.717864 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.717798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s859k"]
Jul 15 18:22:20.833468 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.829745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:20.834137 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.834111    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"]
Jul 15 18:22:20.839382 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.839354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.842734 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.842711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 18:22:20.842898 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.842877    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 18:22:20.843683 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.842825    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 18:22:20.843952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.842781    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-52q9d\""
Jul 15 18:22:20.844056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.843378    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 18:22:20.851192 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.851162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"]
Jul 15 18:22:20.851826 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.851677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef07a2d6-a664-4afd-8260-9b4396345263-tls-certs\") pod \"model-serving-api-54d89bd5fc-s859k\" (UID: \"ef07a2d6-a664-4afd-8260-9b4396345263\") " pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:20.851826 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.851731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4bpq\" (UniqueName: \"kubernetes.io/projected/ef07a2d6-a664-4afd-8260-9b4396345263-kube-api-access-r4bpq\") pod \"model-serving-api-54d89bd5fc-s859k\" (UID: \"ef07a2d6-a664-4afd-8260-9b4396345263\") " pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:20.898812 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.898723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:20.953046 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.953221 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.953221 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t29x7\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-kube-api-access-t29x7\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.953221 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d3a109-2423-41e2-9fe1-03b806bb9492-local-certs\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.953221 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef07a2d6-a664-4afd-8260-9b4396345263-tls-certs\") pod \"model-serving-api-54d89bd5fc-s859k\" (UID: \"ef07a2d6-a664-4afd-8260-9b4396345263\") " pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:20.953453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-token\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.953453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4bpq\" (UniqueName: \"kubernetes.io/projected/ef07a2d6-a664-4afd-8260-9b4396345263-kube-api-access-r4bpq\") pod \"model-serving-api-54d89bd5fc-s859k\" (UID: \"ef07a2d6-a664-4afd-8260-9b4396345263\") " pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:20.953453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.953453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.953348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-cacerts\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:20.955640 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.955615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef07a2d6-a664-4afd-8260-9b4396345263-tls-certs\") pod \"model-serving-api-54d89bd5fc-s859k\" (UID: \"ef07a2d6-a664-4afd-8260-9b4396345263\") " pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:20.964478 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:20.964449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4bpq\" (UniqueName: \"kubernetes.io/projected/ef07a2d6-a664-4afd-8260-9b4396345263-kube-api-access-r4bpq\") pod \"model-serving-api-54d89bd5fc-s859k\" (UID: \"ef07a2d6-a664-4afd-8260-9b4396345263\") " pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:21.020567 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.020535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:21.054214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.054183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.054383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.054233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-cacerts\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.054383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.054279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.054383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.054308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.054383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.054340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t29x7\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-kube-api-access-t29x7\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.054383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.054368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d3a109-2423-41e2-9fe1-03b806bb9492-local-certs\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.054677 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.054444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-token\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.055360 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.055311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.057089 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.057062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.057401 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.057377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d3a109-2423-41e2-9fe1-03b806bb9492-local-certs\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.057739 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.057710    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.057972 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.057953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-cacerts\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.062133 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.062110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-token\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.062832 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.062802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t29x7\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-kube-api-access-t29x7\") pod \"istiod-openshift-gateway-7574459656-l8tmn\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.153389 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.153309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:21.178616 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.178581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s859k"]
Jul 15 18:22:21.181168 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:22:21.181136    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef07a2d6_a664_4afd_8260_9b4396345263.slice/crio-bbc4fb7e8de6194a28b48d1161a566758acd7a0bb9a536975da388783f61ad7a WatchSource:0}: Error finding container bbc4fb7e8de6194a28b48d1161a566758acd7a0bb9a536975da388783f61ad7a: Status 404 returned error can't find the container with id bbc4fb7e8de6194a28b48d1161a566758acd7a0bb9a536975da388783f61ad7a
Jul 15 18:22:21.291415 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.291377    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"]
Jul 15 18:22:21.294356 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:22:21.294331    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d3a109_2423_41e2_9fe1_03b806bb9492.slice/crio-c95e807dcabcd003f997cc7129c20c79c3d21e6aa73e8e217677bbb2b4605aa0 WatchSource:0}: Error finding container c95e807dcabcd003f997cc7129c20c79c3d21e6aa73e8e217677bbb2b4605aa0: Status 404 returned error can't find the container with id c95e807dcabcd003f997cc7129c20c79c3d21e6aa73e8e217677bbb2b4605aa0
Jul 15 18:22:21.876231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.876134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:21.882059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.882020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn" event={"ID":"49d3a109-2423-41e2-9fe1-03b806bb9492","Type":"ContainerStarted","Data":"c95e807dcabcd003f997cc7129c20c79c3d21e6aa73e8e217677bbb2b4605aa0"}
Jul 15 18:22:21.883533 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:21.883501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s859k" event={"ID":"ef07a2d6-a664-4afd-8260-9b4396345263","Type":"ContainerStarted","Data":"bbc4fb7e8de6194a28b48d1161a566758acd7a0bb9a536975da388783f61ad7a"}
Jul 15 18:22:23.901073 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:23.901031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l" event={"ID":"eae91f25-0b21-4d81-9c36-8b87f0f7a838","Type":"ContainerStarted","Data":"7b262f228d46de66349cfd5710212da8dc04ffd99940ac04d7da31185c382d3b"}
Jul 15 18:22:23.902522 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:23.902496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s859k" event={"ID":"ef07a2d6-a664-4afd-8260-9b4396345263","Type":"ContainerStarted","Data":"ada28f279ecc3ce998370599d86b4e2f6f79aa45bd45f71a9c27655f8ac26a24"}
Jul 15 18:22:23.902649 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:23.902553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:23.918314 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:23.918272    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-c757l" podStartSLOduration=1.09691796 podStartE2EDuration="4.918254368s" totalImagesPullingTime="3.821336408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:23.917307958 +0000 UTC m=+329.124571241" watchObservedRunningTime="2026-07-15 18:22:23.918254368 +0000 UTC m=+329.125517654"
Jul 15 18:22:23.934605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:23.934269    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-s859k" podStartSLOduration=1.7053687069999999 podStartE2EDuration="3.934250293s" totalImagesPullingTime="2.228881586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:23.933490115 +0000 UTC m=+329.140753399" watchObservedRunningTime="2026-07-15 18:22:23.934250293 +0000 UTC m=+329.141513577"
Jul 15 18:22:25.466151 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:25.466107    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:22:25.466472 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:25.466179    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:22:25.914249 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:25.914217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn" event={"ID":"49d3a109-2423-41e2-9fe1-03b806bb9492","Type":"ContainerStarted","Data":"173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664"}
Jul 15 18:22:25.914440 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:25.914290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:25.936567 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:25.936518    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn" podStartSLOduration=1.7671072749999999 podStartE2EDuration="5.936502665s" totalImagesPullingTime="4.16939539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:25.934340241 +0000 UTC m=+331.141603525" watchObservedRunningTime="2026-07-15 18:22:25.936502665 +0000 UTC m=+331.143765947"
Jul 15 18:22:26.124832 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.124764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:26.224871 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.224794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:26.404830 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.404797    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"]
Jul 15 18:22:26.408033 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.408010    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.410762 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.410738    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ttrjp\""
Jul 15 18:22:26.422610 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.422540    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"]
Jul 15 18:22:26.466138 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.466109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:26.507484 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507484 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84af7b96-de48-4650-9a32-ecb32ce5c72f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.507959 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.507859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lzcc\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-kube-api-access-8lzcc\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608377 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608377 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608640 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608640 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84af7b96-de48-4650-9a32-ecb32ce5c72f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608640 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608640 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608829 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608829 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lzcc\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-kube-api-access-8lzcc\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.608934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.609035 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.608969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.609150 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.609118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.609251 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.609180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.609442 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.609408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84af7b96-de48-4650-9a32-ecb32ce5c72f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.610988 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.610964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.611260 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.611239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.623351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.623324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:26.623921 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.623895    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lzcc\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-kube-api-access-8lzcc\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.624166 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.624140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-vw5zm\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.718886 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.718856    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:26.753511 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.753471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:26.856570 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.856547    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"]
Jul 15 18:22:26.858956 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:22:26.858923    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84af7b96_de48_4650_9a32_ecb32ce5c72f.slice/crio-655c056b98f333552c8bb3641a1ec9a861ad10b4d9fa2490ffbbeb6902145126 WatchSource:0}: Error finding container 655c056b98f333552c8bb3641a1ec9a861ad10b4d9fa2490ffbbeb6902145126: Status 404 returned error can't find the container with id 655c056b98f333552c8bb3641a1ec9a861ad10b4d9fa2490ffbbeb6902145126
Jul 15 18:22:26.920105 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.920074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" event={"ID":"84af7b96-de48-4650-9a32-ecb32ce5c72f","Type":"ContainerStarted","Data":"655c056b98f333552c8bb3641a1ec9a861ad10b4d9fa2490ffbbeb6902145126"}
Jul 15 18:22:26.921914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:26.921893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:29.871627 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:29.871590    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:22:29.872003 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:29.871677    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:22:29.872003 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:29.871729    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:22:29.938334 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:29.938303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" event={"ID":"84af7b96-de48-4650-9a32-ecb32ce5c72f","Type":"ContainerStarted","Data":"79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728"}
Jul 15 18:22:29.983168 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:29.983108    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" podStartSLOduration=0.973733008 podStartE2EDuration="3.983093456s" totalImagesPullingTime="3.009360448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:29.980307864 +0000 UTC m=+335.187571148" watchObservedRunningTime="2026-07-15 18:22:29.983093456 +0000 UTC m=+335.190356739"
Jul 15 18:22:30.719212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:30.719170    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:30.720782 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:30.720751    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-vw5zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Jul 15 18:22:30.720923 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:30.720803    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Jul 15 18:22:31.421758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.421728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:31.528901 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.528859    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"]
Jul 15 18:22:31.532084 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.532061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.536785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.536763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 18:22:31.536914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.536842    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tkjsq\""
Jul 15 18:22:31.536914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.536882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:31.551274 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.551247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1dbfb8b-f08f-4b65-b082-067f77c37201-cert\") pod \"kserve-controller-manager-d6f4b65b8-q6bd9\" (UID: \"a1dbfb8b-f08f-4b65-b082-067f77c37201\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.551393 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.551305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48kpb\" (UniqueName: \"kubernetes.io/projected/a1dbfb8b-f08f-4b65-b082-067f77c37201-kube-api-access-48kpb\") pod \"kserve-controller-manager-d6f4b65b8-q6bd9\" (UID: \"a1dbfb8b-f08f-4b65-b082-067f77c37201\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.558557 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.558536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"]
Jul 15 18:22:31.561103 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.561080    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"]
Jul 15 18:22:31.564808 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.564789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:31.570494 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.570375    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lktvv\""
Jul 15 18:22:31.572115 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.570954    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 18:22:31.578911 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.578891    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"]
Jul 15 18:22:31.651824 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.651789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1dbfb8b-f08f-4b65-b082-067f77c37201-cert\") pod \"kserve-controller-manager-d6f4b65b8-q6bd9\" (UID: \"a1dbfb8b-f08f-4b65-b082-067f77c37201\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.651824 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.651827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48kpb\" (UniqueName: \"kubernetes.io/projected/a1dbfb8b-f08f-4b65-b082-067f77c37201-kube-api-access-48kpb\") pod \"kserve-controller-manager-d6f4b65b8-q6bd9\" (UID: \"a1dbfb8b-f08f-4b65-b082-067f77c37201\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.652067 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.651863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bb157c4-603f-4f54-be56-18bdacaeef55-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z4k6m\" (UID: \"2bb157c4-603f-4f54-be56-18bdacaeef55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:31.652067 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.651987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72btd\" (UniqueName: \"kubernetes.io/projected/2bb157c4-603f-4f54-be56-18bdacaeef55-kube-api-access-72btd\") pod \"llmisvc-controller-manager-777c6bd7d5-z4k6m\" (UID: \"2bb157c4-603f-4f54-be56-18bdacaeef55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:31.654313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.654289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1dbfb8b-f08f-4b65-b082-067f77c37201-cert\") pod \"kserve-controller-manager-d6f4b65b8-q6bd9\" (UID: \"a1dbfb8b-f08f-4b65-b082-067f77c37201\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.661258 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.661224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:31.662378 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.662348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48kpb\" (UniqueName: \"kubernetes.io/projected/a1dbfb8b-f08f-4b65-b082-067f77c37201-kube-api-access-48kpb\") pod \"kserve-controller-manager-d6f4b65b8-q6bd9\" (UID: \"a1dbfb8b-f08f-4b65-b082-067f77c37201\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.719668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.719601    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-vw5zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Jul 15 18:22:31.719789 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.719663    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Jul 15 18:22:31.753169 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.753136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72btd\" (UniqueName: \"kubernetes.io/projected/2bb157c4-603f-4f54-be56-18bdacaeef55-kube-api-access-72btd\") pod \"llmisvc-controller-manager-777c6bd7d5-z4k6m\" (UID: \"2bb157c4-603f-4f54-be56-18bdacaeef55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:31.753288 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.753230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bb157c4-603f-4f54-be56-18bdacaeef55-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z4k6m\" (UID: \"2bb157c4-603f-4f54-be56-18bdacaeef55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:31.753363 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:22:31.753348    2563 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 15 18:22:31.753477 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:22:31.753451    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb157c4-603f-4f54-be56-18bdacaeef55-cert podName:2bb157c4-603f-4f54-be56-18bdacaeef55 nodeName:}" failed. No retries permitted until 2026-07-15 18:22:32.253405649 +0000 UTC m=+337.460668909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2bb157c4-603f-4f54-be56-18bdacaeef55-cert") pod "llmisvc-controller-manager-777c6bd7d5-z4k6m" (UID: "2bb157c4-603f-4f54-be56-18bdacaeef55") : secret "llmisvc-webhook-server-cert" not found
Jul 15 18:22:31.754008 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.753988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:31.766856 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.766827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72btd\" (UniqueName: \"kubernetes.io/projected/2bb157c4-603f-4f54-be56-18bdacaeef55-kube-api-access-72btd\") pod \"llmisvc-controller-manager-777c6bd7d5-z4k6m\" (UID: \"2bb157c4-603f-4f54-be56-18bdacaeef55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:31.842792 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.842761    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:31.994823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:31.994647    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"]
Jul 15 18:22:31.999811 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:22:31.999780    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dbfb8b_f08f_4b65_b082_067f77c37201.slice/crio-3c6d594a03b39a86d3d0c2fb419bb7ff1389efda3aa53ed944df0cb95b5bc8ec WatchSource:0}: Error finding container 3c6d594a03b39a86d3d0c2fb419bb7ff1389efda3aa53ed944df0cb95b5bc8ec: Status 404 returned error can't find the container with id 3c6d594a03b39a86d3d0c2fb419bb7ff1389efda3aa53ed944df0cb95b5bc8ec
Jul 15 18:22:32.158626 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.158593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:32.257060 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.256973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bb157c4-603f-4f54-be56-18bdacaeef55-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z4k6m\" (UID: \"2bb157c4-603f-4f54-be56-18bdacaeef55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:32.259379 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.259357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bb157c4-603f-4f54-be56-18bdacaeef55-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z4k6m\" (UID: \"2bb157c4-603f-4f54-be56-18bdacaeef55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:32.459306 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.459274    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"]
Jul 15 18:22:32.476652 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.476617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:32.608702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.608680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"]
Jul 15 18:22:32.610978 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:22:32.610950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bb157c4_603f_4f54_be56_18bdacaeef55.slice/crio-90473b1560d4369e9de20d12ce7292aca5a54b8b6539f33f95ba63a4e4ce0f30 WatchSource:0}: Error finding container 90473b1560d4369e9de20d12ce7292aca5a54b8b6539f33f95ba63a4e4ce0f30: Status 404 returned error can't find the container with id 90473b1560d4369e9de20d12ce7292aca5a54b8b6539f33f95ba63a4e4ce0f30
Jul 15 18:22:32.720070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.720036    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-vw5zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Jul 15 18:22:32.720226 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.720097    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Jul 15 18:22:32.796658 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.796570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:32.900822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.900786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:32.952954 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.952919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9" event={"ID":"a1dbfb8b-f08f-4b65-b082-067f77c37201","Type":"ContainerStarted","Data":"3c6d594a03b39a86d3d0c2fb419bb7ff1389efda3aa53ed944df0cb95b5bc8ec"}
Jul 15 18:22:32.953974 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.953953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m" event={"ID":"2bb157c4-603f-4f54-be56-18bdacaeef55","Type":"ContainerStarted","Data":"90473b1560d4369e9de20d12ce7292aca5a54b8b6539f33f95ba63a4e4ce0f30"}
Jul 15 18:22:32.954063 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:32.954006    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerName="istio-proxy" containerID="cri-o://79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728" gracePeriod=30
Jul 15 18:22:33.011572 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:33.011540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:22:34.525943 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.525909    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"]
Jul 15 18:22:34.526300 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.526083    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn" podUID="49d3a109-2423-41e2-9fe1-03b806bb9492" containerName="discovery" containerID="cri-o://173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664" gracePeriod=30
Jul 15 18:22:34.795942 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.795906    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:34.887229 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.887185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-kubeconfig\") pod \"49d3a109-2423-41e2-9fe1-03b806bb9492\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") "
Jul 15 18:22:34.887229 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.887230    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-dns-cert\") pod \"49d3a109-2423-41e2-9fe1-03b806bb9492\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") "
Jul 15 18:22:34.887516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.887261    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-token\") pod \"49d3a109-2423-41e2-9fe1-03b806bb9492\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") "
Jul 15 18:22:34.887516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.887322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-ca-configmap\") pod \"49d3a109-2423-41e2-9fe1-03b806bb9492\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") "
Jul 15 18:22:34.887516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.887353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t29x7\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-kube-api-access-t29x7\") pod \"49d3a109-2423-41e2-9fe1-03b806bb9492\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") "
Jul 15 18:22:34.887516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.887379    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-cacerts\") pod \"49d3a109-2423-41e2-9fe1-03b806bb9492\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") "
Jul 15 18:22:34.887516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.887442    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d3a109-2423-41e2-9fe1-03b806bb9492-local-certs\") pod \"49d3a109-2423-41e2-9fe1-03b806bb9492\" (UID: \"49d3a109-2423-41e2-9fe1-03b806bb9492\") "
Jul 15 18:22:34.888916 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.888880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "49d3a109-2423-41e2-9fe1-03b806bb9492" (UID: "49d3a109-2423-41e2-9fe1-03b806bb9492"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:22:34.892317 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.892272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-cacerts" (OuterVolumeSpecName: "cacerts") pod "49d3a109-2423-41e2-9fe1-03b806bb9492" (UID: "49d3a109-2423-41e2-9fe1-03b806bb9492"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:22:34.892440 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.892321    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-kube-api-access-t29x7" (OuterVolumeSpecName: "kube-api-access-t29x7") pod "49d3a109-2423-41e2-9fe1-03b806bb9492" (UID: "49d3a109-2423-41e2-9fe1-03b806bb9492"). InnerVolumeSpecName "kube-api-access-t29x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:22:34.892838 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.892752    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49d3a109-2423-41e2-9fe1-03b806bb9492-local-certs" (OuterVolumeSpecName: "local-certs") pod "49d3a109-2423-41e2-9fe1-03b806bb9492" (UID: "49d3a109-2423-41e2-9fe1-03b806bb9492"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:22:34.892838 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.892807    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "49d3a109-2423-41e2-9fe1-03b806bb9492" (UID: "49d3a109-2423-41e2-9fe1-03b806bb9492"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:22:34.896068 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.896031    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-token" (OuterVolumeSpecName: "istio-token") pod "49d3a109-2423-41e2-9fe1-03b806bb9492" (UID: "49d3a109-2423-41e2-9fe1-03b806bb9492"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:22:34.896635 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.896606    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "49d3a109-2423-41e2-9fe1-03b806bb9492" (UID: "49d3a109-2423-41e2-9fe1-03b806bb9492"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:22:34.915898 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.915263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-s859k"
Jul 15 18:22:34.970403 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.970293    2563 generic.go:356] "Generic (PLEG): container finished" podID="49d3a109-2423-41e2-9fe1-03b806bb9492" containerID="173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664" exitCode=0
Jul 15 18:22:34.970632 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.970583    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"
Jul 15 18:22:34.970838 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.970786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn" event={"ID":"49d3a109-2423-41e2-9fe1-03b806bb9492","Type":"ContainerDied","Data":"173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664"}
Jul 15 18:22:34.970978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.970937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn" event={"ID":"49d3a109-2423-41e2-9fe1-03b806bb9492","Type":"ContainerDied","Data":"c95e807dcabcd003f997cc7129c20c79c3d21e6aa73e8e217677bbb2b4605aa0"}
Jul 15 18:22:34.971200 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.971069    2563 scope.go:117] "RemoveContainer" containerID="173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664"
Jul 15 18:22:34.989177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.988630    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-ca-configmap\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:34.989177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.988656    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t29x7\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-kube-api-access-t29x7\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:34.989177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.988672    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-cacerts\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:34.989177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.988685    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d3a109-2423-41e2-9fe1-03b806bb9492-local-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:34.989177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.988699    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-kubeconfig\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:34.989177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.988714    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-csr-dns-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:34.989177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:34.988725    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d3a109-2423-41e2-9fe1-03b806bb9492-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:35.013070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:35.013011    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"]
Jul 15 18:22:35.014772 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:35.014749    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8tmn"]
Jul 15 18:22:35.377874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:35.377829    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d3a109-2423-41e2-9fe1-03b806bb9492" path="/var/lib/kubelet/pods/49d3a109-2423-41e2-9fe1-03b806bb9492/volumes"
Jul 15 18:22:35.467379 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:35.467356    2563 scope.go:117] "RemoveContainer" containerID="173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664"
Jul 15 18:22:35.467794 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:22:35.467773    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664\": container with ID starting with 173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664 not found: ID does not exist" containerID="173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664"
Jul 15 18:22:35.467859 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:35.467805    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664"} err="failed to get container status \"173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664\": rpc error: code = NotFound desc = could not find container \"173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664\": container with ID starting with 173bf236c517b6252e85c710de7ccd0c469c9478d8f2716d25f304185f71e664 not found: ID does not exist"
Jul 15 18:22:35.979754 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:35.979710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9" event={"ID":"a1dbfb8b-f08f-4b65-b082-067f77c37201","Type":"ContainerStarted","Data":"140f6c25a9f01adc4d024dfb95d6b97a2cfdd0d5447aaffd363eef37dad351fd"}
Jul 15 18:22:35.980192 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:35.979800    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:22:36.000279 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:36.000225    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9" podStartSLOduration=1.485218274 podStartE2EDuration="5.000208077s" totalImagesPullingTime="3.514989803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:35.998524992 +0000 UTC m=+341.205788277" watchObservedRunningTime="2026-07-15 18:22:36.000208077 +0000 UTC m=+341.207471377"
Jul 15 18:22:36.985344 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:36.985303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m" event={"ID":"2bb157c4-603f-4f54-be56-18bdacaeef55","Type":"ContainerStarted","Data":"b20e249f167a62a9f1d9f2a4daf1eb4c53a04c7b7be17250f39b8ac836a07fb6"}
Jul 15 18:22:36.985916 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:36.985402    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:22:37.001903 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:37.001861    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m" podStartSLOduration=2.413611507 podStartE2EDuration="6.001850629s" totalImagesPullingTime="3.588239122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:37.001495958 +0000 UTC m=+342.208759241" watchObservedRunningTime="2026-07-15 18:22:37.001850629 +0000 UTC m=+342.209113911"
Jul 15 18:22:38.202179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.202156    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:38.316938 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.316917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-podinfo\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.316953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-socket\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.316979    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-data\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-envoy\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317077    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84af7b96-de48-4650-9a32-ecb32ce5c72f-istiod-ca-cert\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-token\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317135    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-certs\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lzcc\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-kube-api-access-8lzcc\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317232    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:22:38.317305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317244    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-credential-socket\") pod \"84af7b96-de48-4650-9a32-ecb32ce5c72f\" (UID: \"84af7b96-de48-4650-9a32-ecb32ce5c72f\") "
Jul 15 18:22:38.317305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317283    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-data" (OuterVolumeSpecName: "istio-data") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:22:38.317647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:22:38.317647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317535    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.317647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317530    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84af7b96-de48-4650-9a32-ecb32ce5c72f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:22:38.317647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317553    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.317647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317567    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.317946 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.317656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:22:38.319407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.319381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-kube-api-access-8lzcc" (OuterVolumeSpecName: "kube-api-access-8lzcc") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "kube-api-access-8lzcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:22:38.319535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.319484    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-token" (OuterVolumeSpecName: "istio-token") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:22:38.319619 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.319593    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:22:38.319619 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.319604    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84af7b96-de48-4650-9a32-ecb32ce5c72f" (UID: "84af7b96-de48-4650-9a32-ecb32ce5c72f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:22:38.418638 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.418606    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.418765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.418643    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84af7b96-de48-4650-9a32-ecb32ce5c72f-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.418765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.418658    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.418765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.418672    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lzcc\" (UniqueName: \"kubernetes.io/projected/84af7b96-de48-4650-9a32-ecb32ce5c72f-kube-api-access-8lzcc\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.418765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.418689    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84af7b96-de48-4650-9a32-ecb32ce5c72f-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.418765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.418705    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84af7b96-de48-4650-9a32-ecb32ce5c72f-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:22:38.995678 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.995621    2563 generic.go:356] "Generic (PLEG): container finished" podID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerID="79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728" exitCode=0
Jul 15 18:22:38.995678 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.995665    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"
Jul 15 18:22:38.995910 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.995712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" event={"ID":"84af7b96-de48-4650-9a32-ecb32ce5c72f","Type":"ContainerDied","Data":"79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728"}
Jul 15 18:22:38.995910 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.995767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm" event={"ID":"84af7b96-de48-4650-9a32-ecb32ce5c72f","Type":"ContainerDied","Data":"655c056b98f333552c8bb3641a1ec9a861ad10b4d9fa2490ffbbeb6902145126"}
Jul 15 18:22:38.995910 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:38.995797    2563 scope.go:117] "RemoveContainer" containerID="79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728"
Jul 15 18:22:39.004753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:39.004736    2563 scope.go:117] "RemoveContainer" containerID="79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728"
Jul 15 18:22:39.004989 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:22:39.004971    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728\": container with ID starting with 79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728 not found: ID does not exist" containerID="79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728"
Jul 15 18:22:39.005063 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:39.005001    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728"} err="failed to get container status \"79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728\": rpc error: code = NotFound desc = could not find container \"79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728\": container with ID starting with 79a0c35b8c9941959189f881215e9b1aaf960c10462bc430a13b34ee7e1d8728 not found: ID does not exist"
Jul 15 18:22:39.034347 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:39.034325    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"]
Jul 15 18:22:39.047706 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:39.047678    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-vw5zm"]
Jul 15 18:22:39.375858 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:22:39.375827    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" path="/var/lib/kubelet/pods/84af7b96-de48-4650-9a32-ecb32ce5c72f/volumes"
Jul 15 18:23:06.990945 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:06.990910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q6bd9"
Jul 15 18:23:07.992698 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:07.992666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z4k6m"
Jul 15 18:23:19.866609 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.866572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:19.956118 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.956084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:19.976575 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.976544    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l99b"]
Jul 15 18:23:19.976839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.976828    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d3a109-2423-41e2-9fe1-03b806bb9492" containerName="discovery"
Jul 15 18:23:19.976879 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.976841    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d3a109-2423-41e2-9fe1-03b806bb9492" containerName="discovery"
Jul 15 18:23:19.976879 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.976854    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerName="istio-proxy"
Jul 15 18:23:19.976879 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.976860    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerName="istio-proxy"
Jul 15 18:23:19.976970 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.976918    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d3a109-2423-41e2-9fe1-03b806bb9492" containerName="discovery"
Jul 15 18:23:19.976970 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.976925    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="84af7b96-de48-4650-9a32-ecb32ce5c72f" containerName="istio-proxy"
Jul 15 18:23:19.979825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.979803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l99b"
Jul 15 18:23:19.982573 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.982552    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 18:23:19.982573 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.982567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 18:23:19.983443 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.983403    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hznpm\""
Jul 15 18:23:19.989335 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:19.989313    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l99b"]
Jul 15 18:23:20.041521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.041490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:20.143566 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.143484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmvps\" (UniqueName: \"kubernetes.io/projected/52ec0f93-a9a1-4210-9152-0f41060ac720-kube-api-access-dmvps\") pod \"kuadrant-operator-catalog-5l99b\" (UID: \"52ec0f93-a9a1-4210-9152-0f41060ac720\") " pod="kuadrant-system/kuadrant-operator-catalog-5l99b"
Jul 15 18:23:20.244929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.244897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvps\" (UniqueName: \"kubernetes.io/projected/52ec0f93-a9a1-4210-9152-0f41060ac720-kube-api-access-dmvps\") pod \"kuadrant-operator-catalog-5l99b\" (UID: \"52ec0f93-a9a1-4210-9152-0f41060ac720\") " pod="kuadrant-system/kuadrant-operator-catalog-5l99b"
Jul 15 18:23:20.253750 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.253723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmvps\" (UniqueName: \"kubernetes.io/projected/52ec0f93-a9a1-4210-9152-0f41060ac720-kube-api-access-dmvps\") pod \"kuadrant-operator-catalog-5l99b\" (UID: \"52ec0f93-a9a1-4210-9152-0f41060ac720\") " pod="kuadrant-system/kuadrant-operator-catalog-5l99b"
Jul 15 18:23:20.289772 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.289750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l99b"
Jul 15 18:23:20.340623 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.340592    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l99b"]
Jul 15 18:23:20.428967 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.428860    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l99b"]
Jul 15 18:23:20.431558 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:20.431532    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ec0f93_a9a1_4210_9152_0f41060ac720.slice/crio-5667e514695c7f01a341aad36bb1de4656c3153eb409fa48fd1b0c8960ed369c WatchSource:0}: Error finding container 5667e514695c7f01a341aad36bb1de4656c3153eb409fa48fd1b0c8960ed369c: Status 404 returned error can't find the container with id 5667e514695c7f01a341aad36bb1de4656c3153eb409fa48fd1b0c8960ed369c
Jul 15 18:23:20.549864 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.549823    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hfz6q"]
Jul 15 18:23:20.554127 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.554112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:20.560324 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.560293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hfz6q"]
Jul 15 18:23:20.751379 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.751293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nm7v\" (UniqueName: \"kubernetes.io/projected/18b9a93c-b3c4-4a88-8418-17d764729260-kube-api-access-6nm7v\") pod \"kuadrant-operator-catalog-hfz6q\" (UID: \"18b9a93c-b3c4-4a88-8418-17d764729260\") " pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:20.775405 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.775363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:20.852299 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.852266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nm7v\" (UniqueName: \"kubernetes.io/projected/18b9a93c-b3c4-4a88-8418-17d764729260-kube-api-access-6nm7v\") pod \"kuadrant-operator-catalog-hfz6q\" (UID: \"18b9a93c-b3c4-4a88-8418-17d764729260\") " pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:20.860279 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.860248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nm7v\" (UniqueName: \"kubernetes.io/projected/18b9a93c-b3c4-4a88-8418-17d764729260-kube-api-access-6nm7v\") pod \"kuadrant-operator-catalog-hfz6q\" (UID: \"18b9a93c-b3c4-4a88-8418-17d764729260\") " pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:20.864172 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.864153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:20.993062 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.993030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:20.994399 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:20.994378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hfz6q"]
Jul 15 18:23:20.995808 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:20.995784    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b9a93c_b3c4_4a88_8418_17d764729260.slice/crio-cb531d43151a107cfea0023b6075bb537bb6fb5032edd2797ed8b30dbc59514d WatchSource:0}: Error finding container cb531d43151a107cfea0023b6075bb537bb6fb5032edd2797ed8b30dbc59514d: Status 404 returned error can't find the container with id cb531d43151a107cfea0023b6075bb537bb6fb5032edd2797ed8b30dbc59514d
Jul 15 18:23:21.191913 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:21.191876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q" event={"ID":"18b9a93c-b3c4-4a88-8418-17d764729260","Type":"ContainerStarted","Data":"cb531d43151a107cfea0023b6075bb537bb6fb5032edd2797ed8b30dbc59514d"}
Jul 15 18:23:21.193069 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:21.193043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l99b" event={"ID":"52ec0f93-a9a1-4210-9152-0f41060ac720","Type":"ContainerStarted","Data":"5667e514695c7f01a341aad36bb1de4656c3153eb409fa48fd1b0c8960ed369c"}
Jul 15 18:23:23.205065 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.205027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l99b" event={"ID":"52ec0f93-a9a1-4210-9152-0f41060ac720","Type":"ContainerStarted","Data":"7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6"}
Jul 15 18:23:23.205536 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.205071    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5l99b" podUID="52ec0f93-a9a1-4210-9152-0f41060ac720" containerName="registry-server" containerID="cri-o://7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6" gracePeriod=2
Jul 15 18:23:23.206658 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.206636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q" event={"ID":"18b9a93c-b3c4-4a88-8418-17d764729260","Type":"ContainerStarted","Data":"dd9a106685e57448cede83dd8f11b15cb29639974cad2c425a113cbecac5ebfa"}
Jul 15 18:23:23.221550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.221511    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5l99b" podStartSLOduration=1.852711855 podStartE2EDuration="4.221497418s" totalImagesPullingTime="2.368785563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:23:23.219223483 +0000 UTC m=+388.426486769" watchObservedRunningTime="2026-07-15 18:23:23.221497418 +0000 UTC m=+388.428760701"
Jul 15 18:23:23.233702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.233667    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q" podStartSLOduration=1.426261367 podStartE2EDuration="3.233657697s" totalImagesPullingTime="1.80739633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:23:23.232591096 +0000 UTC m=+388.439854382" watchObservedRunningTime="2026-07-15 18:23:23.233657697 +0000 UTC m=+388.440920980"
Jul 15 18:23:23.448062 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.448039    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l99b"
Jul 15 18:23:23.472553 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.472487    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmvps\" (UniqueName: \"kubernetes.io/projected/52ec0f93-a9a1-4210-9152-0f41060ac720-kube-api-access-dmvps\") pod \"52ec0f93-a9a1-4210-9152-0f41060ac720\" (UID: \"52ec0f93-a9a1-4210-9152-0f41060ac720\") "
Jul 15 18:23:23.474609 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.474577    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ec0f93-a9a1-4210-9152-0f41060ac720-kube-api-access-dmvps" (OuterVolumeSpecName: "kube-api-access-dmvps") pod "52ec0f93-a9a1-4210-9152-0f41060ac720" (UID: "52ec0f93-a9a1-4210-9152-0f41060ac720"). InnerVolumeSpecName "kube-api-access-dmvps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:23:23.573607 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:23.573577    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmvps\" (UniqueName: \"kubernetes.io/projected/52ec0f93-a9a1-4210-9152-0f41060ac720-kube-api-access-dmvps\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:24.212049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.211955    2563 generic.go:356] "Generic (PLEG): container finished" podID="52ec0f93-a9a1-4210-9152-0f41060ac720" containerID="7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6" exitCode=0
Jul 15 18:23:24.212049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.211993    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l99b"
Jul 15 18:23:24.212049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.212027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l99b" event={"ID":"52ec0f93-a9a1-4210-9152-0f41060ac720","Type":"ContainerDied","Data":"7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6"}
Jul 15 18:23:24.212581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.212073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l99b" event={"ID":"52ec0f93-a9a1-4210-9152-0f41060ac720","Type":"ContainerDied","Data":"5667e514695c7f01a341aad36bb1de4656c3153eb409fa48fd1b0c8960ed369c"}
Jul 15 18:23:24.212581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.212094    2563 scope.go:117] "RemoveContainer" containerID="7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6"
Jul 15 18:23:24.228324 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.228301    2563 scope.go:117] "RemoveContainer" containerID="7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6"
Jul 15 18:23:24.228609 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:23:24.228585    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6\": container with ID starting with 7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6 not found: ID does not exist" containerID="7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6"
Jul 15 18:23:24.228676 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.228616    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6"} err="failed to get container status \"7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6\": rpc error: code = NotFound desc = could not find container \"7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6\": container with ID starting with 7f34307f6e4bb290931f92a4936cdd5badcdf9ffc85a8a44eecd9b1c5fff51d6 not found: ID does not exist"
Jul 15 18:23:24.236748 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.236724    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l99b"]
Jul 15 18:23:24.240195 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:24.240175    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l99b"]
Jul 15 18:23:25.375844 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:25.375809    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52ec0f93-a9a1-4210-9152-0f41060ac720" path="/var/lib/kubelet/pods/52ec0f93-a9a1-4210-9152-0f41060ac720/volumes"
Jul 15 18:23:30.865220 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:30.865186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:30.865751 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:30.865254    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:30.887594 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:30.887563    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:31.266270 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:31.266195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hfz6q"
Jul 15 18:23:35.586096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.586064    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"]
Jul 15 18:23:35.586485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.586359    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ec0f93-a9a1-4210-9152-0f41060ac720" containerName="registry-server"
Jul 15 18:23:35.586485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.586370    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ec0f93-a9a1-4210-9152-0f41060ac720" containerName="registry-server"
Jul 15 18:23:35.586485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.586451    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ec0f93-a9a1-4210-9152-0f41060ac720" containerName="registry-server"
Jul 15 18:23:35.590862 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.590844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.593440 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.593406    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dpmc2\""
Jul 15 18:23:35.599715 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.599692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"]
Jul 15 18:23:35.659586 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.659562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.659719 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.659630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.659719 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.659662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9b4l\" (UniqueName: \"kubernetes.io/projected/85b93b3c-1e22-4523-94ec-9c48f7cee885-kube-api-access-t9b4l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.760836 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.760803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.760987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.760850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9b4l\" (UniqueName: \"kubernetes.io/projected/85b93b3c-1e22-4523-94ec-9c48f7cee885-kube-api-access-t9b4l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.760987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.760896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.761258 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.761237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.761297 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.761248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.768740 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.768714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9b4l\" (UniqueName: \"kubernetes.io/projected/85b93b3c-1e22-4523-94ec-9c48f7cee885-kube-api-access-t9b4l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.900401 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.900321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:35.984310 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:35.982589    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"]
Jul 15 18:23:36.011237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.011203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"]
Jul 15 18:23:36.011387 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.011326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.054091 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.054063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"]
Jul 15 18:23:36.055941 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:36.055907    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b93b3c_1e22_4523_94ec_9c48f7cee885.slice/crio-3976da8afbf9f102c978fb59e1314176e9181ddb4f15ed9df4ee02ae1ee4ef1b WatchSource:0}: Error finding container 3976da8afbf9f102c978fb59e1314176e9181ddb4f15ed9df4ee02ae1ee4ef1b: Status 404 returned error can't find the container with id 3976da8afbf9f102c978fb59e1314176e9181ddb4f15ed9df4ee02ae1ee4ef1b
Jul 15 18:23:36.063921 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.063899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c52wb\" (UniqueName: \"kubernetes.io/projected/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-kube-api-access-c52wb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.064012 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.063955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.064012 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.063999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.164529 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.164417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.164695 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.164553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c52wb\" (UniqueName: \"kubernetes.io/projected/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-kube-api-access-c52wb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.164695 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.164594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.164894 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.164869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.164958 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.164918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.172832 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.172810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c52wb\" (UniqueName: \"kubernetes.io/projected/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-kube-api-access-c52wb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.278129 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.278095    2563 generic.go:356] "Generic (PLEG): container finished" podID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerID="3f0c10fc74c6e47ff532a9497051786d1aa6b88c5d1bae843997c92b47b42fbc" exitCode=0
Jul 15 18:23:36.278319 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.278143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r" event={"ID":"85b93b3c-1e22-4523-94ec-9c48f7cee885","Type":"ContainerDied","Data":"3f0c10fc74c6e47ff532a9497051786d1aa6b88c5d1bae843997c92b47b42fbc"}
Jul 15 18:23:36.278319 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.278200    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r" event={"ID":"85b93b3c-1e22-4523-94ec-9c48f7cee885","Type":"ContainerStarted","Data":"3976da8afbf9f102c978fb59e1314176e9181ddb4f15ed9df4ee02ae1ee4ef1b"}
Jul 15 18:23:36.322028 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.321999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:36.384087 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.384057    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"]
Jul 15 18:23:36.388745 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.388722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.395620 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.395570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"]
Jul 15 18:23:36.453392 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.453371    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"]
Jul 15 18:23:36.455009 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:36.454988    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9e50c3_2e8f_4f70_90ce_9b9a1f0de7dd.slice/crio-442829cbf05fd563c66eac5f1c7b30a5b192699ee091a297720ab0d6254e997f WatchSource:0}: Error finding container 442829cbf05fd563c66eac5f1c7b30a5b192699ee091a297720ab0d6254e997f: Status 404 returned error can't find the container with id 442829cbf05fd563c66eac5f1c7b30a5b192699ee091a297720ab0d6254e997f
Jul 15 18:23:36.467132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.467111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.467234 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.467154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5qn\" (UniqueName: \"kubernetes.io/projected/e1d7c64f-7120-47b3-b617-b093d0f96d16-kube-api-access-dj5qn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.467234 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.467217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.567935 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.567890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5qn\" (UniqueName: \"kubernetes.io/projected/e1d7c64f-7120-47b3-b617-b093d0f96d16-kube-api-access-dj5qn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.568088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.567952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.568088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.568020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.568307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.568289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.568364 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.568317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.576803 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.576786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5qn\" (UniqueName: \"kubernetes.io/projected/e1d7c64f-7120-47b3-b617-b093d0f96d16-kube-api-access-dj5qn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.699287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.699256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:36.789811 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.789787    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"]
Jul 15 18:23:36.794343 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.794321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.805785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.805758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"]
Jul 15 18:23:36.832721 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.832698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"]
Jul 15 18:23:36.867177 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:36.867148    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d7c64f_7120_47b3_b617_b093d0f96d16.slice/crio-170d5f32430fd4b06d40de479f813df56241387b126d7d1539b7c7c04cae3ea6 WatchSource:0}: Error finding container 170d5f32430fd4b06d40de479f813df56241387b126d7d1539b7c7c04cae3ea6: Status 404 returned error can't find the container with id 170d5f32430fd4b06d40de479f813df56241387b126d7d1539b7c7c04cae3ea6
Jul 15 18:23:36.870141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.870121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmgc\" (UniqueName: \"kubernetes.io/projected/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-kube-api-access-2rmgc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.870219 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.870179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.870336 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.870317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.970991 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.970961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.971102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.971035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.971102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.971077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmgc\" (UniqueName: \"kubernetes.io/projected/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-kube-api-access-2rmgc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.971316 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.971295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.971383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.971359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:36.979488 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:36.979463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmgc\" (UniqueName: \"kubernetes.io/projected/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-kube-api-access-2rmgc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:37.106377 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.106352    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:37.243277 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.243249    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"]
Jul 15 18:23:37.245040 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:37.245016    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2f2dc6_5e20_4f33_a36d_feaa5dcfc58d.slice/crio-e166616c2ac6333847e23c81e310216fe69200d319e5c5a5ffa977bbf5079640 WatchSource:0}: Error finding container e166616c2ac6333847e23c81e310216fe69200d319e5c5a5ffa977bbf5079640: Status 404 returned error can't find the container with id e166616c2ac6333847e23c81e310216fe69200d319e5c5a5ffa977bbf5079640
Jul 15 18:23:37.285004 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.284967    2563 generic.go:356] "Generic (PLEG): container finished" podID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerID="ce76a9646ffea9bf1e5c39af6e161899a0d4ccc3425c3ffbb837ce065922cb6f" exitCode=0
Jul 15 18:23:37.285099 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.285050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r" event={"ID":"85b93b3c-1e22-4523-94ec-9c48f7cee885","Type":"ContainerDied","Data":"ce76a9646ffea9bf1e5c39af6e161899a0d4ccc3425c3ffbb837ce065922cb6f"}
Jul 15 18:23:37.286862 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.286817    2563 generic.go:356] "Generic (PLEG): container finished" podID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerID="8c788a17f9e9e80ff70a89abd49a3c9dc0c04ae13438fa8af9c50c563f903792" exitCode=0
Jul 15 18:23:37.286962 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.286899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964" event={"ID":"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd","Type":"ContainerDied","Data":"8c788a17f9e9e80ff70a89abd49a3c9dc0c04ae13438fa8af9c50c563f903792"}
Jul 15 18:23:37.286962 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.286947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964" event={"ID":"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd","Type":"ContainerStarted","Data":"442829cbf05fd563c66eac5f1c7b30a5b192699ee091a297720ab0d6254e997f"}
Jul 15 18:23:37.288362 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.288336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7" event={"ID":"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d","Type":"ContainerStarted","Data":"e166616c2ac6333847e23c81e310216fe69200d319e5c5a5ffa977bbf5079640"}
Jul 15 18:23:37.290015 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.289991    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerID="8229d3975ecbf2b1dbfe7335d6bd1607b76fb60c629e20928e2fcfb7ff67df46" exitCode=0
Jul 15 18:23:37.290128 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.290026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n" event={"ID":"e1d7c64f-7120-47b3-b617-b093d0f96d16","Type":"ContainerDied","Data":"8229d3975ecbf2b1dbfe7335d6bd1607b76fb60c629e20928e2fcfb7ff67df46"}
Jul 15 18:23:37.290128 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:37.290062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n" event={"ID":"e1d7c64f-7120-47b3-b617-b093d0f96d16","Type":"ContainerStarted","Data":"170d5f32430fd4b06d40de479f813df56241387b126d7d1539b7c7c04cae3ea6"}
Jul 15 18:23:38.297072 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.296995    2563 generic.go:356] "Generic (PLEG): container finished" podID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerID="ee24e069b9ca796512bb6196e876c9db2255d91c4930307374192793edb22a64" exitCode=0
Jul 15 18:23:38.297518 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.297090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964" event={"ID":"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd","Type":"ContainerDied","Data":"ee24e069b9ca796512bb6196e876c9db2255d91c4930307374192793edb22a64"}
Jul 15 18:23:38.298708 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.298684    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerID="5a42dcaf498302f773577d10e418a0ef3ba790b08305028cf3522ac63633465c" exitCode=0
Jul 15 18:23:38.298828 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.298770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7" event={"ID":"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d","Type":"ContainerDied","Data":"5a42dcaf498302f773577d10e418a0ef3ba790b08305028cf3522ac63633465c"}
Jul 15 18:23:38.300731 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.300710    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerID="95ffb198d2fd408264bf2c4706aee689b89082fdac9a33917ee5a8ced85e0f11" exitCode=0
Jul 15 18:23:38.300846 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.300807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n" event={"ID":"e1d7c64f-7120-47b3-b617-b093d0f96d16","Type":"ContainerDied","Data":"95ffb198d2fd408264bf2c4706aee689b89082fdac9a33917ee5a8ced85e0f11"}
Jul 15 18:23:38.303176 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.303082    2563 generic.go:356] "Generic (PLEG): container finished" podID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerID="6f9a710e9ec18cfbbdffbbbf5b46d040edabd3d15f0813a7e9e638c6a26e1c27" exitCode=0
Jul 15 18:23:38.303176 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:38.303107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r" event={"ID":"85b93b3c-1e22-4523-94ec-9c48f7cee885","Type":"ContainerDied","Data":"6f9a710e9ec18cfbbdffbbbf5b46d040edabd3d15f0813a7e9e638c6a26e1c27"}
Jul 15 18:23:39.309533 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.309497    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerID="a511b1150433dd544ec656ee044e797c1c6b4aece423d63f48eb53f1c05b4c33" exitCode=0
Jul 15 18:23:39.309977 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.309553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7" event={"ID":"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d","Type":"ContainerDied","Data":"a511b1150433dd544ec656ee044e797c1c6b4aece423d63f48eb53f1c05b4c33"}
Jul 15 18:23:39.311850 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.311827    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerID="00a8dcba01cb8161edb7db5f70b7f4aaa23916a4b6bbeaf0b5a2c5b062115592" exitCode=0
Jul 15 18:23:39.311965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.311915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n" event={"ID":"e1d7c64f-7120-47b3-b617-b093d0f96d16","Type":"ContainerDied","Data":"00a8dcba01cb8161edb7db5f70b7f4aaa23916a4b6bbeaf0b5a2c5b062115592"}
Jul 15 18:23:39.313825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.313804    2563 generic.go:356] "Generic (PLEG): container finished" podID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerID="af3dc3c05df7c71db1a8e316acde0e8ebc3c5ed04bf1161e2677719db4bd5fb8" exitCode=0
Jul 15 18:23:39.313927 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.313880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964" event={"ID":"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd","Type":"ContainerDied","Data":"af3dc3c05df7c71db1a8e316acde0e8ebc3c5ed04bf1161e2677719db4bd5fb8"}
Jul 15 18:23:39.448485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.448461    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:39.495405 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.495373    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9b4l\" (UniqueName: \"kubernetes.io/projected/85b93b3c-1e22-4523-94ec-9c48f7cee885-kube-api-access-t9b4l\") pod \"85b93b3c-1e22-4523-94ec-9c48f7cee885\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") "
Jul 15 18:23:39.495542 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.495454    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-util\") pod \"85b93b3c-1e22-4523-94ec-9c48f7cee885\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") "
Jul 15 18:23:39.495583 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.495549    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-bundle\") pod \"85b93b3c-1e22-4523-94ec-9c48f7cee885\" (UID: \"85b93b3c-1e22-4523-94ec-9c48f7cee885\") "
Jul 15 18:23:39.496008 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.495982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-bundle" (OuterVolumeSpecName: "bundle") pod "85b93b3c-1e22-4523-94ec-9c48f7cee885" (UID: "85b93b3c-1e22-4523-94ec-9c48f7cee885"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:39.497372 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.497344    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b93b3c-1e22-4523-94ec-9c48f7cee885-kube-api-access-t9b4l" (OuterVolumeSpecName: "kube-api-access-t9b4l") pod "85b93b3c-1e22-4523-94ec-9c48f7cee885" (UID: "85b93b3c-1e22-4523-94ec-9c48f7cee885"). InnerVolumeSpecName "kube-api-access-t9b4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:23:39.501017 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.500986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-util" (OuterVolumeSpecName: "util") pod "85b93b3c-1e22-4523-94ec-9c48f7cee885" (UID: "85b93b3c-1e22-4523-94ec-9c48f7cee885"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:39.596852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.596821    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9b4l\" (UniqueName: \"kubernetes.io/projected/85b93b3c-1e22-4523-94ec-9c48f7cee885-kube-api-access-t9b4l\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:39.596852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.596847    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-util\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:39.596852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:39.596859    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b93b3c-1e22-4523-94ec-9c48f7cee885-bundle\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:40.320459 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.320406    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerID="e6227a743d3bb7bb81222d6d7e1740561a1319894792cb9cdded15026e658325" exitCode=0
Jul 15 18:23:40.320893 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.320488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7" event={"ID":"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d","Type":"ContainerDied","Data":"e6227a743d3bb7bb81222d6d7e1740561a1319894792cb9cdded15026e658325"}
Jul 15 18:23:40.322266 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.322250    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r"
Jul 15 18:23:40.322375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.322272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r" event={"ID":"85b93b3c-1e22-4523-94ec-9c48f7cee885","Type":"ContainerDied","Data":"3976da8afbf9f102c978fb59e1314176e9181ddb4f15ed9df4ee02ae1ee4ef1b"}
Jul 15 18:23:40.322375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.322313    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3976da8afbf9f102c978fb59e1314176e9181ddb4f15ed9df4ee02ae1ee4ef1b"
Jul 15 18:23:40.457486 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.457462    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:40.485630 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.485604    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:40.504877 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.504854    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c52wb\" (UniqueName: \"kubernetes.io/projected/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-kube-api-access-c52wb\") pod \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") "
Jul 15 18:23:40.505030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.504910    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-util\") pod \"e1d7c64f-7120-47b3-b617-b093d0f96d16\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") "
Jul 15 18:23:40.505030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.504937    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-bundle\") pod \"e1d7c64f-7120-47b3-b617-b093d0f96d16\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") "
Jul 15 18:23:40.505030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.504979    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj5qn\" (UniqueName: \"kubernetes.io/projected/e1d7c64f-7120-47b3-b617-b093d0f96d16-kube-api-access-dj5qn\") pod \"e1d7c64f-7120-47b3-b617-b093d0f96d16\" (UID: \"e1d7c64f-7120-47b3-b617-b093d0f96d16\") "
Jul 15 18:23:40.505187 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.505048    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-bundle\") pod \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") "
Jul 15 18:23:40.505187 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.505099    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-util\") pod \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\" (UID: \"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd\") "
Jul 15 18:23:40.506137 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.506097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-bundle" (OuterVolumeSpecName: "bundle") pod "e1d7c64f-7120-47b3-b617-b093d0f96d16" (UID: "e1d7c64f-7120-47b3-b617-b093d0f96d16"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:40.506409 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.506366    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-bundle" (OuterVolumeSpecName: "bundle") pod "0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" (UID: "0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:40.507372 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.507337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-kube-api-access-c52wb" (OuterVolumeSpecName: "kube-api-access-c52wb") pod "0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" (UID: "0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd"). InnerVolumeSpecName "kube-api-access-c52wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:23:40.507528 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.507503    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d7c64f-7120-47b3-b617-b093d0f96d16-kube-api-access-dj5qn" (OuterVolumeSpecName: "kube-api-access-dj5qn") pod "e1d7c64f-7120-47b3-b617-b093d0f96d16" (UID: "e1d7c64f-7120-47b3-b617-b093d0f96d16"). InnerVolumeSpecName "kube-api-access-dj5qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:23:40.512678 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.512653    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-util" (OuterVolumeSpecName: "util") pod "0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" (UID: "0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:40.513689 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.513666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-util" (OuterVolumeSpecName: "util") pod "e1d7c64f-7120-47b3-b617-b093d0f96d16" (UID: "e1d7c64f-7120-47b3-b617-b093d0f96d16"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:40.606357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.606269    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-util\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:40.606357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.606300    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d7c64f-7120-47b3-b617-b093d0f96d16-bundle\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:40.606357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.606313    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj5qn\" (UniqueName: \"kubernetes.io/projected/e1d7c64f-7120-47b3-b617-b093d0f96d16-kube-api-access-dj5qn\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:40.606357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.606326    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-bundle\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:40.606357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.606337    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-util\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:40.606357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:40.606349    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c52wb\" (UniqueName: \"kubernetes.io/projected/0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd-kube-api-access-c52wb\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:41.328831 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.328799    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964"
Jul 15 18:23:41.329244 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.328800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964" event={"ID":"0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd","Type":"ContainerDied","Data":"442829cbf05fd563c66eac5f1c7b30a5b192699ee091a297720ab0d6254e997f"}
Jul 15 18:23:41.329244 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.328902    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="442829cbf05fd563c66eac5f1c7b30a5b192699ee091a297720ab0d6254e997f"
Jul 15 18:23:41.330814 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.330791    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n"
Jul 15 18:23:41.330932 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.330810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n" event={"ID":"e1d7c64f-7120-47b3-b617-b093d0f96d16","Type":"ContainerDied","Data":"170d5f32430fd4b06d40de479f813df56241387b126d7d1539b7c7c04cae3ea6"}
Jul 15 18:23:41.330932 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.330845    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="170d5f32430fd4b06d40de479f813df56241387b126d7d1539b7c7c04cae3ea6"
Jul 15 18:23:41.456924 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.456901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:41.463280 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.463260    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:41.514863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.514842    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rmgc\" (UniqueName: \"kubernetes.io/projected/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-kube-api-access-2rmgc\") pod \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") "
Jul 15 18:23:41.514978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.514875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-util\") pod \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") "
Jul 15 18:23:41.514978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.514898    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-bundle\") pod \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\" (UID: \"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d\") "
Jul 15 18:23:41.515370 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.515348    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-bundle" (OuterVolumeSpecName: "bundle") pod "4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" (UID: "4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:41.516919 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.516890    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-kube-api-access-2rmgc" (OuterVolumeSpecName: "kube-api-access-2rmgc") pod "4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" (UID: "4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d"). InnerVolumeSpecName "kube-api-access-2rmgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:23:41.519726 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.519704    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-util" (OuterVolumeSpecName: "util") pod "4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" (UID: "4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:23:41.521172 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.521110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:41.615917 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.615854    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rmgc\" (UniqueName: \"kubernetes.io/projected/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-kube-api-access-2rmgc\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:41.615917 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.615878    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-util\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:41.615917 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:41.615887    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d-bundle\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:23:42.337917 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:42.337890    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7"
Jul 15 18:23:42.337917 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:42.337912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7" event={"ID":"4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d","Type":"ContainerDied","Data":"e166616c2ac6333847e23c81e310216fe69200d319e5c5a5ffa977bbf5079640"}
Jul 15 18:23:42.338467 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:42.337952    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e166616c2ac6333847e23c81e310216fe69200d319e5c5a5ffa977bbf5079640"
Jul 15 18:23:48.423963 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:48.423896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:51.878220 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:51.878154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:52.184150 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:52.184052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:53.231378 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231347    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"]
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231668    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerName="extract"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231681    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerName="extract"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231696    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerName="pull"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231701    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerName="pull"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231712    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerName="extract"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231718    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerName="extract"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231725    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerName="util"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231731    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerName="util"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231737    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerName="util"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231742    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerName="util"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231748    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerName="util"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231753    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerName="util"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231759    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerName="pull"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231763    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerName="pull"
Jul 15 18:23:53.231759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231768    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerName="pull"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231773    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerName="pull"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231779    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerName="pull"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231784    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerName="pull"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231790    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerName="util"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231795    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerName="util"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231801    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerName="extract"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231805    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerName="extract"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231814    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerName="extract"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231818    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerName="extract"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231889    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b93b3c-1e22-4523-94ec-9c48f7cee885" containerName="extract"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231896    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d7c64f-7120-47b3-b617-b093d0f96d16" containerName="extract"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231902    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd" containerName="extract"
Jul 15 18:23:53.232255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.231906    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d" containerName="extract"
Jul 15 18:23:53.234843 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.234827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.238123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.238101    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7p4cx\""
Jul 15 18:23:53.248561 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.248540    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"]
Jul 15 18:23:53.304106 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.304075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20cba5b7-017c-450b-98c1-23d10b5cdfa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.304106 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.304105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj4jp\" (UniqueName: \"kubernetes.io/projected/20cba5b7-017c-450b-98c1-23d10b5cdfa2-kube-api-access-tj4jp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.404518 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.404489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20cba5b7-017c-450b-98c1-23d10b5cdfa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.404518 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.404519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj4jp\" (UniqueName: \"kubernetes.io/projected/20cba5b7-017c-450b-98c1-23d10b5cdfa2-kube-api-access-tj4jp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.404843 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.404825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20cba5b7-017c-450b-98c1-23d10b5cdfa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.415901 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.415881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj4jp\" (UniqueName: \"kubernetes.io/projected/20cba5b7-017c-450b-98c1-23d10b5cdfa2-kube-api-access-tj4jp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.437925 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.437902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:53.544938 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.544878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:23:53.681184 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.681163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"]
Jul 15 18:23:53.683493 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:53.683465    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20cba5b7_017c_450b_98c1_23d10b5cdfa2.slice/crio-30d8f4512a2e3c64ee02ddd68584211e8315a2b3310f6e488ba1dcbfb65228c4 WatchSource:0}: Error finding container 30d8f4512a2e3c64ee02ddd68584211e8315a2b3310f6e488ba1dcbfb65228c4: Status 404 returned error can't find the container with id 30d8f4512a2e3c64ee02ddd68584211e8315a2b3310f6e488ba1dcbfb65228c4
Jul 15 18:23:53.824993 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:53.824967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:54.396362 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:54.396329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s" event={"ID":"20cba5b7-017c-450b-98c1-23d10b5cdfa2","Type":"ContainerStarted","Data":"30d8f4512a2e3c64ee02ddd68584211e8315a2b3310f6e488ba1dcbfb65228c4"}
Jul 15 18:23:54.869265 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:54.869212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:55.771240 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:55.771206    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"]
Jul 15 18:23:55.775624 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:55.775605    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"
Jul 15 18:23:55.778155 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:55.778136    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jfmkh\""
Jul 15 18:23:55.785882 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:55.785861    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"]
Jul 15 18:23:55.825796 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:55.825769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbkr\" (UniqueName: \"kubernetes.io/projected/5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d-kube-api-access-vvbkr\") pod \"authorino-operator-75cc8d5cb7-nvxvq\" (UID: \"5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"
Jul 15 18:23:55.927079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:55.927053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbkr\" (UniqueName: \"kubernetes.io/projected/5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d-kube-api-access-vvbkr\") pod \"authorino-operator-75cc8d5cb7-nvxvq\" (UID: \"5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"
Jul 15 18:23:55.939407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:55.939385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbkr\" (UniqueName: \"kubernetes.io/projected/5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d-kube-api-access-vvbkr\") pod \"authorino-operator-75cc8d5cb7-nvxvq\" (UID: \"5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"
Jul 15 18:23:56.085907 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:56.085884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"
Jul 15 18:23:56.228349 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:56.228323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"]
Jul 15 18:23:56.230504 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:56.230477    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5277eb50_cd7c_4d3b_b8c3_dbc2ece08b0d.slice/crio-07d72d5908c81f98d78b772805b5c3dea3a14aad328ae97c98b750c3a2ae4b82 WatchSource:0}: Error finding container 07d72d5908c81f98d78b772805b5c3dea3a14aad328ae97c98b750c3a2ae4b82: Status 404 returned error can't find the container with id 07d72d5908c81f98d78b772805b5c3dea3a14aad328ae97c98b750c3a2ae4b82
Jul 15 18:23:56.406317 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:56.406241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq" event={"ID":"5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d","Type":"ContainerStarted","Data":"07d72d5908c81f98d78b772805b5c3dea3a14aad328ae97c98b750c3a2ae4b82"}
Jul 15 18:23:56.445092 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:56.445062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:56.539485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:56.539457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:58.071771 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.071742    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"]
Jul 15 18:23:58.081694 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.081672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"
Jul 15 18:23:58.084085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.084063    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 18:23:58.084325 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.084310    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j2bqg\""
Jul 15 18:23:58.088746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.088690    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"]
Jul 15 18:23:58.145643 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.145612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kldk2\" (UniqueName: \"kubernetes.io/projected/dabe02e8-08d8-4093-9351-10b76f92272d-kube-api-access-kldk2\") pod \"dns-operator-controller-manager-864dd78c4c-2v65s\" (UID: \"dabe02e8-08d8-4093-9351-10b76f92272d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"
Jul 15 18:23:58.246619 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.246587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kldk2\" (UniqueName: \"kubernetes.io/projected/dabe02e8-08d8-4093-9351-10b76f92272d-kube-api-access-kldk2\") pod \"dns-operator-controller-manager-864dd78c4c-2v65s\" (UID: \"dabe02e8-08d8-4093-9351-10b76f92272d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"
Jul 15 18:23:58.259222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.259190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kldk2\" (UniqueName: \"kubernetes.io/projected/dabe02e8-08d8-4093-9351-10b76f92272d-kube-api-access-kldk2\") pod \"dns-operator-controller-manager-864dd78c4c-2v65s\" (UID: \"dabe02e8-08d8-4093-9351-10b76f92272d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"
Jul 15 18:23:58.395212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.395146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"
Jul 15 18:23:58.632018 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.631979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:23:58.804199 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:58.804159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"]
Jul 15 18:23:58.810507 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:23:58.810483    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabe02e8_08d8_4093_9351_10b76f92272d.slice/crio-51722105d09a4d14e26eb59c5bf3fb33454f9a72fc4ab783da83e31e26a6a6dd WatchSource:0}: Error finding container 51722105d09a4d14e26eb59c5bf3fb33454f9a72fc4ab783da83e31e26a6a6dd: Status 404 returned error can't find the container with id 51722105d09a4d14e26eb59c5bf3fb33454f9a72fc4ab783da83e31e26a6a6dd
Jul 15 18:23:59.423807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:59.423763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s" event={"ID":"dabe02e8-08d8-4093-9351-10b76f92272d","Type":"ContainerStarted","Data":"51722105d09a4d14e26eb59c5bf3fb33454f9a72fc4ab783da83e31e26a6a6dd"}
Jul 15 18:23:59.425709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:59.425679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq" event={"ID":"5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d","Type":"ContainerStarted","Data":"25bac5206ae731935fd7a8a0c2a000ad285cfe577dfd9fdcfcd4bdd2c2cd4807"}
Jul 15 18:23:59.425834 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:59.425818    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"
Jul 15 18:23:59.445208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:23:59.445157    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq" podStartSLOduration=1.9600429369999999 podStartE2EDuration="4.445141486s" totalImagesPullingTime="2.485098549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:23:59.442779604 +0000 UTC m=+424.650042888" watchObservedRunningTime="2026-07-15 18:23:59.445141486 +0000 UTC m=+424.652404769"
Jul 15 18:24:00.082605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.082566    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"]
Jul 15 18:24:00.086629 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.086603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:00.089085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.089059    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jpt5r\""
Jul 15 18:24:00.094699 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.094640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"]
Jul 15 18:24:00.163345 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.163316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc5gl\" (UniqueName: \"kubernetes.io/projected/1559b84f-a9e7-4b47-aba4-11de508c7822-kube-api-access-tc5gl\") pod \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" (UID: \"1559b84f-a9e7-4b47-aba4-11de508c7822\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:00.264765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.264734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc5gl\" (UniqueName: \"kubernetes.io/projected/1559b84f-a9e7-4b47-aba4-11de508c7822-kube-api-access-tc5gl\") pod \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" (UID: \"1559b84f-a9e7-4b47-aba4-11de508c7822\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:00.277865 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.277842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc5gl\" (UniqueName: \"kubernetes.io/projected/1559b84f-a9e7-4b47-aba4-11de508c7822-kube-api-access-tc5gl\") pod \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" (UID: \"1559b84f-a9e7-4b47-aba4-11de508c7822\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:00.400452 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.400365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:00.486803 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.486776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:00.577826 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:00.577806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"]
Jul 15 18:24:00.579776 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:24:00.579751    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1559b84f_a9e7_4b47_aba4_11de508c7822.slice/crio-0b15432059944b28f0d2583831664ac836799c6654f5654751ba855e4baf40d1 WatchSource:0}: Error finding container 0b15432059944b28f0d2583831664ac836799c6654f5654751ba855e4baf40d1: Status 404 returned error can't find the container with id 0b15432059944b28f0d2583831664ac836799c6654f5654751ba855e4baf40d1
Jul 15 18:24:01.440452 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:01.440392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s" event={"ID":"20cba5b7-017c-450b-98c1-23d10b5cdfa2","Type":"ContainerStarted","Data":"1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7"}
Jul 15 18:24:01.440616 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:01.440482    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:01.441634 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:01.441606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n" event={"ID":"1559b84f-a9e7-4b47-aba4-11de508c7822","Type":"ContainerStarted","Data":"0b15432059944b28f0d2583831664ac836799c6654f5654751ba855e4baf40d1"}
Jul 15 18:24:01.464203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:01.464158    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s" podStartSLOduration=1.639502061 podStartE2EDuration="8.464145013s" totalImagesPullingTime="6.824642952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:01.461130976 +0000 UTC m=+426.668394260" watchObservedRunningTime="2026-07-15 18:24:01.464145013 +0000 UTC m=+426.671408295"
Jul 15 18:24:02.232738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:02.232711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:02.339660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:02.339629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:02.451211 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:02.450716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s" event={"ID":"dabe02e8-08d8-4093-9351-10b76f92272d","Type":"ContainerStarted","Data":"0f41a8840945242266660c54f37a31c2525703e409630915db63d9a90ec31949"}
Jul 15 18:24:02.451211 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:02.450891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"
Jul 15 18:24:02.469712 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:02.469648    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s" podStartSLOduration=1.130744972 podStartE2EDuration="4.46963053s" totalImagesPullingTime="3.338885558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:02.469302614 +0000 UTC m=+427.676565896" watchObservedRunningTime="2026-07-15 18:24:02.46963053 +0000 UTC m=+427.676893813"
Jul 15 18:24:03.384645 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.384617    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"]
Jul 15 18:24:03.388394 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.388372    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.390932 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.390899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 18:24:03.391036 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.390902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 18:24:03.391036 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.390904    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dpmc2\""
Jul 15 18:24:03.397375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.397353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:03.397854 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.397836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"]
Jul 15 18:24:03.457755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.457730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n" event={"ID":"1559b84f-a9e7-4b47-aba4-11de508c7822","Type":"ContainerStarted","Data":"1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7"}
Jul 15 18:24:03.474677 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.474636    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n" podStartSLOduration=1.4091058890000001 podStartE2EDuration="3.474622137s" totalImagesPullingTime="2.065516248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:03.473564206 +0000 UTC m=+428.680827489" watchObservedRunningTime="2026-07-15 18:24:03.474622137 +0000 UTC m=+428.681885419"
Jul 15 18:24:03.492177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.492154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/565896c9-203e-4dd0-af9e-976276ab1e62-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.492278 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.492233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/565896c9-203e-4dd0-af9e-976276ab1e62-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.492506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.492339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9jjj\" (UniqueName: \"kubernetes.io/projected/565896c9-203e-4dd0-af9e-976276ab1e62-kube-api-access-z9jjj\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.519875 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.519850    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:03.593193 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.593176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/565896c9-203e-4dd0-af9e-976276ab1e62-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.593293 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.593201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9jjj\" (UniqueName: \"kubernetes.io/projected/565896c9-203e-4dd0-af9e-976276ab1e62-kube-api-access-z9jjj\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.593293 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.593280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/565896c9-203e-4dd0-af9e-976276ab1e62-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.594110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.594090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/565896c9-203e-4dd0-af9e-976276ab1e62-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.595688 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.595671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/565896c9-203e-4dd0-af9e-976276ab1e62-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.600546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.600530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9jjj\" (UniqueName: \"kubernetes.io/projected/565896c9-203e-4dd0-af9e-976276ab1e62-kube-api-access-z9jjj\") pod \"kuadrant-console-plugin-66b5774985-fsc77\" (UID: \"565896c9-203e-4dd0-af9e-976276ab1e62\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.698570 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.698516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"
Jul 15 18:24:03.828155 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:03.828131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77"]
Jul 15 18:24:03.830080 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:24:03.830043    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod565896c9_203e_4dd0_af9e_976276ab1e62.slice/crio-766cb4f1f64880073401ff47c8cd38cccb9efddceaaa2e2e420b890bb40c0f6d WatchSource:0}: Error finding container 766cb4f1f64880073401ff47c8cd38cccb9efddceaaa2e2e420b890bb40c0f6d: Status 404 returned error can't find the container with id 766cb4f1f64880073401ff47c8cd38cccb9efddceaaa2e2e420b890bb40c0f6d
Jul 15 18:24:04.464166 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:04.464126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77" event={"ID":"565896c9-203e-4dd0-af9e-976276ab1e62","Type":"ContainerStarted","Data":"766cb4f1f64880073401ff47c8cd38cccb9efddceaaa2e2e420b890bb40c0f6d"}
Jul 15 18:24:04.464559 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:04.464342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:05.797177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:05.797146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:05.896093 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:05.896068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:07.536977 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:07.536941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:07.594846 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:07.594806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:10.434371 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:10.434338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvxvq"
Jul 15 18:24:11.450876 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:11.450790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:11.550800 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:11.550770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:12.454008 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:12.453971    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:13.460822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:13.460781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2v65s"
Jul 15 18:24:13.978083 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:13.978045    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:14.245811 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.245725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:14.397219 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.397184    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"]
Jul 15 18:24:14.397466 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.397395    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" containerName="manager" containerID="cri-o://1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7" gracePeriod=2
Jul 15 18:24:14.410982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.410924    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"]
Jul 15 18:24:14.425479 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.425444    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"]
Jul 15 18:24:14.425987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.425658    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" containerName="manager" containerID="cri-o://1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7" gracePeriod=2
Jul 15 18:24:14.428211 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.428141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:14.428724 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:14.428688    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:14.432834 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:14.432806    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:14.433584 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.433536    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"]
Jul 15 18:24:14.435116 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:14.435093    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:14.437144 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:14.437112    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:14.459871 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.459842    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"]
Jul 15 18:24:14.460380 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.460360    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" containerName="manager"
Jul 15 18:24:14.460535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.460383    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" containerName="manager"
Jul 15 18:24:14.460535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.460437    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" containerName="manager"
Jul 15 18:24:14.460535 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.460447    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" containerName="manager"
Jul 15 18:24:14.460662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.460547    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" containerName="manager"
Jul 15 18:24:14.460662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.460565    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" containerName="manager"
Jul 15 18:24:14.465393 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.465375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"
Jul 15 18:24:14.470659 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:14.470629    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:14.474247 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:14.474210    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:14.475381 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.475355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"]
Jul 15 18:24:14.584882 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.584840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlhc\" (UniqueName: \"kubernetes.io/projected/185483cf-c424-4421-8027-78dbfd2ecbba-kube-api-access-xmlhc\") pod \"limitador-operator-controller-manager-859d7b78bd-xpshs\" (UID: \"185483cf-c424-4421-8027-78dbfd2ecbba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"
Jul 15 18:24:14.685754 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.685720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlhc\" (UniqueName: \"kubernetes.io/projected/185483cf-c424-4421-8027-78dbfd2ecbba-kube-api-access-xmlhc\") pod \"limitador-operator-controller-manager-859d7b78bd-xpshs\" (UID: \"185483cf-c424-4421-8027-78dbfd2ecbba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"
Jul 15 18:24:14.711098 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.711069    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlhc\" (UniqueName: \"kubernetes.io/projected/185483cf-c424-4421-8027-78dbfd2ecbba-kube-api-access-xmlhc\") pod \"limitador-operator-controller-manager-859d7b78bd-xpshs\" (UID: \"185483cf-c424-4421-8027-78dbfd2ecbba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"
Jul 15 18:24:14.823015 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:14.822989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"
Jul 15 18:24:15.082694 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.082610    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"]
Jul 15 18:24:15.090063 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.090041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:15.102979 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.102953    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"]
Jul 15 18:24:15.120713 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:15.120672    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:15.123616 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:15.123564    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:15.190210 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.190183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwnq\" (UniqueName: \"kubernetes.io/projected/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-kube-api-access-7mwnq\") pod \"kuadrant-operator-controller-manager-86878c769f-xh8zf\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:15.190328 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.190225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xh8zf\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:15.290898 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.290866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwnq\" (UniqueName: \"kubernetes.io/projected/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-kube-api-access-7mwnq\") pod \"kuadrant-operator-controller-manager-86878c769f-xh8zf\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:15.291042 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.290906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xh8zf\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:15.291310 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.291289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xh8zf\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:15.299110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.299085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwnq\" (UniqueName: \"kubernetes.io/projected/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-kube-api-access-7mwnq\") pod \"kuadrant-operator-controller-manager-86878c769f-xh8zf\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:15.377007 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:15.376933    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:15.378917 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:15.378883    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:15.402266 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:15.402245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:18.637228 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:18.637155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:18.741642 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:18.741599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:22.443056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:22.443016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:22.514356 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:22.514322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:26.479742 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.479709    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:26.483198 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.482369    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:26.494563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.494525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"]
Jul 15 18:24:26.498185 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:24:26.497996    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec22ba52_9ce5_4aec_8103_c7668dfb58d7.slice/crio-a2f9fded54ba7787dc7656934df4bf440445229c600aa19b4d7fa358216042f0 WatchSource:0}: Error finding container a2f9fded54ba7787dc7656934df4bf440445229c600aa19b4d7fa358216042f0: Status 404 returned error can't find the container with id a2f9fded54ba7787dc7656934df4bf440445229c600aa19b4d7fa358216042f0
Jul 15 18:24:26.503352 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.503329    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:26.505592 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.505564    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:26.507541 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.507514    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:26.524013 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.523955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"]
Jul 15 18:24:26.525172 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:24:26.525147    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185483cf_c424_4421_8027_78dbfd2ecbba.slice/crio-85d1f52796d535fb8b7cac8ae4c1c0bad893b114a1bc9b04bc249228e793e526 WatchSource:0}: Error finding container 85d1f52796d535fb8b7cac8ae4c1c0bad893b114a1bc9b04bc249228e793e526: Status 404 returned error can't find the container with id 85d1f52796d535fb8b7cac8ae4c1c0bad893b114a1bc9b04bc249228e793e526
Jul 15 18:24:26.596867 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.596834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf" event={"ID":"ec22ba52-9ce5-4aec-8103-c7668dfb58d7","Type":"ContainerStarted","Data":"c01387e09c961e3584756f45c6b86f6dfab3811b8d1c169d3554727c25596360"}
Jul 15 18:24:26.597001 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.596901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:26.597001 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.596923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf" event={"ID":"ec22ba52-9ce5-4aec-8103-c7668dfb58d7","Type":"ContainerStarted","Data":"a2f9fded54ba7787dc7656934df4bf440445229c600aa19b4d7fa358216042f0"}
Jul 15 18:24:26.598358 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.598330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77" event={"ID":"565896c9-203e-4dd0-af9e-976276ab1e62","Type":"ContainerStarted","Data":"68ceb52ff66d7638eb9486995b6ea0300b0ef2221fe999cb1bad81a5795efa83"}
Jul 15 18:24:26.599119 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.599102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20cba5b7-017c-450b-98c1-23d10b5cdfa2-extensions-socket-volume\") pod \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") "
Jul 15 18:24:26.599214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.599131    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc5gl\" (UniqueName: \"kubernetes.io/projected/1559b84f-a9e7-4b47-aba4-11de508c7822-kube-api-access-tc5gl\") pod \"1559b84f-a9e7-4b47-aba4-11de508c7822\" (UID: \"1559b84f-a9e7-4b47-aba4-11de508c7822\") "
Jul 15 18:24:26.599279 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.599225    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj4jp\" (UniqueName: \"kubernetes.io/projected/20cba5b7-017c-450b-98c1-23d10b5cdfa2-kube-api-access-tj4jp\") pod \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\" (UID: \"20cba5b7-017c-450b-98c1-23d10b5cdfa2\") "
Jul 15 18:24:26.599642 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.599592    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20cba5b7-017c-450b-98c1-23d10b5cdfa2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20cba5b7-017c-450b-98c1-23d10b5cdfa2" (UID: "20cba5b7-017c-450b-98c1-23d10b5cdfa2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:24:26.599738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.599713    2563 generic.go:356] "Generic (PLEG): container finished" podID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" containerID="1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7" exitCode=0
Jul 15 18:24:26.599856 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.599838    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:26.600111 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.599904    2563 scope.go:117] "RemoveContainer" containerID="1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7"
Jul 15 18:24:26.601545 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.601496    2563 generic.go:356] "Generic (PLEG): container finished" podID="1559b84f-a9e7-4b47-aba4-11de508c7822" containerID="1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7" exitCode=0
Jul 15 18:24:26.601647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.601555    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:26.601647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.601571    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1559b84f-a9e7-4b47-aba4-11de508c7822-kube-api-access-tc5gl" (OuterVolumeSpecName: "kube-api-access-tc5gl") pod "1559b84f-a9e7-4b47-aba4-11de508c7822" (UID: "1559b84f-a9e7-4b47-aba4-11de508c7822"). InnerVolumeSpecName "kube-api-access-tc5gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:24:26.601754 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.601645    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20cba5b7-017c-450b-98c1-23d10b5cdfa2-kube-api-access-tj4jp" (OuterVolumeSpecName: "kube-api-access-tj4jp") pod "20cba5b7-017c-450b-98c1-23d10b5cdfa2" (UID: "20cba5b7-017c-450b-98c1-23d10b5cdfa2"). InnerVolumeSpecName "kube-api-access-tj4jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:24:26.603261 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.603238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs" event={"ID":"185483cf-c424-4421-8027-78dbfd2ecbba","Type":"ContainerStarted","Data":"44803b2e0944ec44b76169eeef84ad4b78a0b5f2b1ad3c5871949181236a913f"}
Jul 15 18:24:26.603372 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.603277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs" event={"ID":"185483cf-c424-4421-8027-78dbfd2ecbba","Type":"ContainerStarted","Data":"85d1f52796d535fb8b7cac8ae4c1c0bad893b114a1bc9b04bc249228e793e526"}
Jul 15 18:24:26.603372 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.603303    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"
Jul 15 18:24:26.609189 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.609169    2563 scope.go:117] "RemoveContainer" containerID="1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7"
Jul 15 18:24:26.609472 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.609447    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7\": container with ID starting with 1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7 not found: ID does not exist" containerID="1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7"
Jul 15 18:24:26.609550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.609482    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7"} err="failed to get container status \"1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7\": rpc error: code = NotFound desc = could not find container \"1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7\": container with ID starting with 1186796ef02adcb635ffa07d4cb413040de845ef5937069b19900009142e75a7 not found: ID does not exist"
Jul 15 18:24:26.609550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.609503    2563 scope.go:117] "RemoveContainer" containerID="1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7"
Jul 15 18:24:26.615413 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.615389    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:26.615413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.615386    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf" podStartSLOduration=11.615372861 podStartE2EDuration="11.615372861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:26.613151609 +0000 UTC m=+451.820414908" watchObservedRunningTime="2026-07-15 18:24:26.615372861 +0000 UTC m=+451.822636140"
Jul 15 18:24:26.617389 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.617292    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:26.617493 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.617401    2563 scope.go:117] "RemoveContainer" containerID="1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7"
Jul 15 18:24:26.617726 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.617706    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7\": container with ID starting with 1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7 not found: ID does not exist" containerID="1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7"
Jul 15 18:24:26.617813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.617732    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7"} err="failed to get container status \"1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7\": rpc error: code = NotFound desc = could not find container \"1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7\": container with ID starting with 1111c78e7e27ed6da05561c950f3a39b22911958e65362a87faed41f3bf40fc7 not found: ID does not exist"
Jul 15 18:24:26.619012 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.618990    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:26.620598 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.620572    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:26.638644 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.638584    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fsc77" podStartSLOduration=1.045951003 podStartE2EDuration="23.638567224s" totalImagesPullingTime="22.592616221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:26.636638476 +0000 UTC m=+451.843901771" watchObservedRunningTime="2026-07-15 18:24:26.638567224 +0000 UTC m=+451.845830509"
Jul 15 18:24:26.654538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.654477    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs" podStartSLOduration=12.654456817 podStartE2EDuration="12.654456817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:26.652079663 +0000 UTC m=+451.859342945" watchObservedRunningTime="2026-07-15 18:24:26.654456817 +0000 UTC m=+451.861720103"
Jul 15 18:24:26.699928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.699890    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj4jp\" (UniqueName: \"kubernetes.io/projected/20cba5b7-017c-450b-98c1-23d10b5cdfa2-kube-api-access-tj4jp\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:24:26.699928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.699923    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20cba5b7-017c-450b-98c1-23d10b5cdfa2-extensions-socket-volume\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:24:26.700142 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:26.699952    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc5gl\" (UniqueName: \"kubernetes.io/projected/1559b84f-a9e7-4b47-aba4-11de508c7822-kube-api-access-tc5gl\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:24:26.910649 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.910614    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7hg8n\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7hg8n"
Jul 15 18:24:26.914242 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:24:26.914220    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlw8s\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlw8s"
Jul 15 18:24:27.377303 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:27.377265    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1559b84f-a9e7-4b47-aba4-11de508c7822" path="/var/lib/kubelet/pods/1559b84f-a9e7-4b47-aba4-11de508c7822/volumes"
Jul 15 18:24:27.377662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:27.377647    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20cba5b7-017c-450b-98c1-23d10b5cdfa2" path="/var/lib/kubelet/pods/20cba5b7-017c-450b-98c1-23d10b5cdfa2/volumes"
Jul 15 18:24:31.138998 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:31.138950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:31.237752 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:31.237703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:33.782499 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:33.782468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:33.883168 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:33.883121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:37.613298 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:37.613263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:24:37.613704 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:37.613448    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xpshs"
Jul 15 18:24:38.370612 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:38.370568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:38.472356 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:38.472320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:39.612296 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:39.612260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:40.143805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:40.143770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:42.338261 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:42.338219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:42.438378 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:42.438342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:52.002390 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:52.002351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:52.057256 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:52.057225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:52.535384 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:52.535353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:52.636550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:52.636501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:52.737102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:52.737060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:52.838644 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:52.838613    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:54.052700 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.052667    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"]
Jul 15 18:24:54.064557 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.064527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.067055 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.067026    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"]
Jul 15 18:24:54.067631 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.067610    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 18:24:54.067810 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.067705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nkm9s\""
Jul 15 18:24:54.078946 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.078922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:54.126855 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.126820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b498b3-801a-4550-a7f6-890243927f5b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.126877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.126915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.126945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fftg5\" (UniqueName: \"kubernetes.io/projected/f6b498b3-801a-4550-a7f6-890243927f5b-kube-api-access-fftg5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.127015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127218 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.127080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b498b3-801a-4550-a7f6-890243927f5b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127218 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.127123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127218 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.127161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.127218 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.127201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b498b3-801a-4550-a7f6-890243927f5b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.227904 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.227866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.227904 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.227908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228180 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.227927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fftg5\" (UniqueName: \"kubernetes.io/projected/f6b498b3-801a-4550-a7f6-890243927f5b-kube-api-access-fftg5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228180 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.227969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228180 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b498b3-801a-4550-a7f6-890243927f5b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228180 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228180 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228180 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b498b3-801a-4550-a7f6-890243927f5b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b498b3-801a-4550-a7f6-890243927f5b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228654 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228654 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.228738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.228677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.229047 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.229025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b498b3-801a-4550-a7f6-890243927f5b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.230518 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.230493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b498b3-801a-4550-a7f6-890243927f5b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.230694 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.230674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b498b3-801a-4550-a7f6-890243927f5b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.235813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.235791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b498b3-801a-4550-a7f6-890243927f5b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.235933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.235851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fftg5\" (UniqueName: \"kubernetes.io/projected/f6b498b3-801a-4550-a7f6-890243927f5b-kube-api-access-fftg5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spk4h\" (UID: \"f6b498b3-801a-4550-a7f6-890243927f5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.320683 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.320591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:54.376713 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.376682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:54.422073 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.422032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:54.484303 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.484272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:54.514905 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.514876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"]
Jul 15 18:24:54.516571 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:24:54.516547    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b498b3_801a_4550_a7f6_890243927f5b.slice/crio-9395e4e4e16719fafe67672e11b63fb82ba7fb4e2177293d52306bc2a7d98f10 WatchSource:0}: Error finding container 9395e4e4e16719fafe67672e11b63fb82ba7fb4e2177293d52306bc2a7d98f10: Status 404 returned error can't find the container with id 9395e4e4e16719fafe67672e11b63fb82ba7fb4e2177293d52306bc2a7d98f10
Jul 15 18:24:54.518575 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.518544    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:24:54.518639 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.518610    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:24:54.518680 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.518640    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:24:54.757011 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.756929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" event={"ID":"f6b498b3-801a-4550-a7f6-890243927f5b","Type":"ContainerStarted","Data":"e01449909ff0b65e949ed83ab1d09da524c58fd9a951d1baed6a6fd23d29d562"}
Jul 15 18:24:54.757011 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.756992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" event={"ID":"f6b498b3-801a-4550-a7f6-890243927f5b","Type":"ContainerStarted","Data":"9395e4e4e16719fafe67672e11b63fb82ba7fb4e2177293d52306bc2a7d98f10"}
Jul 15 18:24:54.777343 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:54.777291    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" podStartSLOduration=0.77727544 podStartE2EDuration="777.27544ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:54.776007203 +0000 UTC m=+479.983270485" watchObservedRunningTime="2026-07-15 18:24:54.77727544 +0000 UTC m=+479.984538723"
Jul 15 18:24:55.377034 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:55.377003    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:55.381699 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:55.381675    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:55.762110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:55.762075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:55.762928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:55.762910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:24:58.876345 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:58.876311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:58.932373 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:58.932316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:59.093687 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:59.093654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:59.212741 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:59.212659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:59.308699 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:59.308658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:24:59.975923 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:24:59.975891    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mjb6x"]
Jul 15 18:25:00.008704 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.008664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:00.038857 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.038832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjb6x"]
Jul 15 18:25:00.039017 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.038926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjb6x"
Jul 15 18:25:00.041962 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.041907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cf5cm\""
Jul 15 18:25:00.070970 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.070945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:00.103066 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.103030    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lml8d"]
Jul 15 18:25:00.106612 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.106594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lml8d"
Jul 15 18:25:00.114171 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.114148    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lml8d"]
Jul 15 18:25:00.181558 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.181516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9db2\" (UniqueName: \"kubernetes.io/projected/5a80cd35-6bf2-494a-9616-a997fbdb2544-kube-api-access-x9db2\") pod \"authorino-58cd955675-mjb6x\" (UID: \"5a80cd35-6bf2-494a-9616-a997fbdb2544\") " pod="kuadrant-system/authorino-58cd955675-mjb6x"
Jul 15 18:25:00.181730 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.181646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78pnc\" (UniqueName: \"kubernetes.io/projected/0b924448-afe9-4928-bfc5-f729f83eea14-kube-api-access-78pnc\") pod \"authorino-75d556bd77-lml8d\" (UID: \"0b924448-afe9-4928-bfc5-f729f83eea14\") " pod="kuadrant-system/authorino-75d556bd77-lml8d"
Jul 15 18:25:00.282245 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.282162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78pnc\" (UniqueName: \"kubernetes.io/projected/0b924448-afe9-4928-bfc5-f729f83eea14-kube-api-access-78pnc\") pod \"authorino-75d556bd77-lml8d\" (UID: \"0b924448-afe9-4928-bfc5-f729f83eea14\") " pod="kuadrant-system/authorino-75d556bd77-lml8d"
Jul 15 18:25:00.282245 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.282221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9db2\" (UniqueName: \"kubernetes.io/projected/5a80cd35-6bf2-494a-9616-a997fbdb2544-kube-api-access-x9db2\") pod \"authorino-58cd955675-mjb6x\" (UID: \"5a80cd35-6bf2-494a-9616-a997fbdb2544\") " pod="kuadrant-system/authorino-58cd955675-mjb6x"
Jul 15 18:25:00.291322 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.291294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78pnc\" (UniqueName: \"kubernetes.io/projected/0b924448-afe9-4928-bfc5-f729f83eea14-kube-api-access-78pnc\") pod \"authorino-75d556bd77-lml8d\" (UID: \"0b924448-afe9-4928-bfc5-f729f83eea14\") " pod="kuadrant-system/authorino-75d556bd77-lml8d"
Jul 15 18:25:00.291600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.291582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9db2\" (UniqueName: \"kubernetes.io/projected/5a80cd35-6bf2-494a-9616-a997fbdb2544-kube-api-access-x9db2\") pod \"authorino-58cd955675-mjb6x\" (UID: \"5a80cd35-6bf2-494a-9616-a997fbdb2544\") " pod="kuadrant-system/authorino-58cd955675-mjb6x"
Jul 15 18:25:00.352132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.352099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjb6x"
Jul 15 18:25:00.416531 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.416500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lml8d"
Jul 15 18:25:00.500540 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.500513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjb6x"]
Jul 15 18:25:00.502272 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:25:00.502246    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a80cd35_6bf2_494a_9616_a997fbdb2544.slice/crio-5eac521472c136a24cba0ca6fde35387e517b4120f3cd3d7927bb91f8a04d418 WatchSource:0}: Error finding container 5eac521472c136a24cba0ca6fde35387e517b4120f3cd3d7927bb91f8a04d418: Status 404 returned error can't find the container with id 5eac521472c136a24cba0ca6fde35387e517b4120f3cd3d7927bb91f8a04d418
Jul 15 18:25:00.561397 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.561374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lml8d"]
Jul 15 18:25:00.562861 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:25:00.562837    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b924448_afe9_4928_bfc5_f729f83eea14.slice/crio-f004212c460dc682f2bf712861adbcca242fe9333b7cc79dc2233fc6ffba2d30 WatchSource:0}: Error finding container f004212c460dc682f2bf712861adbcca242fe9333b7cc79dc2233fc6ffba2d30: Status 404 returned error can't find the container with id f004212c460dc682f2bf712861adbcca242fe9333b7cc79dc2233fc6ffba2d30
Jul 15 18:25:00.788434 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.788395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lml8d" event={"ID":"0b924448-afe9-4928-bfc5-f729f83eea14","Type":"ContainerStarted","Data":"f004212c460dc682f2bf712861adbcca242fe9333b7cc79dc2233fc6ffba2d30"}
Jul 15 18:25:00.789572 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:00.789548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjb6x" event={"ID":"5a80cd35-6bf2-494a-9616-a997fbdb2544","Type":"ContainerStarted","Data":"5eac521472c136a24cba0ca6fde35387e517b4120f3cd3d7927bb91f8a04d418"}
Jul 15 18:25:04.820253 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:04.820214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lml8d" event={"ID":"0b924448-afe9-4928-bfc5-f729f83eea14","Type":"ContainerStarted","Data":"07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe"}
Jul 15 18:25:04.821740 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:04.821716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjb6x" event={"ID":"5a80cd35-6bf2-494a-9616-a997fbdb2544","Type":"ContainerStarted","Data":"788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3"}
Jul 15 18:25:04.837473 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:04.837409    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lml8d" podStartSLOduration=1.333544399 podStartE2EDuration="4.837396133s" totalImagesPullingTime="3.503851734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:04.83720463 +0000 UTC m=+490.044467913" watchObservedRunningTime="2026-07-15 18:25:04.837396133 +0000 UTC m=+490.044659415"
Jul 15 18:25:04.869093 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:04.868573    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mjb6x" podStartSLOduration=2.31612931 podStartE2EDuration="5.868549418s" totalImagesPullingTime="3.552420108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:04.857321464 +0000 UTC m=+490.064584748" watchObservedRunningTime="2026-07-15 18:25:04.868549418 +0000 UTC m=+490.075812701"
Jul 15 18:25:04.871882 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:04.871854    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjb6x"]
Jul 15 18:25:06.832100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:06.832056    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mjb6x" podUID="5a80cd35-6bf2-494a-9616-a997fbdb2544" containerName="authorino" containerID="cri-o://788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3" gracePeriod=30
Jul 15 18:25:07.083960 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.083885    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjb6x"
Jul 15 18:25:07.146588 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.146557    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9db2\" (UniqueName: \"kubernetes.io/projected/5a80cd35-6bf2-494a-9616-a997fbdb2544-kube-api-access-x9db2\") pod \"5a80cd35-6bf2-494a-9616-a997fbdb2544\" (UID: \"5a80cd35-6bf2-494a-9616-a997fbdb2544\") "
Jul 15 18:25:07.148622 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.148588    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a80cd35-6bf2-494a-9616-a997fbdb2544-kube-api-access-x9db2" (OuterVolumeSpecName: "kube-api-access-x9db2") pod "5a80cd35-6bf2-494a-9616-a997fbdb2544" (UID: "5a80cd35-6bf2-494a-9616-a997fbdb2544"). InnerVolumeSpecName "kube-api-access-x9db2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:25:07.247341 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.247307    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9db2\" (UniqueName: \"kubernetes.io/projected/5a80cd35-6bf2-494a-9616-a997fbdb2544-kube-api-access-x9db2\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:25:07.838248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.838211    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a80cd35-6bf2-494a-9616-a997fbdb2544" containerID="788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3" exitCode=0
Jul 15 18:25:07.838248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.838250    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjb6x"
Jul 15 18:25:07.838697 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.838298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjb6x" event={"ID":"5a80cd35-6bf2-494a-9616-a997fbdb2544","Type":"ContainerDied","Data":"788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3"}
Jul 15 18:25:07.838697 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.838340    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjb6x" event={"ID":"5a80cd35-6bf2-494a-9616-a997fbdb2544","Type":"ContainerDied","Data":"5eac521472c136a24cba0ca6fde35387e517b4120f3cd3d7927bb91f8a04d418"}
Jul 15 18:25:07.838697 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.838357    2563 scope.go:117] "RemoveContainer" containerID="788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3"
Jul 15 18:25:07.847507 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.847486    2563 scope.go:117] "RemoveContainer" containerID="788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3"
Jul 15 18:25:07.847775 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:25:07.847758    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3\": container with ID starting with 788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3 not found: ID does not exist" containerID="788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3"
Jul 15 18:25:07.847821 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.847784    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3"} err="failed to get container status \"788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3\": rpc error: code = NotFound desc = could not find container \"788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3\": container with ID starting with 788f004d9f70e695b4a8dff165f165da9de4e650d4ce1fd2455d5357ba5e26f3 not found: ID does not exist"
Jul 15 18:25:07.857299 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.857279    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjb6x"]
Jul 15 18:25:07.860532 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:07.860505    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjb6x"]
Jul 15 18:25:09.376815 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:09.376780    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a80cd35-6bf2-494a-9616-a997fbdb2544" path="/var/lib/kubelet/pods/5a80cd35-6bf2-494a-9616-a997fbdb2544/volumes"
Jul 15 18:25:17.139117 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:17.139090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:17.231674 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:17.231640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:17.625565 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:17.625532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:29.811088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:29.811034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:29.981590 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:29.981556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:30.384440 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.384403    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-96696cd55-jtm4w"]
Jul 15 18:25:30.384904 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.384841    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a80cd35-6bf2-494a-9616-a997fbdb2544" containerName="authorino"
Jul 15 18:25:30.384904 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.384859    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a80cd35-6bf2-494a-9616-a997fbdb2544" containerName="authorino"
Jul 15 18:25:30.385065 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.384970    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a80cd35-6bf2-494a-9616-a997fbdb2544" containerName="authorino"
Jul 15 18:25:30.388327 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.388309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.390786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.390770    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 18:25:30.394383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.394362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-96696cd55-jtm4w"]
Jul 15 18:25:30.549668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.549624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hmgk\" (UniqueName: \"kubernetes.io/projected/b17e1d8a-749f-4dc6-bb22-121503f8217e-kube-api-access-5hmgk\") pod \"authorino-96696cd55-jtm4w\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") " pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.549862 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.549684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b17e1d8a-749f-4dc6-bb22-121503f8217e-tls-cert\") pod \"authorino-96696cd55-jtm4w\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") " pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.650672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.650585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hmgk\" (UniqueName: \"kubernetes.io/projected/b17e1d8a-749f-4dc6-bb22-121503f8217e-kube-api-access-5hmgk\") pod \"authorino-96696cd55-jtm4w\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") " pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.650672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.650623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b17e1d8a-749f-4dc6-bb22-121503f8217e-tls-cert\") pod \"authorino-96696cd55-jtm4w\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") " pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.652999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.652971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b17e1d8a-749f-4dc6-bb22-121503f8217e-tls-cert\") pod \"authorino-96696cd55-jtm4w\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") " pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.658443 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.658405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hmgk\" (UniqueName: \"kubernetes.io/projected/b17e1d8a-749f-4dc6-bb22-121503f8217e-kube-api-access-5hmgk\") pod \"authorino-96696cd55-jtm4w\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") " pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.698522 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.698492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:25:30.830290 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.830265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-96696cd55-jtm4w"]
Jul 15 18:25:30.832163 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:25:30.832133    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb17e1d8a_749f_4dc6_bb22_121503f8217e.slice/crio-6a51f8a9c6c7746566d1873168472bbec5da809074d7af571473464d878f0a18 WatchSource:0}: Error finding container 6a51f8a9c6c7746566d1873168472bbec5da809074d7af571473464d878f0a18: Status 404 returned error can't find the container with id 6a51f8a9c6c7746566d1873168472bbec5da809074d7af571473464d878f0a18
Jul 15 18:25:30.966444 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:30.966344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96696cd55-jtm4w" event={"ID":"b17e1d8a-749f-4dc6-bb22-121503f8217e","Type":"ContainerStarted","Data":"6a51f8a9c6c7746566d1873168472bbec5da809074d7af571473464d878f0a18"}
Jul 15 18:25:33.984295 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:33.984252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96696cd55-jtm4w" event={"ID":"b17e1d8a-749f-4dc6-bb22-121503f8217e","Type":"ContainerStarted","Data":"39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36"}
Jul 15 18:25:34.000262 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.000215    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-96696cd55-jtm4w" podStartSLOduration=1.759908182 podStartE2EDuration="4.000202757s" totalImagesPullingTime="2.240294575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:33.999489348 +0000 UTC m=+519.206752630" watchObservedRunningTime="2026-07-15 18:25:34.000202757 +0000 UTC m=+519.207466091"
Jul 15 18:25:34.024715 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.024686    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lml8d"]
Jul 15 18:25:34.024878 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.024858    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lml8d" podUID="0b924448-afe9-4928-bfc5-f729f83eea14" containerName="authorino" containerID="cri-o://07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe" gracePeriod=30
Jul 15 18:25:34.276738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.276712    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lml8d"
Jul 15 18:25:34.277725 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.277707    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78pnc\" (UniqueName: \"kubernetes.io/projected/0b924448-afe9-4928-bfc5-f729f83eea14-kube-api-access-78pnc\") pod \"0b924448-afe9-4928-bfc5-f729f83eea14\" (UID: \"0b924448-afe9-4928-bfc5-f729f83eea14\") "
Jul 15 18:25:34.279680 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.279654    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b924448-afe9-4928-bfc5-f729f83eea14-kube-api-access-78pnc" (OuterVolumeSpecName: "kube-api-access-78pnc") pod "0b924448-afe9-4928-bfc5-f729f83eea14" (UID: "0b924448-afe9-4928-bfc5-f729f83eea14"). InnerVolumeSpecName "kube-api-access-78pnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:25:34.378212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.378179    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78pnc\" (UniqueName: \"kubernetes.io/projected/0b924448-afe9-4928-bfc5-f729f83eea14-kube-api-access-78pnc\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:25:34.990676 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.990639    2563 generic.go:356] "Generic (PLEG): container finished" podID="0b924448-afe9-4928-bfc5-f729f83eea14" containerID="07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe" exitCode=0
Jul 15 18:25:34.990676 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.990675    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lml8d"
Jul 15 18:25:34.991164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.990719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lml8d" event={"ID":"0b924448-afe9-4928-bfc5-f729f83eea14","Type":"ContainerDied","Data":"07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe"}
Jul 15 18:25:34.991164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.990758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lml8d" event={"ID":"0b924448-afe9-4928-bfc5-f729f83eea14","Type":"ContainerDied","Data":"f004212c460dc682f2bf712861adbcca242fe9333b7cc79dc2233fc6ffba2d30"}
Jul 15 18:25:34.991164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.990774    2563 scope.go:117] "RemoveContainer" containerID="07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe"
Jul 15 18:25:34.999561 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.999524    2563 scope.go:117] "RemoveContainer" containerID="07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe"
Jul 15 18:25:34.999809 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:25:34.999787    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe\": container with ID starting with 07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe not found: ID does not exist" containerID="07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe"
Jul 15 18:25:34.999865 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:34.999818    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe"} err="failed to get container status \"07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe\": rpc error: code = NotFound desc = could not find container \"07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe\": container with ID starting with 07c8658e6a9d9f0ee71704ed1eb43848874cea1711703b3393ec80270f9cb0fe not found: ID does not exist"
Jul 15 18:25:35.011258 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:35.011235    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lml8d"]
Jul 15 18:25:35.018341 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:35.018319    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lml8d"]
Jul 15 18:25:35.376741 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:35.376708    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b924448-afe9-4928-bfc5-f729f83eea14" path="/var/lib/kubelet/pods/0b924448-afe9-4928-bfc5-f729f83eea14/volumes"
Jul 15 18:25:39.955054 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:39.955007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:40.053776 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.053741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:40.153836 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.153799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:40.160257 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.160233    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6588c6cddf-bk678"]
Jul 15 18:25:40.160605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.160590    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b924448-afe9-4928-bfc5-f729f83eea14" containerName="authorino"
Jul 15 18:25:40.160657 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.160607    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b924448-afe9-4928-bfc5-f729f83eea14" containerName="authorino"
Jul 15 18:25:40.160692 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.160673    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b924448-afe9-4928-bfc5-f729f83eea14" containerName="authorino"
Jul 15 18:25:40.167410 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.167391    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.171020 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.170991    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vjtw5\""
Jul 15 18:25:40.171147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.171039    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 18:25:40.171147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.171045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 18:25:40.175967 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.175949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6588c6cddf-bk678"]
Jul 15 18:25:40.217231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.217132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlq6j\" (UniqueName: \"kubernetes.io/projected/93d3f877-b2cc-4c5a-b758-185afa321517-kube-api-access-qlq6j\") pod \"maas-controller-6588c6cddf-bk678\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") " pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.217231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.217227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d3f877-b2cc-4c5a-b758-185afa321517-webhook-cert\") pod \"maas-controller-6588c6cddf-bk678\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") " pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.251890 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.251845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:40.318596 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.318558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlq6j\" (UniqueName: \"kubernetes.io/projected/93d3f877-b2cc-4c5a-b758-185afa321517-kube-api-access-qlq6j\") pod \"maas-controller-6588c6cddf-bk678\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") " pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.318785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.318665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d3f877-b2cc-4c5a-b758-185afa321517-webhook-cert\") pod \"maas-controller-6588c6cddf-bk678\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") " pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.321148 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.321125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d3f877-b2cc-4c5a-b758-185afa321517-webhook-cert\") pod \"maas-controller-6588c6cddf-bk678\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") " pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.326486 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.326464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlq6j\" (UniqueName: \"kubernetes.io/projected/93d3f877-b2cc-4c5a-b758-185afa321517-kube-api-access-qlq6j\") pod \"maas-controller-6588c6cddf-bk678\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") " pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.479581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.479500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:40.612164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:40.612134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6588c6cddf-bk678"]
Jul 15 18:25:40.614027 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:25:40.614003    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d3f877_b2cc_4c5a_b758_185afa321517.slice/crio-022300e5e4349a379d3609edf9a5e6f3ac2f8b4081317afe3d03dff9a6540745 WatchSource:0}: Error finding container 022300e5e4349a379d3609edf9a5e6f3ac2f8b4081317afe3d03dff9a6540745: Status 404 returned error can't find the container with id 022300e5e4349a379d3609edf9a5e6f3ac2f8b4081317afe3d03dff9a6540745
Jul 15 18:25:41.030392 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:41.030353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6588c6cddf-bk678" event={"ID":"93d3f877-b2cc-4c5a-b758-185afa321517","Type":"ContainerStarted","Data":"022300e5e4349a379d3609edf9a5e6f3ac2f8b4081317afe3d03dff9a6540745"}
Jul 15 18:25:43.042297 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:43.042260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6588c6cddf-bk678" event={"ID":"93d3f877-b2cc-4c5a-b758-185afa321517","Type":"ContainerStarted","Data":"10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458"}
Jul 15 18:25:43.042760 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:43.042324    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:25:43.060956 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:43.060897    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6588c6cddf-bk678" podStartSLOduration=0.747382986 podStartE2EDuration="3.060877171s" totalImagesPullingTime="2.313494185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:43.059000919 +0000 UTC m=+528.266264204" watchObservedRunningTime="2026-07-15 18:25:43.060877171 +0000 UTC m=+528.268140455"
Jul 15 18:25:43.097611 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:43.097564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:43.198609 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:43.198511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:25:54.050849 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:25:54.050773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:26:14.892139 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:14.892103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:14.986898 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:14.986864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:15.422515 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.422482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:15.477817 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.477774    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"]
Jul 15 18:26:15.483718 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.483698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.486243 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.486223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 18:26:15.486360 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.486251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 18:26:15.486360 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.486254    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fbc5d\""
Jul 15 18:26:15.487134 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.487116    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 18:26:15.492370 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.492110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"]
Jul 15 18:26:15.636156 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.636118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7541ff8c-3365-42e3-b5ad-292efda43ad9-openshift-service-ca\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.636374 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.636182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7541ff8c-3365-42e3-b5ad-292efda43ad9-maas-api-tls\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.636374 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.636267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4sf\" (UniqueName: \"kubernetes.io/projected/7541ff8c-3365-42e3-b5ad-292efda43ad9-kube-api-access-mg4sf\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.736937 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.736857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7541ff8c-3365-42e3-b5ad-292efda43ad9-maas-api-tls\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.737078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.736921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4sf\" (UniqueName: \"kubernetes.io/projected/7541ff8c-3365-42e3-b5ad-292efda43ad9-kube-api-access-mg4sf\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.737078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.737008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7541ff8c-3365-42e3-b5ad-292efda43ad9-openshift-service-ca\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.737078 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:26:15.737018    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 15 18:26:15.737182 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:26:15.737118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7541ff8c-3365-42e3-b5ad-292efda43ad9-maas-api-tls podName:7541ff8c-3365-42e3-b5ad-292efda43ad9 nodeName:}" failed. No retries permitted until 2026-07-15 18:26:16.237096926 +0000 UTC m=+561.444360187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7541ff8c-3365-42e3-b5ad-292efda43ad9-maas-api-tls") pod "maas-api-5787bbc746-8wttw" (UID: "7541ff8c-3365-42e3-b5ad-292efda43ad9") : secret "maas-api-serving-cert" not found
Jul 15 18:26:15.737688 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.737671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7541ff8c-3365-42e3-b5ad-292efda43ad9-openshift-service-ca\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.746247 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.746220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4sf\" (UniqueName: \"kubernetes.io/projected/7541ff8c-3365-42e3-b5ad-292efda43ad9-kube-api-access-mg4sf\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:15.852709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.852679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:15.951273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:15.951225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:16.060683 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:16.060645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:16.242963 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:16.242928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7541ff8c-3365-42e3-b5ad-292efda43ad9-maas-api-tls\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:16.245492 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:16.245466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7541ff8c-3365-42e3-b5ad-292efda43ad9-maas-api-tls\") pod \"maas-api-5787bbc746-8wttw\" (UID: \"7541ff8c-3365-42e3-b5ad-292efda43ad9\") " pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:16.396474 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:16.396358    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:16.566822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:16.566791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"]
Jul 15 18:26:16.568210 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:26:16.568187    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7541ff8c_3365_42e3_b5ad_292efda43ad9.slice/crio-5bbcfcafefe2945a978ab5a4a8ec656f24b90059ef72cb19daf1a9e22e7a5f14 WatchSource:0}: Error finding container 5bbcfcafefe2945a978ab5a4a8ec656f24b90059ef72cb19daf1a9e22e7a5f14: Status 404 returned error can't find the container with id 5bbcfcafefe2945a978ab5a4a8ec656f24b90059ef72cb19daf1a9e22e7a5f14
Jul 15 18:26:17.229757 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:17.229711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw" event={"ID":"7541ff8c-3365-42e3-b5ad-292efda43ad9","Type":"ContainerStarted","Data":"5bbcfcafefe2945a978ab5a4a8ec656f24b90059ef72cb19daf1a9e22e7a5f14"}
Jul 15 18:26:21.263283 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:21.263175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw" event={"ID":"7541ff8c-3365-42e3-b5ad-292efda43ad9","Type":"ContainerStarted","Data":"ff788b300e00eabbd3cf217157b8a0002cdfa5bc6d1b349c452912f07871d367"}
Jul 15 18:26:21.263668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:21.263327    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:21.283804 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:21.283759    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw" podStartSLOduration=2.199957496 podStartE2EDuration="6.283745239s" totalImagesPullingTime="4.083787743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:26:21.281066145 +0000 UTC m=+566.488329441" watchObservedRunningTime="2026-07-15 18:26:21.283745239 +0000 UTC m=+566.491008523"
Jul 15 18:26:24.281044 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:24.281009    2563 generic.go:356] "Generic (PLEG): container finished" podID="f6b498b3-801a-4550-a7f6-890243927f5b" containerID="e01449909ff0b65e949ed83ab1d09da524c58fd9a951d1baed6a6fd23d29d562" exitCode=0
Jul 15 18:26:24.281490 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:24.281079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" event={"ID":"f6b498b3-801a-4550-a7f6-890243927f5b","Type":"ContainerDied","Data":"e01449909ff0b65e949ed83ab1d09da524c58fd9a951d1baed6a6fd23d29d562"}
Jul 15 18:26:24.281538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:24.281489    2563 scope.go:117] "RemoveContainer" containerID="e01449909ff0b65e949ed83ab1d09da524c58fd9a951d1baed6a6fd23d29d562"
Jul 15 18:26:24.282590 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:24.282563    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:26:24.282667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:24.282637    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:26:24.282706 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:24.282685    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:26:25.289874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:25.289838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" event={"ID":"f6b498b3-801a-4550-a7f6-890243927f5b","Type":"ContainerStarted","Data":"f297008ec3a67408432865330691022ed5398b2efc67d79f9c1c0216d92ff37a"}
Jul 15 18:26:25.377847 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:25.377815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:26:25.378945 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:25.378921    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-spk4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 18:26:25.379054 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:25.378968    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" podUID="f6b498b3-801a-4550-a7f6-890243927f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 18:26:25.762369 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:25.762325    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:26:26.377781 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:26.377742    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-spk4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 18:26:26.378199 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:26.377812    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" podUID="f6b498b3-801a-4550-a7f6-890243927f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 18:26:27.274509 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:27.274483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5787bbc746-8wttw"
Jul 15 18:26:27.378074 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:27.378042    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-spk4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 18:26:27.378452 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:27.378100    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" podUID="f6b498b3-801a-4550-a7f6-890243927f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 18:26:28.273209 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:28.273165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:28.371858 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:28.371823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:28.377549 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:28.377523    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-spk4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 18:26:28.377679 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:28.377585    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h" podUID="f6b498b3-801a-4550-a7f6-890243927f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 18:26:29.381019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:29.380990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:26:29.381968 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:29.381948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spk4h"
Jul 15 18:26:36.195779 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:36.195731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:49.450058 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:49.449966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:26:55.264248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:55.264224    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:26:55.264709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:26:55.264224    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:27:10.130229 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:10.130190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:27:16.198848 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.198814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:27:16.454511 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.454407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"]
Jul 15 18:27:16.458713 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.458689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.468696 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.468642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 18:27:16.469081 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.469045    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 18:27:16.469213 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.469042    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 18:27:16.469213 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.469054    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8r5n2\""
Jul 15 18:27:16.482879 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.482858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"]
Jul 15 18:27:16.505921 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.505901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:27:16.545007 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.544984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.545103 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.545015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.545103 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.545033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c0b3378-b639-4b68-bf16-c76af8b6db35-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.545103 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.545053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.545226 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.545166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98445\" (UniqueName: \"kubernetes.io/projected/5c0b3378-b639-4b68-bf16-c76af8b6db35-kube-api-access-98445\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.545226 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.545200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646178 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646289 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646289 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c0b3378-b639-4b68-bf16-c76af8b6db35-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646289 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646289 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98445\" (UniqueName: \"kubernetes.io/projected/5c0b3378-b639-4b68-bf16-c76af8b6db35-kube-api-access-98445\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646537 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646537 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.646637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.646607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.648531 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.648508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c0b3378-b639-4b68-bf16-c76af8b6db35-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.648670 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.648652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c0b3378-b639-4b68-bf16-c76af8b6db35-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.658988 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.658968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98445\" (UniqueName: \"kubernetes.io/projected/5c0b3378-b639-4b68-bf16-c76af8b6db35-kube-api-access-98445\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fgb4l\" (UID: \"5c0b3378-b639-4b68-bf16-c76af8b6db35\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.775128 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.775072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:16.916913 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.916883    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"]
Jul 15 18:27:16.918902 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:27:16.918879    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0b3378_b639_4b68_bf16_c76af8b6db35.slice/crio-17e8b6e2e70bee2ed0b0ae98c41b277028abe1bbdfd66da973035dc25c039a98 WatchSource:0}: Error finding container 17e8b6e2e70bee2ed0b0ae98c41b277028abe1bbdfd66da973035dc25c039a98: Status 404 returned error can't find the container with id 17e8b6e2e70bee2ed0b0ae98c41b277028abe1bbdfd66da973035dc25c039a98
Jul 15 18:27:16.920389 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:16.920368    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:27:17.576023 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:17.575811    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l" event={"ID":"5c0b3378-b639-4b68-bf16-c76af8b6db35","Type":"ContainerStarted","Data":"17e8b6e2e70bee2ed0b0ae98c41b277028abe1bbdfd66da973035dc25c039a98"}
Jul 15 18:27:18.582962 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:18.582929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l" event={"ID":"5c0b3378-b639-4b68-bf16-c76af8b6db35","Type":"ContainerStarted","Data":"20becf7d26157d65754834f331b3267fdc7eeb4f0efb22c5a8bd19b54c3d8ae5"}
Jul 15 18:27:18.602237 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:18.602193    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l" podStartSLOduration=1.451509792 podStartE2EDuration="2.602174609s" totalImagesPullingTime="1.150664817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:27:18.602018085 +0000 UTC m=+623.809281369" watchObservedRunningTime="2026-07-15 18:27:18.602174609 +0000 UTC m=+623.809437893"
Jul 15 18:27:26.776106 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:26.776072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:26.776633 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:26.776155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:26.788227 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:26.788205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:27.642828 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:27.642798    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fgb4l"
Jul 15 18:27:29.369163 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:29.369134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:27:37.428696 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:27:37.428660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:28:05.139087 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:28:05.139051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:28:05.192387 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:28:05.192356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:28:05.705301 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:28:05.705258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:28:16.019232 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:28:16.019197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:28:19.797761 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:28:19.797723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:28:42.448485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:28:42.448450    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:28:42.546660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:28:42.546631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:20.264781 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:20.264740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:27.590121 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:27.590087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:27.691298 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:27.691274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:44.425602 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.425568    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84497cb946-6kfz2"]
Jul 15 18:29:44.428915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.428898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.439236 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.439209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84497cb946-6kfz2"]
Jul 15 18:29:44.548175 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.548146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5c779d0-5ad3-4414-9129-098bcf513c00-tls-cert\") pod \"authorino-84497cb946-6kfz2\" (UID: \"a5c779d0-5ad3-4414-9129-098bcf513c00\") " pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.548311 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.548180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8zp4\" (UniqueName: \"kubernetes.io/projected/a5c779d0-5ad3-4414-9129-098bcf513c00-kube-api-access-d8zp4\") pod \"authorino-84497cb946-6kfz2\" (UID: \"a5c779d0-5ad3-4414-9129-098bcf513c00\") " pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.648830 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.648807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5c779d0-5ad3-4414-9129-098bcf513c00-tls-cert\") pod \"authorino-84497cb946-6kfz2\" (UID: \"a5c779d0-5ad3-4414-9129-098bcf513c00\") " pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.648997 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.648844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8zp4\" (UniqueName: \"kubernetes.io/projected/a5c779d0-5ad3-4414-9129-098bcf513c00-kube-api-access-d8zp4\") pod \"authorino-84497cb946-6kfz2\" (UID: \"a5c779d0-5ad3-4414-9129-098bcf513c00\") " pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.651113 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.651084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5c779d0-5ad3-4414-9129-098bcf513c00-tls-cert\") pod \"authorino-84497cb946-6kfz2\" (UID: \"a5c779d0-5ad3-4414-9129-098bcf513c00\") " pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.660111 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.660090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8zp4\" (UniqueName: \"kubernetes.io/projected/a5c779d0-5ad3-4414-9129-098bcf513c00-kube-api-access-d8zp4\") pod \"authorino-84497cb946-6kfz2\" (UID: \"a5c779d0-5ad3-4414-9129-098bcf513c00\") " pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.738988 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.738938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84497cb946-6kfz2"
Jul 15 18:29:44.884800 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.884596    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84497cb946-6kfz2"]
Jul 15 18:29:44.887384 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:29:44.887350    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5c779d0_5ad3_4414_9129_098bcf513c00.slice/crio-1bcbf27dc0b8bf48c904ceaff9e4f465731e37fb01cc09bf80f9ddd8ca0dc0eb WatchSource:0}: Error finding container 1bcbf27dc0b8bf48c904ceaff9e4f465731e37fb01cc09bf80f9ddd8ca0dc0eb: Status 404 returned error can't find the container with id 1bcbf27dc0b8bf48c904ceaff9e4f465731e37fb01cc09bf80f9ddd8ca0dc0eb
Jul 15 18:29:44.911102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:44.911068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:45.318508 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:45.318481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:45.360845 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:45.360812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84497cb946-6kfz2" event={"ID":"a5c779d0-5ad3-4414-9129-098bcf513c00","Type":"ContainerStarted","Data":"1bcbf27dc0b8bf48c904ceaff9e4f465731e37fb01cc09bf80f9ddd8ca0dc0eb"}
Jul 15 18:29:46.269480 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.269443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:46.368914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.368860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84497cb946-6kfz2" event={"ID":"a5c779d0-5ad3-4414-9129-098bcf513c00","Type":"ContainerStarted","Data":"105f77dd2f0ff121475d015e5825dca4b2d135eb71bc9f1753ffa88aaf42acbd"}
Jul 15 18:29:46.378611 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.378576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:29:46.396784 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.396722    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84497cb946-6kfz2" podStartSLOduration=1.8546437679999999 podStartE2EDuration="2.396702859s" totalImagesPullingTime="542.059091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:29:46.395577444 +0000 UTC m=+771.602840724" watchObservedRunningTime="2026-07-15 18:29:46.396702859 +0000 UTC m=+771.603966143"
Jul 15 18:29:46.450733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.450687    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-96696cd55-jtm4w"]
Jul 15 18:29:46.451000 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.450976    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-96696cd55-jtm4w" podUID="b17e1d8a-749f-4dc6-bb22-121503f8217e" containerName="authorino" containerID="cri-o://39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36" gracePeriod=30
Jul 15 18:29:46.709163 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.709138    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:29:46.768282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.768242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hmgk\" (UniqueName: \"kubernetes.io/projected/b17e1d8a-749f-4dc6-bb22-121503f8217e-kube-api-access-5hmgk\") pod \"b17e1d8a-749f-4dc6-bb22-121503f8217e\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") "
Jul 15 18:29:46.768482 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.768311    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b17e1d8a-749f-4dc6-bb22-121503f8217e-tls-cert\") pod \"b17e1d8a-749f-4dc6-bb22-121503f8217e\" (UID: \"b17e1d8a-749f-4dc6-bb22-121503f8217e\") "
Jul 15 18:29:46.770806 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.770777    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b17e1d8a-749f-4dc6-bb22-121503f8217e-kube-api-access-5hmgk" (OuterVolumeSpecName: "kube-api-access-5hmgk") pod "b17e1d8a-749f-4dc6-bb22-121503f8217e" (UID: "b17e1d8a-749f-4dc6-bb22-121503f8217e"). InnerVolumeSpecName "kube-api-access-5hmgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:29:46.785284 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.785243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b17e1d8a-749f-4dc6-bb22-121503f8217e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b17e1d8a-749f-4dc6-bb22-121503f8217e" (UID: "b17e1d8a-749f-4dc6-bb22-121503f8217e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:29:46.869693 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.869622    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hmgk\" (UniqueName: \"kubernetes.io/projected/b17e1d8a-749f-4dc6-bb22-121503f8217e-kube-api-access-5hmgk\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:29:46.869693 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:46.869648    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b17e1d8a-749f-4dc6-bb22-121503f8217e-tls-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:29:47.377912 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.377873    2563 generic.go:356] "Generic (PLEG): container finished" podID="b17e1d8a-749f-4dc6-bb22-121503f8217e" containerID="39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36" exitCode=0
Jul 15 18:29:47.378359 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.377989    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96696cd55-jtm4w"
Jul 15 18:29:47.378952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.378927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96696cd55-jtm4w" event={"ID":"b17e1d8a-749f-4dc6-bb22-121503f8217e","Type":"ContainerDied","Data":"39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36"}
Jul 15 18:29:47.379101 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.378963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96696cd55-jtm4w" event={"ID":"b17e1d8a-749f-4dc6-bb22-121503f8217e","Type":"ContainerDied","Data":"6a51f8a9c6c7746566d1873168472bbec5da809074d7af571473464d878f0a18"}
Jul 15 18:29:47.379101 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.378985    2563 scope.go:117] "RemoveContainer" containerID="39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36"
Jul 15 18:29:47.389391 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.389376    2563 scope.go:117] "RemoveContainer" containerID="39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36"
Jul 15 18:29:47.389681 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:29:47.389658    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36\": container with ID starting with 39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36 not found: ID does not exist" containerID="39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36"
Jul 15 18:29:47.389740 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.389695    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36"} err="failed to get container status \"39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36\": rpc error: code = NotFound desc = could not find container \"39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36\": container with ID starting with 39bd79348841857b68a029f2e072ac14cefb6cda0479cf0b22820f4e95229f36 not found: ID does not exist"
Jul 15 18:29:47.407658 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.407638    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-96696cd55-jtm4w"]
Jul 15 18:29:47.416107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:47.416089    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-96696cd55-jtm4w"]
Jul 15 18:29:49.377022 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:29:49.376988    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b17e1d8a-749f-4dc6-bb22-121503f8217e" path="/var/lib/kubelet/pods/b17e1d8a-749f-4dc6-bb22-121503f8217e/volumes"
Jul 15 18:30:00.147902 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.147871    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx"]
Jul 15 18:30:00.148307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.148257    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b17e1d8a-749f-4dc6-bb22-121503f8217e" containerName="authorino"
Jul 15 18:30:00.148307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.148269    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b17e1d8a-749f-4dc6-bb22-121503f8217e" containerName="authorino"
Jul 15 18:30:00.148381 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.148337    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b17e1d8a-749f-4dc6-bb22-121503f8217e" containerName="authorino"
Jul 15 18:30:00.152686 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.152669    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx"
Jul 15 18:30:00.155641 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.155616    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d2zdm\""
Jul 15 18:30:00.158030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.158007    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx"]
Jul 15 18:30:00.163900 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.163880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx"
Jul 15 18:30:00.299158 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.299133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx"]
Jul 15 18:30:00.301096 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:30:00.301067    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57074b01_3c60_4cc5_91dc_6bb86c5855e7.slice/crio-e2014ea9a6d56f83da27d07af14cd2897dd92643e6507713e56eed60a61796f0 WatchSource:0}: Error finding container e2014ea9a6d56f83da27d07af14cd2897dd92643e6507713e56eed60a61796f0: Status 404 returned error can't find the container with id e2014ea9a6d56f83da27d07af14cd2897dd92643e6507713e56eed60a61796f0
Jul 15 18:30:00.447429 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:00.447365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx" event={"ID":"57074b01-3c60-4cc5-91dc-6bb86c5855e7","Type":"ContainerStarted","Data":"e2014ea9a6d56f83da27d07af14cd2897dd92643e6507713e56eed60a61796f0"}
Jul 15 18:30:09.497121 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:09.497048    2563 generic.go:356] "Generic (PLEG): container finished" podID="57074b01-3c60-4cc5-91dc-6bb86c5855e7" containerID="23517b6abbba77a5d89a92e9e2eb9892aa1cc4e5d754ef100d8835e9634143d2" exitCode=0
Jul 15 18:30:09.497121 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:09.497095    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx" event={"ID":"57074b01-3c60-4cc5-91dc-6bb86c5855e7","Type":"ContainerDied","Data":"23517b6abbba77a5d89a92e9e2eb9892aa1cc4e5d754ef100d8835e9634143d2"}
Jul 15 18:30:10.668292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:10.668268    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx"
Jul 15 18:30:11.509258 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:11.509220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx" event={"ID":"57074b01-3c60-4cc5-91dc-6bb86c5855e7","Type":"ContainerDied","Data":"e2014ea9a6d56f83da27d07af14cd2897dd92643e6507713e56eed60a61796f0"}
Jul 15 18:30:11.509258 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:11.509255    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735670-98jlx"
Jul 15 18:30:11.509517 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:11.509271    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2014ea9a6d56f83da27d07af14cd2897dd92643e6507713e56eed60a61796f0"
Jul 15 18:30:58.720699 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:58.720661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:30:58.819631 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:58.819600    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6588c6cddf-bk678"]
Jul 15 18:30:58.819895 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:58.819866    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6588c6cddf-bk678" podUID="93d3f877-b2cc-4c5a-b758-185afa321517" containerName="manager" containerID="cri-o://10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458" gracePeriod=30
Jul 15 18:30:59.071905 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.071881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:30:59.126494 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.126466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlq6j\" (UniqueName: \"kubernetes.io/projected/93d3f877-b2cc-4c5a-b758-185afa321517-kube-api-access-qlq6j\") pod \"93d3f877-b2cc-4c5a-b758-185afa321517\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") "
Jul 15 18:30:59.126635 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.126558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d3f877-b2cc-4c5a-b758-185afa321517-webhook-cert\") pod \"93d3f877-b2cc-4c5a-b758-185afa321517\" (UID: \"93d3f877-b2cc-4c5a-b758-185afa321517\") "
Jul 15 18:30:59.128658 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.128628    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d3f877-b2cc-4c5a-b758-185afa321517-kube-api-access-qlq6j" (OuterVolumeSpecName: "kube-api-access-qlq6j") pod "93d3f877-b2cc-4c5a-b758-185afa321517" (UID: "93d3f877-b2cc-4c5a-b758-185afa321517"). InnerVolumeSpecName "kube-api-access-qlq6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:30:59.128894 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.128870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d3f877-b2cc-4c5a-b758-185afa321517-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "93d3f877-b2cc-4c5a-b758-185afa321517" (UID: "93d3f877-b2cc-4c5a-b758-185afa321517"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:30:59.227282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.227256    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d3f877-b2cc-4c5a-b758-185afa321517-webhook-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:30:59.227366 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.227285    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlq6j\" (UniqueName: \"kubernetes.io/projected/93d3f877-b2cc-4c5a-b758-185afa321517-kube-api-access-qlq6j\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:30:59.779413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.779334    2563 generic.go:356] "Generic (PLEG): container finished" podID="93d3f877-b2cc-4c5a-b758-185afa321517" containerID="10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458" exitCode=0
Jul 15 18:30:59.779413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.779375    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6588c6cddf-bk678"
Jul 15 18:30:59.779851 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.779417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6588c6cddf-bk678" event={"ID":"93d3f877-b2cc-4c5a-b758-185afa321517","Type":"ContainerDied","Data":"10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458"}
Jul 15 18:30:59.779851 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.779481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6588c6cddf-bk678" event={"ID":"93d3f877-b2cc-4c5a-b758-185afa321517","Type":"ContainerDied","Data":"022300e5e4349a379d3609edf9a5e6f3ac2f8b4081317afe3d03dff9a6540745"}
Jul 15 18:30:59.779851 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.779509    2563 scope.go:117] "RemoveContainer" containerID="10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458"
Jul 15 18:30:59.788246 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.788230    2563 scope.go:117] "RemoveContainer" containerID="10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458"
Jul 15 18:30:59.788532 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:30:59.788513    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458\": container with ID starting with 10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458 not found: ID does not exist" containerID="10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458"
Jul 15 18:30:59.788589 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.788539    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458"} err="failed to get container status \"10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458\": rpc error: code = NotFound desc = could not find container \"10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458\": container with ID starting with 10c90c640bd2103005a71c84d0ffb672b7073a934cabe80dde5b46b6c7efd458 not found: ID does not exist"
Jul 15 18:30:59.796411 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.796386    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6588c6cddf-bk678"]
Jul 15 18:30:59.800543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:30:59.800523    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6588c6cddf-bk678"]
Jul 15 18:31:00.481874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.481846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:00.592453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.592413    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6588c6cddf-lfgzf"]
Jul 15 18:31:00.592833 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.592816    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d3f877-b2cc-4c5a-b758-185afa321517" containerName="manager"
Jul 15 18:31:00.592907 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.592834    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d3f877-b2cc-4c5a-b758-185afa321517" containerName="manager"
Jul 15 18:31:00.592907 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.592854    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57074b01-3c60-4cc5-91dc-6bb86c5855e7" containerName="cleanup"
Jul 15 18:31:00.592907 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.592861    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="57074b01-3c60-4cc5-91dc-6bb86c5855e7" containerName="cleanup"
Jul 15 18:31:00.593077 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.592950    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="57074b01-3c60-4cc5-91dc-6bb86c5855e7" containerName="cleanup"
Jul 15 18:31:00.593077 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.592966    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d3f877-b2cc-4c5a-b758-185afa321517" containerName="manager"
Jul 15 18:31:00.597587 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.597571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:00.601230 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.601201    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 18:31:00.601230 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.601223    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 18:31:00.601373 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.601287    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vjtw5\""
Jul 15 18:31:00.606263 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.606244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6588c6cddf-lfgzf"]
Jul 15 18:31:00.638369 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.638350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nklmt\" (UniqueName: \"kubernetes.io/projected/728cbbb0-54ee-4bcb-b7e2-ef23a55136e9-kube-api-access-nklmt\") pod \"maas-controller-6588c6cddf-lfgzf\" (UID: \"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9\") " pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:00.638487 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.638380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/728cbbb0-54ee-4bcb-b7e2-ef23a55136e9-webhook-cert\") pod \"maas-controller-6588c6cddf-lfgzf\" (UID: \"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9\") " pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:00.739694 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.739642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/728cbbb0-54ee-4bcb-b7e2-ef23a55136e9-webhook-cert\") pod \"maas-controller-6588c6cddf-lfgzf\" (UID: \"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9\") " pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:00.739770 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.739721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nklmt\" (UniqueName: \"kubernetes.io/projected/728cbbb0-54ee-4bcb-b7e2-ef23a55136e9-kube-api-access-nklmt\") pod \"maas-controller-6588c6cddf-lfgzf\" (UID: \"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9\") " pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:00.741987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.741964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/728cbbb0-54ee-4bcb-b7e2-ef23a55136e9-webhook-cert\") pod \"maas-controller-6588c6cddf-lfgzf\" (UID: \"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9\") " pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:00.747676 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.747656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nklmt\" (UniqueName: \"kubernetes.io/projected/728cbbb0-54ee-4bcb-b7e2-ef23a55136e9-kube-api-access-nklmt\") pod \"maas-controller-6588c6cddf-lfgzf\" (UID: \"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9\") " pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:00.907892 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:00.907872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:01.034566 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:01.034542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6588c6cddf-lfgzf"]
Jul 15 18:31:01.036331 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:31:01.036305    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728cbbb0_54ee_4bcb_b7e2_ef23a55136e9.slice/crio-ba08ba02f42faaf0d7c1f93e1aead0920f6bfd35642d5459ff512522cb786cdc WatchSource:0}: Error finding container ba08ba02f42faaf0d7c1f93e1aead0920f6bfd35642d5459ff512522cb786cdc: Status 404 returned error can't find the container with id ba08ba02f42faaf0d7c1f93e1aead0920f6bfd35642d5459ff512522cb786cdc
Jul 15 18:31:01.376738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:01.376712    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d3f877-b2cc-4c5a-b758-185afa321517" path="/var/lib/kubelet/pods/93d3f877-b2cc-4c5a-b758-185afa321517/volumes"
Jul 15 18:31:01.791825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:01.791750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6588c6cddf-lfgzf" event={"ID":"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9","Type":"ContainerStarted","Data":"ba08ba02f42faaf0d7c1f93e1aead0920f6bfd35642d5459ff512522cb786cdc"}
Jul 15 18:31:02.798204 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:02.798174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6588c6cddf-lfgzf" event={"ID":"728cbbb0-54ee-4bcb-b7e2-ef23a55136e9","Type":"ContainerStarted","Data":"64ab551648c47f7c208fa441efe8476c615b153f8fb47529ebaa9a5eb1423c39"}
Jul 15 18:31:02.798612 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:02.798298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:02.816802 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:02.816760    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6588c6cddf-lfgzf" podStartSLOduration=1.609149603 podStartE2EDuration="2.816745875s" totalImagesPullingTime="1.207596272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:31:02.814120442 +0000 UTC m=+848.021383723" watchObservedRunningTime="2026-07-15 18:31:02.816745875 +0000 UTC m=+848.024009155"
Jul 15 18:31:13.805876 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:13.805848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6588c6cddf-lfgzf"
Jul 15 18:31:31.967252 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:31.967208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:32.062673 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:32.062641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:32.190866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:32.190837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:37.928438 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:37.928400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:38.002154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:38.002106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:38.073514 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:38.073483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:38.173433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:38.173391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:38.273606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:38.273539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:44.118960 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:44.118929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:44.219123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:44.219094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:31:55.297448 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:55.297353    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:31:55.299511 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:31:55.299487    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:32:20.417694 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:32:20.417658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:32:53.291884 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:32:53.291854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:32:53.392807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:32:53.392775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:33:10.293417 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:33:10.293387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:34:00.412961 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:34:00.412926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:34:00.508362 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:34:00.508330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:35:28.263748 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:28.263707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:35:43.183931 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:43.183888    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"]
Jul 15 18:35:43.184495 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:43.184150    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf" podUID="ec22ba52-9ce5-4aec-8103-c7668dfb58d7" containerName="manager" containerID="cri-o://c01387e09c961e3584756f45c6b86f6dfab3811b8d1c169d3554727c25596360" gracePeriod=10
Jul 15 18:35:46.410127 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.410097    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec22ba52-9ce5-4aec-8103-c7668dfb58d7" containerID="c01387e09c961e3584756f45c6b86f6dfab3811b8d1c169d3554727c25596360" exitCode=0
Jul 15 18:35:46.410570 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.410174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf" event={"ID":"ec22ba52-9ce5-4aec-8103-c7668dfb58d7","Type":"ContainerDied","Data":"c01387e09c961e3584756f45c6b86f6dfab3811b8d1c169d3554727c25596360"}
Jul 15 18:35:46.545459 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.545413    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:35:46.663175 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.663091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-extensions-socket-volume\") pod \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") "
Jul 15 18:35:46.663175 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.663157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mwnq\" (UniqueName: \"kubernetes.io/projected/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-kube-api-access-7mwnq\") pod \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\" (UID: \"ec22ba52-9ce5-4aec-8103-c7668dfb58d7\") "
Jul 15 18:35:46.663483 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.663462    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ec22ba52-9ce5-4aec-8103-c7668dfb58d7" (UID: "ec22ba52-9ce5-4aec-8103-c7668dfb58d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:35:46.665132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.665110    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-kube-api-access-7mwnq" (OuterVolumeSpecName: "kube-api-access-7mwnq") pod "ec22ba52-9ce5-4aec-8103-c7668dfb58d7" (UID: "ec22ba52-9ce5-4aec-8103-c7668dfb58d7"). InnerVolumeSpecName "kube-api-access-7mwnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:35:46.764186 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.764153    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-extensions-socket-volume\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:35:46.764186 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:46.764182    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mwnq\" (UniqueName: \"kubernetes.io/projected/ec22ba52-9ce5-4aec-8103-c7668dfb58d7-kube-api-access-7mwnq\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:35:47.417710 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:47.417682    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"
Jul 15 18:35:47.418075 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:47.417682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf" event={"ID":"ec22ba52-9ce5-4aec-8103-c7668dfb58d7","Type":"ContainerDied","Data":"a2f9fded54ba7787dc7656934df4bf440445229c600aa19b4d7fa358216042f0"}
Jul 15 18:35:47.418075 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:47.417810    2563 scope.go:117] "RemoveContainer" containerID="c01387e09c961e3584756f45c6b86f6dfab3811b8d1c169d3554727c25596360"
Jul 15 18:35:47.436626 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:47.436600    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"]
Jul 15 18:35:47.439564 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:47.439540    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xh8zf"]
Jul 15 18:35:49.376910 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:35:49.376872    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec22ba52-9ce5-4aec-8103-c7668dfb58d7" path="/var/lib/kubelet/pods/ec22ba52-9ce5-4aec-8103-c7668dfb58d7/volumes"
Jul 15 18:36:44.323075 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.323040    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"]
Jul 15 18:36:44.325556 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.323405    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec22ba52-9ce5-4aec-8103-c7668dfb58d7" containerName="manager"
Jul 15 18:36:44.325556 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.323416    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec22ba52-9ce5-4aec-8103-c7668dfb58d7" containerName="manager"
Jul 15 18:36:44.325556 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.323536    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec22ba52-9ce5-4aec-8103-c7668dfb58d7" containerName="manager"
Jul 15 18:36:44.326413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.326396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.329859 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.329838    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7p4cx\""
Jul 15 18:36:44.340375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.340352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"]
Jul 15 18:36:44.484581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.484538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17b175a1-6414-4f94-8335-b5b04c7f193c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmgp6\" (UID: \"17b175a1-6414-4f94-8335-b5b04c7f193c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.484581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.484588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cbcf\" (UniqueName: \"kubernetes.io/projected/17b175a1-6414-4f94-8335-b5b04c7f193c-kube-api-access-4cbcf\") pod \"kuadrant-operator-controller-manager-86878c769f-fmgp6\" (UID: \"17b175a1-6414-4f94-8335-b5b04c7f193c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.586179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.586083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17b175a1-6414-4f94-8335-b5b04c7f193c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmgp6\" (UID: \"17b175a1-6414-4f94-8335-b5b04c7f193c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.586179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.586131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbcf\" (UniqueName: \"kubernetes.io/projected/17b175a1-6414-4f94-8335-b5b04c7f193c-kube-api-access-4cbcf\") pod \"kuadrant-operator-controller-manager-86878c769f-fmgp6\" (UID: \"17b175a1-6414-4f94-8335-b5b04c7f193c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.586597 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.586577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17b175a1-6414-4f94-8335-b5b04c7f193c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmgp6\" (UID: \"17b175a1-6414-4f94-8335-b5b04c7f193c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.594848 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.594827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cbcf\" (UniqueName: \"kubernetes.io/projected/17b175a1-6414-4f94-8335-b5b04c7f193c-kube-api-access-4cbcf\") pod \"kuadrant-operator-controller-manager-86878c769f-fmgp6\" (UID: \"17b175a1-6414-4f94-8335-b5b04c7f193c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.636889 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.636852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:44.784011 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:44.783985    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"]
Jul 15 18:36:44.785747 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:36:44.785718    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b175a1_6414_4f94_8335_b5b04c7f193c.slice/crio-befd131988222e395783787247ee862174cdd8a73dba2898f1e73b5cde22da24 WatchSource:0}: Error finding container befd131988222e395783787247ee862174cdd8a73dba2898f1e73b5cde22da24: Status 404 returned error can't find the container with id befd131988222e395783787247ee862174cdd8a73dba2898f1e73b5cde22da24
Jul 15 18:36:45.739848 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:45.739808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6" event={"ID":"17b175a1-6414-4f94-8335-b5b04c7f193c","Type":"ContainerStarted","Data":"1f5e4e3153058f49e330d3f3fe50df6a09458e7d39b9056a544741877370257b"}
Jul 15 18:36:45.740252 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:45.739863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6" event={"ID":"17b175a1-6414-4f94-8335-b5b04c7f193c","Type":"ContainerStarted","Data":"befd131988222e395783787247ee862174cdd8a73dba2898f1e73b5cde22da24"}
Jul 15 18:36:45.740252 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:45.739935    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:36:45.761805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:45.761751    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6" podStartSLOduration=1.761732572 podStartE2EDuration="1.761732572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:36:45.760608246 +0000 UTC m=+1190.967871528" watchObservedRunningTime="2026-07-15 18:36:45.761732572 +0000 UTC m=+1190.968995859"
Jul 15 18:36:49.611654 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:49.611619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:36:49.670432 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:49.670400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:36:55.333318 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:55.333270    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:36:55.335698 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:55.335675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:36:56.748976 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:36:56.748886    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmgp6"
Jul 15 18:38:56.429776 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:38:56.429737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:39:21.863525 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:39:21.863405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:39:21.914693 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:39:21.914661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:40:50.454325 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:40:50.454243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:41:55.371547 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:41:55.371514    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:41:55.376624 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:41:55.376599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:42:21.966813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:42:21.966733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:42:32.091553 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:42:32.091517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:42:40.644085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:42:40.644051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:42:50.247266 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:42:50.247232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:42:58.494472 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:42:58.494418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:03.614159 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:03.614132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:06.672499 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:06.672468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:06.764112 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:06.764078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:07.127778 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:07.127736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:13.633562 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:13.633532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:13.776385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:13.776359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:13.946299 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:13.946270    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"]
Jul 15 18:43:13.949756 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:13.949736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:13.953744 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:13.953725    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3f3fe1b2-openshift-default-dockercfg-4rkwx\""
Jul 15 18:43:14.004058 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.004037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"]
Jul 15 18:43:14.035829 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.035803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:14.129305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.129260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:14.131468 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-podinfo\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-socket\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b8ad944-8285-4468-83f2-dcfaef4849d3-istiod-ca-cert\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-credential-socket\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131767 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-data\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131767 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-token\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131767 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-envoy\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131912 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzsm\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-kube-api-access-jzzsm\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.131912 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.131791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-certs\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.232872 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.232799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-token\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.232872 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.232837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-envoy\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.232872 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.232863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzsm\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-kube-api-access-jzzsm\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.232882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-certs\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.232907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-podinfo\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.232926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-socket\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.232952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b8ad944-8285-4468-83f2-dcfaef4849d3-istiod-ca-cert\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.233110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-credential-socket\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.233156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-data\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.233249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-certs\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233466 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.233313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-socket\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233650 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.233606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-credential-socket\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233650 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.233640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-data\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.233829 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.233796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b8ad944-8285-4468-83f2-dcfaef4849d3-istiod-ca-cert\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.235591 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.235570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-envoy\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.236014 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.235996    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-podinfo\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.241703 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.241685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-token\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.241818 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.241800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzsm\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-kube-api-access-jzzsm\") pod \"e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") " pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.259484 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.259466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:14.398325 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.398286    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"]
Jul 15 18:43:14.400704 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:43:14.400673    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8ad944_8285_4468_83f2_dcfaef4849d3.slice/crio-e390bf8da2bdb2f200863e32ecba7b07994a309cbde7523dd7d92e676bb51e49 WatchSource:0}: Error finding container e390bf8da2bdb2f200863e32ecba7b07994a309cbde7523dd7d92e676bb51e49: Status 404 returned error can't find the container with id e390bf8da2bdb2f200863e32ecba7b07994a309cbde7523dd7d92e676bb51e49
Jul 15 18:43:14.402746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.402708    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:43:14.402854 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.402776    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:43:14.402854 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.402823    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:43:14.927839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.927799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" event={"ID":"8b8ad944-8285-4468-83f2-dcfaef4849d3","Type":"ContainerStarted","Data":"60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800"}
Jul 15 18:43:14.928294 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.927865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" event={"ID":"8b8ad944-8285-4468-83f2-dcfaef4849d3","Type":"ContainerStarted","Data":"e390bf8da2bdb2f200863e32ecba7b07994a309cbde7523dd7d92e676bb51e49"}
Jul 15 18:43:14.950937 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:14.950890    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" podStartSLOduration=1.9508756 podStartE2EDuration="1.9508756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:43:14.94937263 +0000 UTC m=+1580.156635913" watchObservedRunningTime="2026-07-15 18:43:14.9508756 +0000 UTC m=+1580.158138883"
Jul 15 18:43:15.068189 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.068155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:15.166433 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.166403    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"]
Jul 15 18:43:15.170071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.170046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.171304 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.171266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:15.173966 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.173947    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3f3fe1b2-serving-cert\""
Jul 15 18:43:15.185812 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.185760    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"]
Jul 15 18:43:15.252331 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.252300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:15.260100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.260064    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:15.280631 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.280605    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:15.344863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.344832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pz7z\" (UniqueName: \"kubernetes.io/projected/fa9fd600-18dd-40a3-9482-960556539cfb-kube-api-access-8pz7z\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.345017 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.344877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fd600-18dd-40a3-9482-960556539cfb-openshift-service-ca\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.345017 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.344983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.446550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.446484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pz7z\" (UniqueName: \"kubernetes.io/projected/fa9fd600-18dd-40a3-9482-960556539cfb-kube-api-access-8pz7z\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.446550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.446527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fd600-18dd-40a3-9482-960556539cfb-openshift-service-ca\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.446727 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.446577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.446727 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:43:15.446707    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-serving-cert: secret "maas-api-e2e-ait-3f3fe1b2-serving-cert" not found
Jul 15 18:43:15.446898 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:43:15.446755    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls podName:fa9fd600-18dd-40a3-9482-960556539cfb nodeName:}" failed. No retries permitted until 2026-07-15 18:43:15.946740697 +0000 UTC m=+1581.154003958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls") pod "maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" (UID: "fa9fd600-18dd-40a3-9482-960556539cfb") : secret "maas-api-e2e-ait-3f3fe1b2-serving-cert" not found
Jul 15 18:43:15.447263 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.447239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fd600-18dd-40a3-9482-960556539cfb-openshift-service-ca\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.460137 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.460112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pz7z\" (UniqueName: \"kubernetes.io/projected/fa9fd600-18dd-40a3-9482-960556539cfb-kube-api-access-8pz7z\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.907472 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.907443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:15.934139 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.934117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:15.935023 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.935003    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:15.954398 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:15.954360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:15.954571 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:43:15.954531    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-serving-cert: secret "maas-api-e2e-ait-3f3fe1b2-serving-cert" not found
Jul 15 18:43:15.954642 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:43:15.954593    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls podName:fa9fd600-18dd-40a3-9482-960556539cfb nodeName:}" failed. No retries permitted until 2026-07-15 18:43:16.954573599 +0000 UTC m=+1582.161836870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls") pod "maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" (UID: "fa9fd600-18dd-40a3-9482-960556539cfb") : secret "maas-api-e2e-ait-3f3fe1b2-serving-cert" not found
Jul 15 18:43:16.002537 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:16.002501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:16.102334 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:16.102306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:16.963529 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:16.963499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:16.965890 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:16.965858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls\") pod \"maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:16.982748 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:16.982719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:17.123383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:17.123358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"]
Jul 15 18:43:17.125089 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:43:17.125064    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9fd600_18dd_40a3_9482_960556539cfb.slice/crio-11ebd46c0f9633257c70ac52faa38d9c3eb64d897a0a32124ffe7c5ca9a7be43 WatchSource:0}: Error finding container 11ebd46c0f9633257c70ac52faa38d9c3eb64d897a0a32124ffe7c5ca9a7be43: Status 404 returned error can't find the container with id 11ebd46c0f9633257c70ac52faa38d9c3eb64d897a0a32124ffe7c5ca9a7be43
Jul 15 18:43:17.126837 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:17.126816    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:43:17.679724 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:17.679697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:17.948980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:17.948899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" event={"ID":"fa9fd600-18dd-40a3-9482-960556539cfb","Type":"ContainerStarted","Data":"79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625"}
Jul 15 18:43:17.948980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:17.948954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" event={"ID":"fa9fd600-18dd-40a3-9482-960556539cfb","Type":"ContainerStarted","Data":"11ebd46c0f9633257c70ac52faa38d9c3eb64d897a0a32124ffe7c5ca9a7be43"}
Jul 15 18:43:17.949205 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:17.949195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:17.975328 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:17.975289    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" podStartSLOduration=2.429164321 podStartE2EDuration="2.975277193s" totalImagesPullingTime="546.112872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:43:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:43:17.972646548 +0000 UTC m=+1583.179909828" watchObservedRunningTime="2026-07-15 18:43:17.975277193 +0000 UTC m=+1583.182540476"
Jul 15 18:43:24.965270 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:24.965240    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:43:27.013233 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:27.013203    2563 generic.go:356] "Generic (PLEG): container finished" podID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerID="60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800" exitCode=0
Jul 15 18:43:27.013758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:27.013278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" event={"ID":"8b8ad944-8285-4468-83f2-dcfaef4849d3","Type":"ContainerDied","Data":"60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800"}
Jul 15 18:43:27.013839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:27.013778    2563 scope.go:117] "RemoveContainer" containerID="60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800"
Jul 15 18:43:27.014813 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:27.014784    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:43:27.014870 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:27.014856    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:43:27.014906 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:27.014889    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:43:28.020882 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:28.020850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" event={"ID":"8b8ad944-8285-4468-83f2-dcfaef4849d3","Type":"ContainerStarted","Data":"247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610"}
Jul 15 18:43:28.260445 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:28.260396    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:28.261597 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:28.261574    2563 patch_prober.go:28] interesting pod/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 18:43:28.261708 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:28.261636    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 18:43:29.259877 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:29.259844    2563 patch_prober.go:28] interesting pod/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 18:43:29.260273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:29.259901    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 18:43:30.260684 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:30.260652    2563 patch_prober.go:28] interesting pod/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 18:43:30.261084 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:30.260700    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 18:43:30.934739 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:30.934707    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:31.260585 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:31.260509    2563 patch_prober.go:28] interesting pod/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 18:43:31.260585 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:31.260559    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 18:43:32.263924 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:32.263888    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:32.264917 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:32.264896    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:43:53.219627 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:53.219534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:43:53.292034 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:43:53.292000    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:30.594884 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.594843    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"]
Jul 15 18:44:30.595524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.595032    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" podUID="fa9fd600-18dd-40a3-9482-960556539cfb" containerName="maas-api" containerID="cri-o://79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625" gracePeriod=30
Jul 15 18:44:30.622469 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.622411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:30.855718 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.855667    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:44:30.969050 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.969023    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fd600-18dd-40a3-9482-960556539cfb-openshift-service-ca\") pod \"fa9fd600-18dd-40a3-9482-960556539cfb\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") "
Jul 15 18:44:30.969215 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.969057    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pz7z\" (UniqueName: \"kubernetes.io/projected/fa9fd600-18dd-40a3-9482-960556539cfb-kube-api-access-8pz7z\") pod \"fa9fd600-18dd-40a3-9482-960556539cfb\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") "
Jul 15 18:44:30.969215 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.969110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls\") pod \"fa9fd600-18dd-40a3-9482-960556539cfb\" (UID: \"fa9fd600-18dd-40a3-9482-960556539cfb\") "
Jul 15 18:44:30.969444 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.969397    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa9fd600-18dd-40a3-9482-960556539cfb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa9fd600-18dd-40a3-9482-960556539cfb" (UID: "fa9fd600-18dd-40a3-9482-960556539cfb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:44:30.971110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.971077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa9fd600-18dd-40a3-9482-960556539cfb" (UID: "fa9fd600-18dd-40a3-9482-960556539cfb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:44:30.971203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:30.971172    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa9fd600-18dd-40a3-9482-960556539cfb-kube-api-access-8pz7z" (OuterVolumeSpecName: "kube-api-access-8pz7z") pod "fa9fd600-18dd-40a3-9482-960556539cfb" (UID: "fa9fd600-18dd-40a3-9482-960556539cfb"). InnerVolumeSpecName "kube-api-access-8pz7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:44:31.070214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.070191    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9fd600-18dd-40a3-9482-960556539cfb-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:31.070214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.070215    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fd600-18dd-40a3-9482-960556539cfb-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:31.070371 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.070224    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pz7z\" (UniqueName: \"kubernetes.io/projected/fa9fd600-18dd-40a3-9482-960556539cfb-kube-api-access-8pz7z\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:31.397283 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.397255    2563 generic.go:356] "Generic (PLEG): container finished" podID="fa9fd600-18dd-40a3-9482-960556539cfb" containerID="79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625" exitCode=0
Jul 15 18:44:31.397404 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.397301    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"
Jul 15 18:44:31.397404 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.397329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" event={"ID":"fa9fd600-18dd-40a3-9482-960556539cfb","Type":"ContainerDied","Data":"79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625"}
Jul 15 18:44:31.397404 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.397396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2" event={"ID":"fa9fd600-18dd-40a3-9482-960556539cfb","Type":"ContainerDied","Data":"11ebd46c0f9633257c70ac52faa38d9c3eb64d897a0a32124ffe7c5ca9a7be43"}
Jul 15 18:44:31.397596 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.397417    2563 scope.go:117] "RemoveContainer" containerID="79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625"
Jul 15 18:44:31.409607 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.409592    2563 scope.go:117] "RemoveContainer" containerID="79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625"
Jul 15 18:44:31.409873 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:44:31.409854    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625\": container with ID starting with 79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625 not found: ID does not exist" containerID="79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625"
Jul 15 18:44:31.409933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.409880    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625"} err="failed to get container status \"79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625\": rpc error: code = NotFound desc = could not find container \"79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625\": container with ID starting with 79b4a5c49780d796a91efd45ae51c15b6a19015cead303ec91e622ba63480625 not found: ID does not exist"
Jul 15 18:44:31.417048 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.417030    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"]
Jul 15 18:44:31.421130 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:31.421111    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3f3fe1b2-67db7889bc-r45j2"]
Jul 15 18:44:33.377385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:33.377353    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa9fd600-18dd-40a3-9482-960556539cfb" path="/var/lib/kubelet/pods/fa9fd600-18dd-40a3-9482-960556539cfb/volumes"
Jul 15 18:44:35.224102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:35.224058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:41.053602 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:41.053569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:41.154763 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:41.154734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:45.434099 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:45.434067    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"]
Jul 15 18:44:45.434527 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:45.434245    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy" containerID="cri-o://247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610" gracePeriod=30
Jul 15 18:44:45.460024 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:45.459997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:45.894823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:45.894796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:45.957177 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:45.957153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:46.056117 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.056084    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"]
Jul 15 18:44:46.056660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.056635    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9fd600-18dd-40a3-9482-960556539cfb" containerName="maas-api"
Jul 15 18:44:46.056660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.056660    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9fd600-18dd-40a3-9482-960556539cfb" containerName="maas-api"
Jul 15 18:44:46.056840 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.056780    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9fd600-18dd-40a3-9482-960556539cfb" containerName="maas-api"
Jul 15 18:44:46.061004 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.060985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.063481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.063462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-827ccb59-gw-openshift-default-dockercfg-h5d9l\""
Jul 15 18:44:46.072948 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.072924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"]
Jul 15 18:44:46.091922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.091892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:46.180476 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-certs\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180476 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-podinfo\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-socket\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzq9q\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-kube-api-access-gzq9q\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-envoy\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-credential-socket\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f01e869b-faea-4fa8-ae9f-8874ed930967-istiod-ca-cert\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180967 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-data\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.180967 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.180866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-token\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.281820 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9q\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-kube-api-access-gzq9q\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.281965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-envoy\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.281965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-credential-socket\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.281965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f01e869b-faea-4fa8-ae9f-8874ed930967-istiod-ca-cert\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.281965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-data\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.281965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-token\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.281965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-certs\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.282268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.281987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-podinfo\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.282268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.282015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-socket\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.282444 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.282400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-data\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.282517 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.282464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-socket\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.282517 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.282497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-certs\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.282625 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.282512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-credential-socket\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.282746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.282723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f01e869b-faea-4fa8-ae9f-8874ed930967-istiod-ca-cert\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.284241 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.284217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-envoy\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.284689 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.284674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-podinfo\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.290055 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.290032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzq9q\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-kube-api-access-gzq9q\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.290131 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.290107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-token\") pod \"e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") " pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.372069 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.372046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:46.512149 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.512123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"]
Jul 15 18:44:46.513516 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:44:46.513490    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01e869b_faea_4fa8_ae9f_8874ed930967.slice/crio-03c557a6a28d6645f702a37ee4484ef3b294ba97f9d214361d13ed1d6db0f032 WatchSource:0}: Error finding container 03c557a6a28d6645f702a37ee4484ef3b294ba97f9d214361d13ed1d6db0f032: Status 404 returned error can't find the container with id 03c557a6a28d6645f702a37ee4484ef3b294ba97f9d214361d13ed1d6db0f032
Jul 15 18:44:46.515602 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.515570    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:44:46.515674 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.515634    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:44:46.515674 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:46.515662    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:44:47.267088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.267051    2563 patch_prober.go:28] interesting pod/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 18:44:47.267253 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.267118    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:44:47.342957 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.342923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:47.422379 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.422052    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"]
Jul 15 18:44:47.425762 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.425738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.429910 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.428545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-827ccb59-serving-cert\""
Jul 15 18:44:47.440200 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.440175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"]
Jul 15 18:44:47.465093 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.465063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:47.491287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.491265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" event={"ID":"f01e869b-faea-4fa8-ae9f-8874ed930967","Type":"ContainerStarted","Data":"5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510"}
Jul 15 18:44:47.491388 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.491305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" event={"ID":"f01e869b-faea-4fa8-ae9f-8874ed930967","Type":"ContainerStarted","Data":"03c557a6a28d6645f702a37ee4484ef3b294ba97f9d214361d13ed1d6db0f032"}
Jul 15 18:44:47.493866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.493841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2c6f1-10c3-4f70-95d9-ec2783285579-openshift-service-ca\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.493978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.493881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.493978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.493903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvztm\" (UniqueName: \"kubernetes.io/projected/9ca2c6f1-10c3-4f70-95d9-ec2783285579-kube-api-access-wvztm\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.514007 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.513959    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" podStartSLOduration=1.5139418679999999 podStartE2EDuration="1.513941868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:44:47.511310667 +0000 UTC m=+1672.718573950" watchObservedRunningTime="2026-07-15 18:44:47.513941868 +0000 UTC m=+1672.721205155"
Jul 15 18:44:47.594808 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.594779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2c6f1-10c3-4f70-95d9-ec2783285579-openshift-service-ca\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.594949 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.594840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.594949 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.594879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvztm\" (UniqueName: \"kubernetes.io/projected/9ca2c6f1-10c3-4f70-95d9-ec2783285579-kube-api-access-wvztm\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.595066 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:44:47.594945    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-serving-cert: secret "maas-api-e2e-migrate-827ccb59-serving-cert" not found
Jul 15 18:44:47.595066 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:44:47.595009    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls podName:9ca2c6f1-10c3-4f70-95d9-ec2783285579 nodeName:}" failed. No retries permitted until 2026-07-15 18:44:48.094988565 +0000 UTC m=+1673.302251840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls") pod "maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh" (UID: "9ca2c6f1-10c3-4f70-95d9-ec2783285579") : secret "maas-api-e2e-migrate-827ccb59-serving-cert" not found
Jul 15 18:44:47.595795 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.595777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2c6f1-10c3-4f70-95d9-ec2783285579-openshift-service-ca\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.605273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.605248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvztm\" (UniqueName: \"kubernetes.io/projected/9ca2c6f1-10c3-4f70-95d9-ec2783285579-kube-api-access-wvztm\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:47.723883 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.723854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:47.938934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:47.938860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:48.038880 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.038854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:48.098035 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.098002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:48.100837 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.100777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls\") pod \"maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:48.342085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.342057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:48.372820 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.372795    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:48.377786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.377764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:48.477370 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.477345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"]
Jul 15 18:44:48.478279 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:44:48.478255    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca2c6f1_10c3_4f70_95d9_ec2783285579.slice/crio-8d4dc24b42149667fe95fbe92b38ba58f8246e6b8a24d7dd0a85c63558db1a20 WatchSource:0}: Error finding container 8d4dc24b42149667fe95fbe92b38ba58f8246e6b8a24d7dd0a85c63558db1a20: Status 404 returned error can't find the container with id 8d4dc24b42149667fe95fbe92b38ba58f8246e6b8a24d7dd0a85c63558db1a20
Jul 15 18:44:48.498738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.498714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh" event={"ID":"9ca2c6f1-10c3-4f70-95d9-ec2783285579","Type":"ContainerStarted","Data":"8d4dc24b42149667fe95fbe92b38ba58f8246e6b8a24d7dd0a85c63558db1a20"}
Jul 15 18:44:48.499086 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.499071    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:48.499972 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:48.499954    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:44:49.505597 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:49.505559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh" event={"ID":"9ca2c6f1-10c3-4f70-95d9-ec2783285579","Type":"ContainerStarted","Data":"b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641"}
Jul 15 18:44:49.506065 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:49.505874    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:49.524643 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:49.524600    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh" podStartSLOduration=2.043617104 podStartE2EDuration="2.524586047s" totalImagesPullingTime="480.968943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:44:49.521205209 +0000 UTC m=+1674.728468503" watchObservedRunningTime="2026-07-15 18:44:49.524586047 +0000 UTC m=+1674.731849330"
Jul 15 18:44:50.685812 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.685790    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:44:50.722546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722474    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-certs\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722507    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b8ad944-8285-4468-83f2-dcfaef4849d3-istiod-ca-cert\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-data\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-credential-socket\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-envoy\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722682    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzzsm\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-kube-api-access-jzzsm\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722724    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-podinfo\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722749    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-socket\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-token\") pod \"8b8ad944-8285-4468-83f2-dcfaef4849d3\" (UID: \"8b8ad944-8285-4468-83f2-dcfaef4849d3\") "
Jul 15 18:44:50.722786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722781    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:44:50.723144 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.722896    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b8ad944-8285-4468-83f2-dcfaef4849d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:44:50.723144 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.723085    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b8ad944-8285-4468-83f2-dcfaef4849d3-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.723144 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.723106    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.723297 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.723154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:44:50.723356 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.723316    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:44:50.723599 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.723557    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:44:50.725540 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.725501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:44:50.725707 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.725587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-kube-api-access-jzzsm" (OuterVolumeSpecName: "kube-api-access-jzzsm") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "kube-api-access-jzzsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:44:50.726003 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.725977    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:44:50.726853 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.726819    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b8ad944-8285-4468-83f2-dcfaef4849d3" (UID: "8b8ad944-8285-4468-83f2-dcfaef4849d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:44:50.823797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.823755    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.823797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.823786    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.823797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.823798    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.824079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.823809    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzzsm\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-kube-api-access-jzzsm\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.824079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.823817    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.824079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.823827    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b8ad944-8285-4468-83f2-dcfaef4849d3-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:50.824079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:50.823834    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8ad944-8285-4468-83f2-dcfaef4849d3-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:44:51.519142 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.519104    2563 generic.go:356] "Generic (PLEG): container finished" podID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerID="247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610" exitCode=0
Jul 15 18:44:51.519315 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.519171    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"
Jul 15 18:44:51.519315 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.519190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" event={"ID":"8b8ad944-8285-4468-83f2-dcfaef4849d3","Type":"ContainerDied","Data":"247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610"}
Jul 15 18:44:51.519315 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.519238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp" event={"ID":"8b8ad944-8285-4468-83f2-dcfaef4849d3","Type":"ContainerDied","Data":"e390bf8da2bdb2f200863e32ecba7b07994a309cbde7523dd7d92e676bb51e49"}
Jul 15 18:44:51.519315 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.519262    2563 scope.go:117] "RemoveContainer" containerID="247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610"
Jul 15 18:44:51.538606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.538564    2563 scope.go:117] "RemoveContainer" containerID="60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800"
Jul 15 18:44:51.540324 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.540301    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"]
Jul 15 18:44:51.545816 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.545745    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3f3fe1b2-openshift-default-9b85b6647-kd7xp"]
Jul 15 18:44:51.553815 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.553800    2563 scope.go:117] "RemoveContainer" containerID="247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610"
Jul 15 18:44:51.555092 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:44:51.555068    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610\": container with ID starting with 247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610 not found: ID does not exist" containerID="247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610"
Jul 15 18:44:51.555271 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.555245    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610"} err="failed to get container status \"247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610\": rpc error: code = NotFound desc = could not find container \"247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610\": container with ID starting with 247de4ebf20b8753cc30783f165354164297e9c6ddf0e8b9f23a50fdd29bb610 not found: ID does not exist"
Jul 15 18:44:51.555401 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.555388    2563 scope.go:117] "RemoveContainer" containerID="60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800"
Jul 15 18:44:51.556845 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:44:51.556790    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800\": container with ID starting with 60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800 not found: ID does not exist" containerID="60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800"
Jul 15 18:44:51.556845 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:51.556821    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800"} err="failed to get container status \"60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800\": rpc error: code = NotFound desc = could not find container \"60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800\": container with ID starting with 60f427c7989ba32715a2204a20f4e41ea45e951f2db803f1e137d15c4e4d1800 not found: ID does not exist"
Jul 15 18:44:53.377561 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:53.377533    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" path="/var/lib/kubelet/pods/8b8ad944-8285-4468-83f2-dcfaef4849d3/volumes"
Jul 15 18:44:56.524943 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:56.524917    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:44:58.568718 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.568687    2563 generic.go:356] "Generic (PLEG): container finished" podID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerID="5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510" exitCode=0
Jul 15 18:44:58.569109 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.568760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" event={"ID":"f01e869b-faea-4fa8-ae9f-8874ed930967","Type":"ContainerDied","Data":"5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510"}
Jul 15 18:44:58.569109 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.569084    2563 scope.go:117] "RemoveContainer" containerID="5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510"
Jul 15 18:44:58.569998 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.569972    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:44:58.570068 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.570054    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:44:58.570106 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.570090    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:44:58.747785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.747747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:58.810313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:58.810279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:44:59.576153 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:44:59.576116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" event={"ID":"f01e869b-faea-4fa8-ae9f-8874ed930967","Type":"ContainerStarted","Data":"c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4"}
Jul 15 18:45:00.372178 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:00.372152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:45:00.373501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:00.373475    2563 patch_prober.go:28] interesting pod/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 18:45:00.373645 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:00.373520    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 18:45:01.373094 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:01.373061    2563 patch_prober.go:28] interesting pod/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 18:45:01.373591 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:01.373133    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 18:45:02.182612 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:02.182575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:45:02.373081 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:02.373043    2563 patch_prober.go:28] interesting pod/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 18:45:02.373244 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:02.373098    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 18:45:03.373228 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:03.373191    2563 patch_prober.go:28] interesting pod/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 18:45:03.373533 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:03.373495    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 18:45:03.499181 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:03.499154    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:45:04.376476 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:04.376446    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:45:04.377521 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:04.377494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:45:52.029058 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:52.029025    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"]
Jul 15 18:45:52.029586 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:52.029239    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy" containerID="cri-o://c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4" gracePeriod=30
Jul 15 18:45:52.096768 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:52.096740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:45:52.196762 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:52.196727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:45:57.312183 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.312158    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:45:57.384375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-credential-socket\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-token\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-podinfo\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384496    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-envoy\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384682 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384645    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f01e869b-faea-4fa8-ae9f-8874ed930967-istiod-ca-cert\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384741 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzq9q\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-kube-api-access-gzq9q\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384649    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:45:57.384797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384765    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-certs\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384801    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-data\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.384909 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.384840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-socket\") pod \"f01e869b-faea-4fa8-ae9f-8874ed930967\" (UID: \"f01e869b-faea-4fa8-ae9f-8874ed930967\") "
Jul 15 18:45:57.385046 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.385024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f01e869b-faea-4fa8-ae9f-8874ed930967-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:45:57.385204 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.385187    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.385281 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.385210    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f01e869b-faea-4fa8-ae9f-8874ed930967-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.385281 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.385243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:45:57.385442 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.385398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:45:57.385934 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.385909    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-data" (OuterVolumeSpecName: "istio-data") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:45:57.386790 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.386765    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-token" (OuterVolumeSpecName: "istio-token") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:45:57.387059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.387036    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:45:57.387123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.387038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:45:57.387264 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.387237    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-kube-api-access-gzq9q" (OuterVolumeSpecName: "kube-api-access-gzq9q") pod "f01e869b-faea-4fa8-ae9f-8874ed930967" (UID: "f01e869b-faea-4fa8-ae9f-8874ed930967"). InnerVolumeSpecName "kube-api-access-gzq9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:45:57.485861 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.485836    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.485861 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.485858    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.485861 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.485866    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzq9q\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-kube-api-access-gzq9q\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.486039 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.485875    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.486039 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.485885    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.486039 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.485892    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f01e869b-faea-4fa8-ae9f-8874ed930967-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.486039 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.485900    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f01e869b-faea-4fa8-ae9f-8874ed930967-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.513288 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.513265    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"]
Jul 15 18:45:57.513558 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.513514    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh" podUID="9ca2c6f1-10c3-4f70-95d9-ec2783285579" containerName="maas-api" containerID="cri-o://b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641" gracePeriod=30
Jul 15 18:45:57.541457 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.541381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:45:57.760382 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.760356    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:45:57.889123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.889101    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls\") pod \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") "
Jul 15 18:45:57.889255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.889168    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvztm\" (UniqueName: \"kubernetes.io/projected/9ca2c6f1-10c3-4f70-95d9-ec2783285579-kube-api-access-wvztm\") pod \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") "
Jul 15 18:45:57.889255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.889227    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2c6f1-10c3-4f70-95d9-ec2783285579-openshift-service-ca\") pod \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\" (UID: \"9ca2c6f1-10c3-4f70-95d9-ec2783285579\") "
Jul 15 18:45:57.889614 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.889587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca2c6f1-10c3-4f70-95d9-ec2783285579-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ca2c6f1-10c3-4f70-95d9-ec2783285579" (UID: "9ca2c6f1-10c3-4f70-95d9-ec2783285579"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:45:57.891044 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.891019    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ca2c6f1-10c3-4f70-95d9-ec2783285579" (UID: "9ca2c6f1-10c3-4f70-95d9-ec2783285579"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:45:57.891159 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.891141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca2c6f1-10c3-4f70-95d9-ec2783285579-kube-api-access-wvztm" (OuterVolumeSpecName: "kube-api-access-wvztm") pod "9ca2c6f1-10c3-4f70-95d9-ec2783285579" (UID: "9ca2c6f1-10c3-4f70-95d9-ec2783285579"). InnerVolumeSpecName "kube-api-access-wvztm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:45:57.923865 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.923825    2563 generic.go:356] "Generic (PLEG): container finished" podID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerID="c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4" exitCode=0
Jul 15 18:45:57.923987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.923886    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"
Jul 15 18:45:57.923987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.923904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" event={"ID":"f01e869b-faea-4fa8-ae9f-8874ed930967","Type":"ContainerDied","Data":"c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4"}
Jul 15 18:45:57.923987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.923981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg" event={"ID":"f01e869b-faea-4fa8-ae9f-8874ed930967","Type":"ContainerDied","Data":"03c557a6a28d6645f702a37ee4484ef3b294ba97f9d214361d13ed1d6db0f032"}
Jul 15 18:45:57.924157 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.924005    2563 scope.go:117] "RemoveContainer" containerID="c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4"
Jul 15 18:45:57.925594 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.925562    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ca2c6f1-10c3-4f70-95d9-ec2783285579" containerID="b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641" exitCode=0
Jul 15 18:45:57.925732 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.925618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh" event={"ID":"9ca2c6f1-10c3-4f70-95d9-ec2783285579","Type":"ContainerDied","Data":"b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641"}
Jul 15 18:45:57.925732 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.925663    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"
Jul 15 18:45:57.925732 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.925671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh" event={"ID":"9ca2c6f1-10c3-4f70-95d9-ec2783285579","Type":"ContainerDied","Data":"8d4dc24b42149667fe95fbe92b38ba58f8246e6b8a24d7dd0a85c63558db1a20"}
Jul 15 18:45:57.933962 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.933927    2563 scope.go:117] "RemoveContainer" containerID="5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510"
Jul 15 18:45:57.942829 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.942814    2563 scope.go:117] "RemoveContainer" containerID="c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4"
Jul 15 18:45:57.943097 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:45:57.943080    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4\": container with ID starting with c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4 not found: ID does not exist" containerID="c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4"
Jul 15 18:45:57.943150 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.943104    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4"} err="failed to get container status \"c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4\": rpc error: code = NotFound desc = could not find container \"c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4\": container with ID starting with c19a105d5fde2de6fc897d75064ee53131323065d60a79b7f07425dc8f8c02e4 not found: ID does not exist"
Jul 15 18:45:57.943150 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.943119    2563 scope.go:117] "RemoveContainer" containerID="5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510"
Jul 15 18:45:57.943371 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:45:57.943356    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510\": container with ID starting with 5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510 not found: ID does not exist" containerID="5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510"
Jul 15 18:45:57.943436 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.943374    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510"} err="failed to get container status \"5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510\": rpc error: code = NotFound desc = could not find container \"5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510\": container with ID starting with 5adad6779cf20d8f342eec0a4cedf384c6a73cd2fcf80a3b9e433b4f4de6d510 not found: ID does not exist"
Jul 15 18:45:57.943436 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.943386    2563 scope.go:117] "RemoveContainer" containerID="b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641"
Jul 15 18:45:57.949246 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.949221    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"]
Jul 15 18:45:57.952164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.952133    2563 scope.go:117] "RemoveContainer" containerID="b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641"
Jul 15 18:45:57.952394 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:45:57.952377    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641\": container with ID starting with b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641 not found: ID does not exist" containerID="b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641"
Jul 15 18:45:57.952479 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.952440    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641"} err="failed to get container status \"b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641\": rpc error: code = NotFound desc = could not find container \"b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641\": container with ID starting with b1b4d1dd53dc03434c62cd602dd36c8a8d34da000aa2e5964473a03ac8cc4641 not found: ID does not exist"
Jul 15 18:45:57.952897 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.952878    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-827ccb59-gw-openshift-default-9cb69496c-w7zlg"]
Jul 15 18:45:57.962523 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.962501    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"]
Jul 15 18:45:57.968028 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.968006    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-827ccb59-678c74b79-gpgnh"]
Jul 15 18:45:57.990187 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.990171    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca2c6f1-10c3-4f70-95d9-ec2783285579-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.990276 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.990207    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvztm\" (UniqueName: \"kubernetes.io/projected/9ca2c6f1-10c3-4f70-95d9-ec2783285579-kube-api-access-wvztm\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:57.990276 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:57.990218    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2c6f1-10c3-4f70-95d9-ec2783285579-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:45:58.282100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:58.282045    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:45:58.703532 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:58.703493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:45:59.377825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:59.377791    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca2c6f1-10c3-4f70-95d9-ec2783285579" path="/var/lib/kubelet/pods/9ca2c6f1-10c3-4f70-95d9-ec2783285579/volumes"
Jul 15 18:45:59.378199 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:45:59.378186    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" path="/var/lib/kubelet/pods/f01e869b-faea-4fa8-ae9f-8874ed930967/volumes"
Jul 15 18:46:03.773591 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.773554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:03.875687 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.875660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:03.966316 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.966286    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"]
Jul 15 18:46:03.966920 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.966896    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy"
Jul 15 18:46:03.966920 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.966922    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy"
Jul 15 18:46:03.967107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.966937    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy"
Jul 15 18:46:03.967107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.966946    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy"
Jul 15 18:46:03.967107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.966983    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca2c6f1-10c3-4f70-95d9-ec2783285579" containerName="maas-api"
Jul 15 18:46:03.967107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.966992    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca2c6f1-10c3-4f70-95d9-ec2783285579" containerName="maas-api"
Jul 15 18:46:03.967107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.967093    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy"
Jul 15 18:46:03.967107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.967106    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy"
Jul 15 18:46:03.967413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.967117    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy"
Jul 15 18:46:03.967413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.967126    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca2c6f1-10c3-4f70-95d9-ec2783285579" containerName="maas-api"
Jul 15 18:46:03.967413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.967136    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy"
Jul 15 18:46:03.972270 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.972249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:03.974807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.974785    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cfe32069-openshift-default-dockercfg-ppmtd\""
Jul 15 18:46:03.980372 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:03.980345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"]
Jul 15 18:46:04.002324 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.002292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:04.037745 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.037678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-certs\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.037745 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.037723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-istio-token\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.037896 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.037784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e62b78-712e-4971-bbf8-9f901896058f-istio-podinfo\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.037896 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.037815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-credential-socket\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.037974 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.037895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e62b78-712e-4971-bbf8-9f901896058f-istiod-ca-cert\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.037974 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.037923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbthj\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-kube-api-access-mbthj\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.037974 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.037943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-socket\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.038107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.038008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-envoy\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.038107 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.038022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-data\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.068992 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.068957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:04.139179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e62b78-712e-4971-bbf8-9f901896058f-istiod-ca-cert\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139262 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbthj\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-kube-api-access-mbthj\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139262 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-socket\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139262 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-envoy\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139262 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-data\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139487 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-certs\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139487 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-istio-token\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139487 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e62b78-712e-4971-bbf8-9f901896058f-istio-podinfo\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139645 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-credential-socket\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139708 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139688    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-certs\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139814 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-socket\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139938 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-data\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.139938 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.139877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-credential-socket\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.140078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.140063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e62b78-712e-4971-bbf8-9f901896058f-istiod-ca-cert\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.141747 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.141725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-envoy\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.141869 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.141851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e62b78-712e-4971-bbf8-9f901896058f-istio-podinfo\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.150347 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.150323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbthj\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-kube-api-access-mbthj\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.150524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.150357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-istio-token\") pod \"e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") " pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.284606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.284582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:04.426340 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.426310    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"]
Jul 15 18:46:04.427408 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:46:04.427380    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e62b78_712e_4971_bbf8_9f901896058f.slice/crio-35eb3b1b58853efeb1dbe7534cb1f990776ecb569ab15e488c05da99a2681db8 WatchSource:0}: Error finding container 35eb3b1b58853efeb1dbe7534cb1f990776ecb569ab15e488c05da99a2681db8: Status 404 returned error can't find the container with id 35eb3b1b58853efeb1dbe7534cb1f990776ecb569ab15e488c05da99a2681db8
Jul 15 18:46:04.429617 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.429580    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:46:04.429734 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.429665    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:46:04.429734 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.429708    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:46:04.970737 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.970700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" event={"ID":"78e62b78-712e-4971-bbf8-9f901896058f","Type":"ContainerStarted","Data":"847c19a268e88896e59d80fe61844287d2e723586c1a4fd53fdc47d3817bc95b"}
Jul 15 18:46:04.971145 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.970751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" event={"ID":"78e62b78-712e-4971-bbf8-9f901896058f","Type":"ContainerStarted","Data":"35eb3b1b58853efeb1dbe7534cb1f990776ecb569ab15e488c05da99a2681db8"}
Jul 15 18:46:04.992227 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:04.992186    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" podStartSLOduration=1.99216988 podStartE2EDuration="1.99216988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:46:04.989378611 +0000 UTC m=+1750.196641905" watchObservedRunningTime="2026-07-15 18:46:04.99216988 +0000 UTC m=+1750.199433162"
Jul 15 18:46:05.103017 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.102982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:05.180637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.180604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:05.181183 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.181156    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"]
Jul 15 18:46:05.181770 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.181745    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy"
Jul 15 18:46:05.181770 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.181770    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f01e869b-faea-4fa8-ae9f-8874ed930967" containerName="istio-proxy"
Jul 15 18:46:05.181937 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.181785    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy"
Jul 15 18:46:05.181937 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.181794    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8ad944-8285-4468-83f2-dcfaef4849d3" containerName="istio-proxy"
Jul 15 18:46:05.185497 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.185477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.187807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.187790    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cfe32069-serving-cert\""
Jul 15 18:46:05.195310 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.195260    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"]
Jul 15 18:46:05.249778 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.249710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9p8\" (UniqueName: \"kubernetes.io/projected/c0b9287a-2586-48bb-86e3-0d31021306da-kube-api-access-6l9p8\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.249906 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.249844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.249973 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.249913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b9287a-2586-48bb-86e3-0d31021306da-openshift-service-ca\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.285562 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.285537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:05.318035 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.318010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:05.350874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.350849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b9287a-2586-48bb-86e3-0d31021306da-openshift-service-ca\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.351059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.350919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9p8\" (UniqueName: \"kubernetes.io/projected/c0b9287a-2586-48bb-86e3-0d31021306da-kube-api-access-6l9p8\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.351059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.351003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.351186 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:46:05.351127    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-serving-cert: secret "maas-api-e2e-ait-cfe32069-serving-cert" not found
Jul 15 18:46:05.351234 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:46:05.351191    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls podName:c0b9287a-2586-48bb-86e3-0d31021306da nodeName:}" failed. No retries permitted until 2026-07-15 18:46:05.851171407 +0000 UTC m=+1751.058434682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls") pod "maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p" (UID: "c0b9287a-2586-48bb-86e3-0d31021306da") : secret "maas-api-e2e-ait-cfe32069-serving-cert" not found
Jul 15 18:46:05.351613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.351592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b9287a-2586-48bb-86e3-0d31021306da-openshift-service-ca\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.359874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.359844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9p8\" (UniqueName: \"kubernetes.io/projected/c0b9287a-2586-48bb-86e3-0d31021306da-kube-api-access-6l9p8\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.855901 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.855871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.858279 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.858255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls\") pod \"maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:05.976660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.976627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:05.977497 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:05.977479    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:06.085672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:06.085636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:06.101655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:06.101628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:06.192262 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:06.191292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:06.246129 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:06.246098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"]
Jul 15 18:46:06.249747 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:46:06.249712    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b9287a_2586_48bb_86e3_0d31021306da.slice/crio-8a7339db4ebbed7852dd7c35d9392700777b8ae589eb3ff26d68c63ffc13c937 WatchSource:0}: Error finding container 8a7339db4ebbed7852dd7c35d9392700777b8ae589eb3ff26d68c63ffc13c937: Status 404 returned error can't find the container with id 8a7339db4ebbed7852dd7c35d9392700777b8ae589eb3ff26d68c63ffc13c937
Jul 15 18:46:06.990147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:06.990057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p" event={"ID":"c0b9287a-2586-48bb-86e3-0d31021306da","Type":"ContainerStarted","Data":"082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202"}
Jul 15 18:46:06.990534 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:06.990150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p" event={"ID":"c0b9287a-2586-48bb-86e3-0d31021306da","Type":"ContainerStarted","Data":"8a7339db4ebbed7852dd7c35d9392700777b8ae589eb3ff26d68c63ffc13c937"}
Jul 15 18:46:06.990534 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:06.990204    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:07.009375 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:07.009330    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p" podStartSLOduration=1.6062769609999998 podStartE2EDuration="2.009317565s" totalImagesPullingTime="403.040604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:46:07.007453588 +0000 UTC m=+1752.214716870" watchObservedRunningTime="2026-07-15 18:46:07.009317565 +0000 UTC m=+1752.216580852"
Jul 15 18:46:07.630225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:07.630189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:13.000925 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:13.000900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:46:16.044842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:16.044774    2563 generic.go:356] "Generic (PLEG): container finished" podID="78e62b78-712e-4971-bbf8-9f901896058f" containerID="847c19a268e88896e59d80fe61844287d2e723586c1a4fd53fdc47d3817bc95b" exitCode=0
Jul 15 18:46:16.045212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:16.044855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" event={"ID":"78e62b78-712e-4971-bbf8-9f901896058f","Type":"ContainerDied","Data":"847c19a268e88896e59d80fe61844287d2e723586c1a4fd53fdc47d3817bc95b"}
Jul 15 18:46:16.045212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:16.045203    2563 scope.go:117] "RemoveContainer" containerID="847c19a268e88896e59d80fe61844287d2e723586c1a4fd53fdc47d3817bc95b"
Jul 15 18:46:16.046133 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:16.046107    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:46:16.046187 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:16.046171    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:46:16.046222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:16.046206    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:46:17.056958 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:17.056922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" event={"ID":"78e62b78-712e-4971-bbf8-9f901896058f","Type":"ContainerStarted","Data":"df27cef73c179585779cd258fde6e9c86c3ac509f051dfc38ab211b17a48139b"}
Jul 15 18:46:17.285060 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:17.285030    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:17.286240 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:17.286214    2563 patch_prober.go:28] interesting pod/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 18:46:17.286352 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:17.286259    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 18:46:18.285663 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:18.285630    2563 patch_prober.go:28] interesting pod/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 18:46:18.286042 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:18.285682    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 18:46:19.285350 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:19.285316    2563 patch_prober.go:28] interesting pod/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 18:46:19.285571 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:19.285368    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 18:46:20.285490 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:20.285456    2563 patch_prober.go:28] interesting pod/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 18:46:20.285880 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:20.285511    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 18:46:20.452581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:20.452532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:20.977481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:20.977454    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:21.288616 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:21.288544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:21.289626 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:21.289605    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:46:25.136928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:25.136895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:25.243265 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:25.243232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:26.540847 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:26.540798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:26.642636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:26.642609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:53.975634 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:53.975596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:46:55.408948 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:55.408922    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:46:55.415534 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:46:55.415515    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:47:20.694259 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:20.694221    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"]
Jul 15 18:47:20.694751 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:20.694495    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p" podUID="c0b9287a-2586-48bb-86e3-0d31021306da" containerName="maas-api" containerID="cri-o://082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202" gracePeriod=30
Jul 15 18:47:20.720960 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:20.720936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:20.956050 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:20.955997    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:47:21.053059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.053032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l9p8\" (UniqueName: \"kubernetes.io/projected/c0b9287a-2586-48bb-86e3-0d31021306da-kube-api-access-6l9p8\") pod \"c0b9287a-2586-48bb-86e3-0d31021306da\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") "
Jul 15 18:47:21.053193 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.053122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls\") pod \"c0b9287a-2586-48bb-86e3-0d31021306da\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") "
Jul 15 18:47:21.053193 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.053142    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b9287a-2586-48bb-86e3-0d31021306da-openshift-service-ca\") pod \"c0b9287a-2586-48bb-86e3-0d31021306da\" (UID: \"c0b9287a-2586-48bb-86e3-0d31021306da\") "
Jul 15 18:47:21.053614 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.053587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b9287a-2586-48bb-86e3-0d31021306da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0b9287a-2586-48bb-86e3-0d31021306da" (UID: "c0b9287a-2586-48bb-86e3-0d31021306da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:47:21.055226 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.055204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0b9287a-2586-48bb-86e3-0d31021306da" (UID: "c0b9287a-2586-48bb-86e3-0d31021306da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:47:21.055316 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.055210    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b9287a-2586-48bb-86e3-0d31021306da-kube-api-access-6l9p8" (OuterVolumeSpecName: "kube-api-access-6l9p8") pod "c0b9287a-2586-48bb-86e3-0d31021306da" (UID: "c0b9287a-2586-48bb-86e3-0d31021306da"). InnerVolumeSpecName "kube-api-access-6l9p8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:47:21.154025 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.154002    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0b9287a-2586-48bb-86e3-0d31021306da-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:21.154025 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.154025    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b9287a-2586-48bb-86e3-0d31021306da-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:21.154158 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.154035    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9p8\" (UniqueName: \"kubernetes.io/projected/c0b9287a-2586-48bb-86e3-0d31021306da-kube-api-access-6l9p8\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:21.441820 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.441796    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0b9287a-2586-48bb-86e3-0d31021306da" containerID="082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202" exitCode=0
Jul 15 18:47:21.441918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.441832    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"
Jul 15 18:47:21.441918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.441860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p" event={"ID":"c0b9287a-2586-48bb-86e3-0d31021306da","Type":"ContainerDied","Data":"082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202"}
Jul 15 18:47:21.441918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.441896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p" event={"ID":"c0b9287a-2586-48bb-86e3-0d31021306da","Type":"ContainerDied","Data":"8a7339db4ebbed7852dd7c35d9392700777b8ae589eb3ff26d68c63ffc13c937"}
Jul 15 18:47:21.442030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.441929    2563 scope.go:117] "RemoveContainer" containerID="082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202"
Jul 15 18:47:21.450882 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.450866    2563 scope.go:117] "RemoveContainer" containerID="082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202"
Jul 15 18:47:21.451151 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:47:21.451133    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202\": container with ID starting with 082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202 not found: ID does not exist" containerID="082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202"
Jul 15 18:47:21.451200 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.451167    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202"} err="failed to get container status \"082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202\": rpc error: code = NotFound desc = could not find container \"082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202\": container with ID starting with 082ee5e44bf5258473a76ae63b8a3c73215b7c4d1c744a3732105ba5c502f202 not found: ID does not exist"
Jul 15 18:47:21.458961 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.458941    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"]
Jul 15 18:47:21.463080 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:21.463060    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cfe32069-74b4cf7fc5-zqv5p"]
Jul 15 18:47:23.376973 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:23.376937    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0b9287a-2586-48bb-86e3-0d31021306da" path="/var/lib/kubelet/pods/c0b9287a-2586-48bb-86e3-0d31021306da/volumes"
Jul 15 18:47:25.368166 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:25.368129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:31.205019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:31.204986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:31.278812 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:31.278786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:36.370564 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.370530    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"]
Jul 15 18:47:36.371023 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.370702    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy" containerID="cri-o://df27cef73c179585779cd258fde6e9c86c3ac509f051dfc38ab211b17a48139b" gracePeriod=30
Jul 15 18:47:36.397370 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.397342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:36.663664 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.663591    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"]
Jul 15 18:47:36.664214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.664198    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b9287a-2586-48bb-86e3-0d31021306da" containerName="maas-api"
Jul 15 18:47:36.664259 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.664217    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b9287a-2586-48bb-86e3-0d31021306da" containerName="maas-api"
Jul 15 18:47:36.664348 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.664337    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b9287a-2586-48bb-86e3-0d31021306da" containerName="maas-api"
Jul 15 18:47:36.667775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.667752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.670649 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.670345    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8020c7cf-openshift-default-dockercfg-kfnk5\""
Jul 15 18:47:36.676396 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.676373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"]
Jul 15 18:47:36.769798 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.769759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-podinfo\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.769952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.769847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-token\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.769952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.769876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhmn8\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-kube-api-access-lhmn8\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.770082 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.769953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-credential-socket\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.770082 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.770014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-certs\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.770082 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.770069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-envoy\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.770222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.770159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-socket\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.770222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.770198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4745029b-4e5e-4e41-9353-1b47590fa64a-istiod-ca-cert\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.770308 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.770292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-data\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870683 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-credential-socket\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870683 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-certs\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-envoy\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-socket\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4745029b-4e5e-4e41-9353-1b47590fa64a-istiod-ca-cert\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-data\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-podinfo\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.870915 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-token\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.871248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.870922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmn8\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-kube-api-access-lhmn8\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.871248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.871114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-credential-socket\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.871248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.871163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-certs\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.871248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.871210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-socket\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.871527 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.871510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-data\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.871598 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.871575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4745029b-4e5e-4e41-9353-1b47590fa64a-istiod-ca-cert\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.873043 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.873026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-envoy\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.873366 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.873344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-podinfo\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.878879 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.878855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-token\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.879097 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.879073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhmn8\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-kube-api-access-lhmn8\") pod \"e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") " pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:36.942049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.941994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:36.979970 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:36.979949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:37.132415 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:47:37.132376    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4745029b_4e5e_4e41_9353_1b47590fa64a.slice/crio-5b792e18edf6013c07f03850638bcb95efc9f5c3750cc0472ffc89fcb6597f66 WatchSource:0}: Error finding container 5b792e18edf6013c07f03850638bcb95efc9f5c3750cc0472ffc89fcb6597f66: Status 404 returned error can't find the container with id 5b792e18edf6013c07f03850638bcb95efc9f5c3750cc0472ffc89fcb6597f66
Jul 15 18:47:37.132896 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.132867    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"]
Jul 15 18:47:37.134825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.134792    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:47:37.134911 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.134856    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:47:37.134911 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.134885    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:47:37.542898 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.542862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" event={"ID":"4745029b-4e5e-4e41-9353-1b47590fa64a","Type":"ContainerStarted","Data":"f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638"}
Jul 15 18:47:37.543353 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.542922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" event={"ID":"4745029b-4e5e-4e41-9353-1b47590fa64a","Type":"ContainerStarted","Data":"5b792e18edf6013c07f03850638bcb95efc9f5c3750cc0472ffc89fcb6597f66"}
Jul 15 18:47:37.563645 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.563590    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" podStartSLOduration=1.563575459 podStartE2EDuration="1.563575459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:47:37.560928931 +0000 UTC m=+1842.768192230" watchObservedRunningTime="2026-07-15 18:47:37.563575459 +0000 UTC m=+1842.770838742"
Jul 15 18:47:37.802577 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.802541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:37.897912 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.897880    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"]
Jul 15 18:47:37.901531 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.901514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:37.904195 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.904175    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8020c7cf-serving-cert\""
Jul 15 18:47:37.910083 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.910060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"]
Jul 15 18:47:37.980257 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.980234    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:37.981759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.981734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:37.981867 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.981830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4jrq\" (UniqueName: \"kubernetes.io/projected/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-kube-api-access-r4jrq\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:37.981910 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:37.981885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-openshift-service-ca\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.082628 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.082546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4jrq\" (UniqueName: \"kubernetes.io/projected/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-kube-api-access-r4jrq\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.082628 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.082592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-openshift-service-ca\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.082845 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.082657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.082845 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:47:38.082823    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-serving-cert: secret "maas-api-e2e-derive-8020c7cf-serving-cert" not found
Jul 15 18:47:38.082948 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:47:38.082895    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls podName:fbaa5601-e8a4-4755-9ba2-d4e4c5052477 nodeName:}" failed. No retries permitted until 2026-07-15 18:47:38.582874966 +0000 UTC m=+1843.790138241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls") pod "maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx" (UID: "fbaa5601-e8a4-4755-9ba2-d4e4c5052477") : secret "maas-api-e2e-derive-8020c7cf-serving-cert" not found
Jul 15 18:47:38.083364 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.083334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-openshift-service-ca\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.097996 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.097970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4jrq\" (UniqueName: \"kubernetes.io/projected/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-kube-api-access-r4jrq\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.125407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.125386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:38.230579 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.230557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:38.359043 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.358978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:38.491432 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.491405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:38.588124 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.588097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.590539 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.590514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls\") pod \"maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.592087 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.592064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:38.812705 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.812674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:38.952214 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.952184    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"]
Jul 15 18:47:38.952955 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:47:38.952927    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbaa5601_e8a4_4755_9ba2_d4e4c5052477.slice/crio-b3bc6f53294a546ffb14792562f7136ce15eb1fb2259679ab3cb53f17f2dd2fc WatchSource:0}: Error finding container b3bc6f53294a546ffb14792562f7136ce15eb1fb2259679ab3cb53f17f2dd2fc: Status 404 returned error can't find the container with id b3bc6f53294a546ffb14792562f7136ce15eb1fb2259679ab3cb53f17f2dd2fc
Jul 15 18:47:38.985767 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:38.985748    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:39.556740 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:39.556709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx" event={"ID":"fbaa5601-e8a4-4755-9ba2-d4e4c5052477","Type":"ContainerStarted","Data":"50ed415ec949e6e84652c5e7621075f3541edbfcc664967d59c463b688bbeef8"}
Jul 15 18:47:39.556889 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:39.556763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx" event={"ID":"fbaa5601-e8a4-4755-9ba2-d4e4c5052477","Type":"ContainerStarted","Data":"b3bc6f53294a546ffb14792562f7136ce15eb1fb2259679ab3cb53f17f2dd2fc"}
Jul 15 18:47:39.557138 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:39.557118    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:39.557181 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:39.557172    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:39.558101 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:39.558084    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:39.576348 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:39.576309    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx" podStartSLOduration=2.182551119 podStartE2EDuration="2.576287951s" totalImagesPullingTime="393.736832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:47:39.573555662 +0000 UTC m=+1844.780818942" watchObservedRunningTime="2026-07-15 18:47:39.576287951 +0000 UTC m=+1844.783551225"
Jul 15 18:47:41.573236 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.573200    2563 generic.go:356] "Generic (PLEG): container finished" podID="78e62b78-712e-4971-bbf8-9f901896058f" containerID="df27cef73c179585779cd258fde6e9c86c3ac509f051dfc38ab211b17a48139b" exitCode=0
Jul 15 18:47:41.573671 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.573232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" event={"ID":"78e62b78-712e-4971-bbf8-9f901896058f","Type":"ContainerDied","Data":"df27cef73c179585779cd258fde6e9c86c3ac509f051dfc38ab211b17a48139b"}
Jul 15 18:47:41.573671 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.573313    2563 scope.go:117] "RemoveContainer" containerID="847c19a268e88896e59d80fe61844287d2e723586c1a4fd53fdc47d3817bc95b"
Jul 15 18:47:41.624260 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.624239    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:47:41.713891 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.713870    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-credential-socket\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.713902    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-certs\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.713923    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-istio-token\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.713949    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e62b78-712e-4971-bbf8-9f901896058f-istiod-ca-cert\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.713967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-socket\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbthj\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-kube-api-access-mbthj\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714052    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-envoy\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-data\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e62b78-712e-4971-bbf8-9f901896058f-istio-podinfo\") pod \"78e62b78-712e-4971-bbf8-9f901896058f\" (UID: \"78e62b78-712e-4971-bbf8-9f901896058f\") "
Jul 15 18:47:41.714501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714284    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:47:41.714501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714449    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:47:41.714660 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714491    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e62b78-712e-4971-bbf8-9f901896058f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:47:41.714852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714768    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.714852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714792    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e62b78-712e-4971-bbf8-9f901896058f-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.714852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714797    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:47:41.715086 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.714805    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.715755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.715723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-data" (OuterVolumeSpecName: "istio-data") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:47:41.716546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.716523    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78e62b78-712e-4971-bbf8-9f901896058f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:47:41.716652 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.716558    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-istio-token" (OuterVolumeSpecName: "istio-token") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:47:41.716901 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.716879    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-kube-api-access-mbthj" (OuterVolumeSpecName: "kube-api-access-mbthj") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "kube-api-access-mbthj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:47:41.717009 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.716989    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78e62b78-712e-4971-bbf8-9f901896058f" (UID: "78e62b78-712e-4971-bbf8-9f901896058f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:47:41.815689 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.815665    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e62b78-712e-4971-bbf8-9f901896058f-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.815689 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.815688    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.815823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.815697    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.815823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.815707    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbthj\" (UniqueName: \"kubernetes.io/projected/78e62b78-712e-4971-bbf8-9f901896058f-kube-api-access-mbthj\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.815823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.815716    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:41.815823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:41.815724    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e62b78-712e-4971-bbf8-9f901896058f-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:47:42.580211 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:42.580182    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"
Jul 15 18:47:42.580211 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:42.580193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk" event={"ID":"78e62b78-712e-4971-bbf8-9f901896058f","Type":"ContainerDied","Data":"35eb3b1b58853efeb1dbe7534cb1f990776ecb569ab15e488c05da99a2681db8"}
Jul 15 18:47:42.580678 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:42.580253    2563 scope.go:117] "RemoveContainer" containerID="df27cef73c179585779cd258fde6e9c86c3ac509f051dfc38ab211b17a48139b"
Jul 15 18:47:42.603256 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:42.603235    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"]
Jul 15 18:47:42.606475 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:42.606452    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cfe32069-openshift-default-c76f89c4c-pkhgk"]
Jul 15 18:47:43.377548 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:43.377516    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78e62b78-712e-4971-bbf8-9f901896058f" path="/var/lib/kubelet/pods/78e62b78-712e-4971-bbf8-9f901896058f/volumes"
Jul 15 18:47:46.581227 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:46.581199    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:47:47.924309 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:47.924278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:47.978199 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:47.978166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:51.540662 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:51.540626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:47:53.646100 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:53.646072    2563 generic.go:356] "Generic (PLEG): container finished" podID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerID="f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638" exitCode=0
Jul 15 18:47:53.646600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:53.646146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" event={"ID":"4745029b-4e5e-4e41-9353-1b47590fa64a","Type":"ContainerDied","Data":"f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638"}
Jul 15 18:47:53.646679 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:53.646622    2563 scope.go:117] "RemoveContainer" containerID="f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638"
Jul 15 18:47:53.647647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:53.647622    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:47:53.647715 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:53.647685    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:47:53.647762 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:53.647716    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:47:54.558078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:54.558044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:54.656727 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:54.656688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" event={"ID":"4745029b-4e5e-4e41-9353-1b47590fa64a","Type":"ContainerStarted","Data":"18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b"}
Jul 15 18:47:54.980684 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:54.980594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:54.981838 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:54.981814    2563 patch_prober.go:28] interesting pod/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 15 18:47:54.981945 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:54.981875    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 15 18:47:55.981080 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:55.981046    2563 patch_prober.go:28] interesting pod/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 15 18:47:55.981494 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:55.981094    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 15 18:47:56.981153 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:56.981116    2563 patch_prober.go:28] interesting pod/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 15 18:47:56.981628 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:56.981170    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 15 18:47:57.980318 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:57.980279    2563 patch_prober.go:28] interesting pod/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 15 18:47:57.980515 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:57.980349    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 15 18:47:58.984789 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:58.984758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:58.985185 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:58.985048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:47:58.985671 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:47:58.985654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:48:42.819568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:42.819529    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"]
Jul 15 18:48:42.820175 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:42.819783    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx" podUID="fbaa5601-e8a4-4755-9ba2-d4e4c5052477" containerName="maas-api" containerID="cri-o://50ed415ec949e6e84652c5e7621075f3541edbfcc664967d59c463b688bbeef8" gracePeriod=30
Jul 15 18:48:42.894160 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:42.894119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:42.938256 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:42.938194    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbaa5601-e8a4-4755-9ba2-d4e4c5052477" containerID="50ed415ec949e6e84652c5e7621075f3541edbfcc664967d59c463b688bbeef8" exitCode=0
Jul 15 18:48:42.938328 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:42.938259    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx" event={"ID":"fbaa5601-e8a4-4755-9ba2-d4e4c5052477","Type":"ContainerDied","Data":"50ed415ec949e6e84652c5e7621075f3541edbfcc664967d59c463b688bbeef8"}
Jul 15 18:48:43.077775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.077721    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:48:43.222874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.222841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4jrq\" (UniqueName: \"kubernetes.io/projected/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-kube-api-access-r4jrq\") pod \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") "
Jul 15 18:48:43.223009 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.222894    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-openshift-service-ca\") pod \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") "
Jul 15 18:48:43.223009 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.222973    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls\") pod \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\" (UID: \"fbaa5601-e8a4-4755-9ba2-d4e4c5052477\") "
Jul 15 18:48:43.223300 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.223270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbaa5601-e8a4-4755-9ba2-d4e4c5052477" (UID: "fbaa5601-e8a4-4755-9ba2-d4e4c5052477"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:48:43.224891 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.224865    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-kube-api-access-r4jrq" (OuterVolumeSpecName: "kube-api-access-r4jrq") pod "fbaa5601-e8a4-4755-9ba2-d4e4c5052477" (UID: "fbaa5601-e8a4-4755-9ba2-d4e4c5052477"). InnerVolumeSpecName "kube-api-access-r4jrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:48:43.224973 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.224949    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbaa5601-e8a4-4755-9ba2-d4e4c5052477" (UID: "fbaa5601-e8a4-4755-9ba2-d4e4c5052477"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:48:43.324091 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.324062    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4jrq\" (UniqueName: \"kubernetes.io/projected/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-kube-api-access-r4jrq\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:48:43.324091 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.324088    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:48:43.324231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.324102    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbaa5601-e8a4-4755-9ba2-d4e4c5052477-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:48:43.944840 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.944814    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"
Jul 15 18:48:43.944840 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.944832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx" event={"ID":"fbaa5601-e8a4-4755-9ba2-d4e4c5052477","Type":"ContainerDied","Data":"b3bc6f53294a546ffb14792562f7136ce15eb1fb2259679ab3cb53f17f2dd2fc"}
Jul 15 18:48:43.945304 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.944883    2563 scope.go:117] "RemoveContainer" containerID="50ed415ec949e6e84652c5e7621075f3541edbfcc664967d59c463b688bbeef8"
Jul 15 18:48:43.962146 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.962121    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"]
Jul 15 18:48:43.965924 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:43.965901    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8020c7cf-85ff9c8c59-mwrbx"]
Jul 15 18:48:45.377688 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:45.377658    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbaa5601-e8a4-4755-9ba2-d4e4c5052477" path="/var/lib/kubelet/pods/fbaa5601-e8a4-4755-9ba2-d4e4c5052477/volumes"
Jul 15 18:48:47.363243 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:47.363207    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:53.029164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:53.029129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:53.097279 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:53.097250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:57.591966 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:57.591924    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"]
Jul 15 18:48:57.592414 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:57.592171    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy" containerID="cri-o://18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b" gracePeriod=30
Jul 15 18:48:57.614449 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:57.614399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:58.217466 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:58.217415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:58.320465 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:58.320410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:58.465337 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:58.465309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:48:58.987289 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:58.987255    2563 patch_prober.go:28] interesting pod/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 15 18:48:58.987678 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:48:58.987313    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:49:00.931144 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:00.931111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:02.844488 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.844463    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:49:02.973924 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.973896    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhmn8\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-kube-api-access-lhmn8\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.973944    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-token\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.973981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-certs\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4745029b-4e5e-4e41-9353-1b47590fa64a-istiod-ca-cert\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974021    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-socket\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974056 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974044    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-data\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974283 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974125    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-envoy\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974283 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974161    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-podinfo\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974283 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974184    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-credential-socket\") pod \"4745029b-4e5e-4e41-9353-1b47590fa64a\" (UID: \"4745029b-4e5e-4e41-9353-1b47590fa64a\") "
Jul 15 18:49:02.974457 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974321    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:49:02.974457 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974335    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:49:02.974570 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974532    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4745029b-4e5e-4e41-9353-1b47590fa64a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:49:02.974625 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:49:02.974625 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974613    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:02.974727 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974668    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:02.974963 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.974937    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:49:02.976360 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.976337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:49:02.976485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.976351    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:49:02.976582 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.976565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-kube-api-access-lhmn8" (OuterVolumeSpecName: "kube-api-access-lhmn8") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "kube-api-access-lhmn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:49:02.976642 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:02.976580    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4745029b-4e5e-4e41-9353-1b47590fa64a" (UID: "4745029b-4e5e-4e41-9353-1b47590fa64a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:49:03.062385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.062357    2563 generic.go:356] "Generic (PLEG): container finished" podID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerID="18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b" exitCode=0
Jul 15 18:49:03.062534 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.062477    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"
Jul 15 18:49:03.062534 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.062495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" event={"ID":"4745029b-4e5e-4e41-9353-1b47590fa64a","Type":"ContainerDied","Data":"18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b"}
Jul 15 18:49:03.062615 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.062554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq" event={"ID":"4745029b-4e5e-4e41-9353-1b47590fa64a","Type":"ContainerDied","Data":"5b792e18edf6013c07f03850638bcb95efc9f5c3750cc0472ffc89fcb6597f66"}
Jul 15 18:49:03.062615 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.062578    2563 scope.go:117] "RemoveContainer" containerID="18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b"
Jul 15 18:49:03.071854 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.071838    2563 scope.go:117] "RemoveContainer" containerID="f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638"
Jul 15 18:49:03.075805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.075786    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:03.075918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.075810    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:03.075918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.075823    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:03.075918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.075838    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhmn8\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-kube-api-access-lhmn8\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:03.075918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.075852    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:03.075918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.075865    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4745029b-4e5e-4e41-9353-1b47590fa64a-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:03.075918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.075886    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4745029b-4e5e-4e41-9353-1b47590fa64a-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:49:03.080155 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.080139    2563 scope.go:117] "RemoveContainer" containerID="18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b"
Jul 15 18:49:03.080405 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:49:03.080386    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b\": container with ID starting with 18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b not found: ID does not exist" containerID="18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b"
Jul 15 18:49:03.080491 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.080412    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b"} err="failed to get container status \"18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b\": rpc error: code = NotFound desc = could not find container \"18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b\": container with ID starting with 18ed92e6c589bd026cba79fe9243c917d8e1723b99695f88e63bc76ac5b2dd5b not found: ID does not exist"
Jul 15 18:49:03.080491 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.080445    2563 scope.go:117] "RemoveContainer" containerID="f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638"
Jul 15 18:49:03.080660 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:49:03.080646    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638\": container with ID starting with f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638 not found: ID does not exist" containerID="f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638"
Jul 15 18:49:03.080704 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.080664    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638"} err="failed to get container status \"f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638\": rpc error: code = NotFound desc = could not find container \"f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638\": container with ID starting with f653252fabe342579bdd0502f468328044c582364e27b536975ee64c74628638 not found: ID does not exist"
Jul 15 18:49:03.088269 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.088244    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"]
Jul 15 18:49:03.093074 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.093055    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8020c7cf-openshift-default-7dfc855c99-kscgq"]
Jul 15 18:49:03.377330 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:03.377287    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" path="/var/lib/kubelet/pods/4745029b-4e5e-4e41-9353-1b47590fa64a/volumes"
Jul 15 18:49:04.174739 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:04.174707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:06.715146 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:06.715115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:06.789030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:06.789002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:06.914046 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:06.914020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:07.013481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:07.013394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:07.443300 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:07.443268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:14.465768 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:14.465734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:24.456667 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:24.456634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:33.394034 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:33.393993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:39.190775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:39.190730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:39.258595 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:39.258564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:39.358668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:39.358639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:49:55.334769 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:49:55.334662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:01.452556 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:01.452516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:01.563474 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:01.563402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:01.668231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:01.668204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:12.315050 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:12.315014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:13.154261 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:13.154230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:19.218728 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:19.218689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:19.310880 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:19.310845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:19.424346 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:19.424316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:19.517615 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:19.517548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:20.376492 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:20.376459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:20.490564 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:20.490533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:20.587568 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:20.587543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:22.326978 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:22.326948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:28.789403 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:28.789372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:28.911380 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:28.911350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:29.642707 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:29.642669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:36.607461 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:36.607408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:36.705791 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:36.705766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:36.865563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:36.865493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:37.320852 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.320826    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"]
Jul 15 18:50:37.321222 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321208    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy"
Jul 15 18:50:37.321273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321223    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy"
Jul 15 18:50:37.321273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321240    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbaa5601-e8a4-4755-9ba2-d4e4c5052477" containerName="maas-api"
Jul 15 18:50:37.321273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321245    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbaa5601-e8a4-4755-9ba2-d4e4c5052477" containerName="maas-api"
Jul 15 18:50:37.321273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321264    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy"
Jul 15 18:50:37.321273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321269    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy"
Jul 15 18:50:37.321462 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy"
Jul 15 18:50:37.321462 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321287    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy"
Jul 15 18:50:37.321462 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321345    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy"
Jul 15 18:50:37.321462 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321355    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbaa5601-e8a4-4755-9ba2-d4e4c5052477" containerName="maas-api"
Jul 15 18:50:37.321462 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321361    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy"
Jul 15 18:50:37.321462 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.321367    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy"
Jul 15 18:50:37.324493 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.324478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.333757 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.333739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-24b88ef5-openshift-default-dockercfg-ckfz7\""
Jul 15 18:50:37.355446 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.355408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:37.378812 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.378794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"]
Jul 15 18:50:37.391417 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-data\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26ft4\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-kube-api-access-26ft4\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-token\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-podinfo\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391725 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-socket\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391725 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istiod-ca-cert\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391725 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-envoy\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391887 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-certs\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.391887 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.391798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-credential-socket\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.492771 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.492739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-certs\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.492918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.492782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-credential-socket\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.492918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.492804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-data\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493042 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.492924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26ft4\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-kube-api-access-26ft4\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493042 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.492966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-token\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493042 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-podinfo\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-socket\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istiod-ca-cert\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-certs\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-envoy\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493455 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-credential-socket\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-data\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-socket\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.493870 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.493845    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istiod-ca-cert\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.495348 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.495328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-envoy\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.495500 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.495484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-podinfo\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.505362 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.505343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26ft4\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-kube-api-access-26ft4\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.507929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.507898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-token\") pod \"e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") " pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.634871 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.634798    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:37.781848 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.781821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:37.806507 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.806484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"]
Jul 15 18:50:37.808878 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:50:37.808853    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635d2bb2_c8aa_4658_b78c_a9ec62c1c2b2.slice/crio-a9861c6dcd027c1d57c877ad7c315f7a92ee737fabe7d8ea077ebc8e4b8e5f57 WatchSource:0}: Error finding container a9861c6dcd027c1d57c877ad7c315f7a92ee737fabe7d8ea077ebc8e4b8e5f57: Status 404 returned error can't find the container with id a9861c6dcd027c1d57c877ad7c315f7a92ee737fabe7d8ea077ebc8e4b8e5f57
Jul 15 18:50:37.811018 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.810975    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:50:37.811110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.811060    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:50:37.811186 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:37.811106    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:50:38.618652 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:38.618619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" event={"ID":"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2","Type":"ContainerStarted","Data":"868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78"}
Jul 15 18:50:38.618817 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:38.618670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" event={"ID":"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2","Type":"ContainerStarted","Data":"a9861c6dcd027c1d57c877ad7c315f7a92ee737fabe7d8ea077ebc8e4b8e5f57"}
Jul 15 18:50:38.635785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:38.635757    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:38.640655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:38.640634    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:38.650142 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:38.650101    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" podStartSLOduration=1.650087796 podStartE2EDuration="1.650087796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:38.648874731 +0000 UTC m=+2023.856138030" watchObservedRunningTime="2026-07-15 18:50:38.650087796 +0000 UTC m=+2023.857351078"
Jul 15 18:50:39.624597 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:39.624568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:39.625605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:39.625581    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:41.015613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.015578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:41.176889 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.176857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:41.271589 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.271504    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"]
Jul 15 18:50:41.272130 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.272114    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy"
Jul 15 18:50:41.272187 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.272134    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4745029b-4e5e-4e41-9353-1b47590fa64a" containerName="istio-proxy"
Jul 15 18:50:41.272273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.272262    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78e62b78-712e-4971-bbf8-9f901896058f" containerName="istio-proxy"
Jul 15 18:50:41.275808 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.275789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.280823 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.280808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-24b88ef5-serving-cert\""
Jul 15 18:50:41.310146 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.310124    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"]
Jul 15 18:50:41.324351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.324328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-openshift-service-ca\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.324488 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.324357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtms\" (UniqueName: \"kubernetes.io/projected/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-kube-api-access-nhtms\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.324566 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.324503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.377892 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.377866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:41.425194 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.425169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.425297 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.425243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-openshift-service-ca\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.425297 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.425272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtms\" (UniqueName: \"kubernetes.io/projected/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-kube-api-access-nhtms\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.425297 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:50:41.425282    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-serving-cert: secret "maas-api-e2e-mt-24b88ef5-serving-cert" not found
Jul 15 18:50:41.425502 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:50:41.425361    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls podName:d1c69d42-ea4b-46de-8cd8-968b3c748cb7 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:41.925339912 +0000 UTC m=+2027.132603189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls") pod "maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc" (UID: "d1c69d42-ea4b-46de-8cd8-968b3c748cb7") : secret "maas-api-e2e-mt-24b88ef5-serving-cert" not found
Jul 15 18:50:41.425928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.425904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-openshift-service-ca\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.461376 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.461345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtms\" (UniqueName: \"kubernetes.io/projected/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-kube-api-access-nhtms\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.654794 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.654765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:41.930563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.930490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:41.933307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:41.933283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls\") pod \"maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:42.187301 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:42.187236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:42.352398 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:42.352373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"]
Jul 15 18:50:42.354996 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:50:42.354969    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c69d42_ea4b_46de_8cd8_968b3c748cb7.slice/crio-8dfd0dac0604eb1fcdceb11d824c861a0fe355966ef5be0e66d4b301786910e8 WatchSource:0}: Error finding container 8dfd0dac0604eb1fcdceb11d824c861a0fe355966ef5be0e66d4b301786910e8: Status 404 returned error can't find the container with id 8dfd0dac0604eb1fcdceb11d824c861a0fe355966ef5be0e66d4b301786910e8
Jul 15 18:50:42.356545 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:42.356525    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:50:42.594453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:42.594410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:42.641886 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:42.641856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc" event={"ID":"d1c69d42-ea4b-46de-8cd8-968b3c748cb7","Type":"ContainerStarted","Data":"8dfd0dac0604eb1fcdceb11d824c861a0fe355966ef5be0e66d4b301786910e8"}
Jul 15 18:50:42.748587 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:42.748557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:43.651003 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:43.650972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc" event={"ID":"d1c69d42-ea4b-46de-8cd8-968b3c748cb7","Type":"ContainerStarted","Data":"787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3"}
Jul 15 18:50:43.651504 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:43.651081    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:43.676321 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:43.676278    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc" podStartSLOduration=2.216757672 podStartE2EDuration="2.676264469s" totalImagesPullingTime="459.506797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:43.673931864 +0000 UTC m=+2028.881195149" watchObservedRunningTime="2026-07-15 18:50:43.676264469 +0000 UTC m=+2028.883527752"
Jul 15 18:50:45.398810 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:45.398782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:46.233311 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:46.233254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:46.444060 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:46.444030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:46.664490 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:46.664461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:49.661912 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:49.661880    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:50:52.990364 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:52.990332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:53.099859 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:53.099820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:50:55.276156 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.274867    2563 patch_prober.go:28] interesting pod/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:50484->10.132.0.64:15021: read: connection reset by peer" start-of-body=
Jul 15 18:50:55.276156 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.274937    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:50484->10.132.0.64:15021: read: connection reset by peer"
Jul 15 18:50:55.717141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.717111    2563 generic.go:356] "Generic (PLEG): container finished" podID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerID="868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78" exitCode=0
Jul 15 18:50:55.717284 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.717184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" event={"ID":"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2","Type":"ContainerDied","Data":"868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78"}
Jul 15 18:50:55.717579 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.717563    2563 scope.go:117] "RemoveContainer" containerID="868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78"
Jul 15 18:50:55.718469 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.718417    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:50:55.718534 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.718514    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:50:55.718576 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:55.718550    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:50:56.725124 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:56.725089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" event={"ID":"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2","Type":"ContainerStarted","Data":"8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7"}
Jul 15 18:50:57.635956 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:57.635923    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:50:57.636151 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:57.636030    2563 patch_prober.go:28] interesting pod/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 18:50:57.636151 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:57.636072    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 18:50:58.636041 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:58.636003    2563 patch_prober.go:28] interesting pod/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 18:50:58.636645 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:58.636611    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 18:50:59.635673 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:59.635639    2563 patch_prober.go:28] interesting pod/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 18:50:59.636102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:50:59.636072    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 18:51:00.639321 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:00.639293    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:51:00.639709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:00.639673    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:51:00.640369 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:00.640352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:51:03.713718 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:03.713687    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"]
Jul 15 18:51:03.714604 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:03.714413    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc" podUID="d1c69d42-ea4b-46de-8cd8-968b3c748cb7" containerName="maas-api" containerID="cri-o://787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3" gracePeriod=30
Jul 15 18:51:03.774899 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:03.774875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:03.972698 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:03.972643    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:51:04.016668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.016642    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls\") pod \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") "
Jul 15 18:51:04.016805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.016682    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhtms\" (UniqueName: \"kubernetes.io/projected/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-kube-api-access-nhtms\") pod \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") "
Jul 15 18:51:04.016805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.016716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-openshift-service-ca\") pod \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\" (UID: \"d1c69d42-ea4b-46de-8cd8-968b3c748cb7\") "
Jul 15 18:51:04.017140 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.017115    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1c69d42-ea4b-46de-8cd8-968b3c748cb7" (UID: "d1c69d42-ea4b-46de-8cd8-968b3c748cb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:51:04.018646 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.018613    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-kube-api-access-nhtms" (OuterVolumeSpecName: "kube-api-access-nhtms") pod "d1c69d42-ea4b-46de-8cd8-968b3c748cb7" (UID: "d1c69d42-ea4b-46de-8cd8-968b3c748cb7"). InnerVolumeSpecName "kube-api-access-nhtms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:51:04.018744 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.018694    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1c69d42-ea4b-46de-8cd8-968b3c748cb7" (UID: "d1c69d42-ea4b-46de-8cd8-968b3c748cb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:51:04.117787 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.117762    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:04.117787 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.117785    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhtms\" (UniqueName: \"kubernetes.io/projected/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-kube-api-access-nhtms\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:04.117914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.117796    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c69d42-ea4b-46de-8cd8-968b3c748cb7-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:04.780668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.780632    2563 generic.go:356] "Generic (PLEG): container finished" podID="d1c69d42-ea4b-46de-8cd8-968b3c748cb7" containerID="787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3" exitCode=0
Jul 15 18:51:04.781085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.780679    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"
Jul 15 18:51:04.781085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.780678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc" event={"ID":"d1c69d42-ea4b-46de-8cd8-968b3c748cb7","Type":"ContainerDied","Data":"787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3"}
Jul 15 18:51:04.781085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.780730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc" event={"ID":"d1c69d42-ea4b-46de-8cd8-968b3c748cb7","Type":"ContainerDied","Data":"8dfd0dac0604eb1fcdceb11d824c861a0fe355966ef5be0e66d4b301786910e8"}
Jul 15 18:51:04.781085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.780750    2563 scope.go:117] "RemoveContainer" containerID="787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3"
Jul 15 18:51:04.797271 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.797246    2563 scope.go:117] "RemoveContainer" containerID="787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3"
Jul 15 18:51:04.797587 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:51:04.797564    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3\": container with ID starting with 787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3 not found: ID does not exist" containerID="787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3"
Jul 15 18:51:04.797652 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.797594    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3"} err="failed to get container status \"787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3\": rpc error: code = NotFound desc = could not find container \"787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3\": container with ID starting with 787cd1566466bfad221a435bc2061bdb25503b087e93c611fb74e1cc3532d1d3 not found: ID does not exist"
Jul 15 18:51:04.812009 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.811986    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"]
Jul 15 18:51:04.818904 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:04.818885    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24b88ef5-bb8c48f78-sr7nc"]
Jul 15 18:51:05.377863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:05.377832    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1c69d42-ea4b-46de-8cd8-968b3c748cb7" path="/var/lib/kubelet/pods/d1c69d42-ea4b-46de-8cd8-968b3c748cb7/volumes"
Jul 15 18:51:08.490965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:08.490938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:14.257973 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:14.257939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:14.335562 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:14.335528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:19.234967 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:19.234883    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"]
Jul 15 18:51:19.235365 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:19.235151    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy" containerID="cri-o://8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7" gracePeriod=30
Jul 15 18:51:19.257265 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:19.257240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:19.536300 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:19.536222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:19.706824 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:19.706787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:19.890104 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:19.890072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:20.099060 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:20.099034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:24.495843 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.495818    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:51:24.573858 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.573836    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-token\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.573990 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.573886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26ft4\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-kube-api-access-26ft4\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.573990 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.573916    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-podinfo\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.573990 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.573938    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-certs\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.573990 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.573959    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-data\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.574216 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.573994    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istiod-ca-cert\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.574216 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574058    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-socket\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.574216 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574086    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-envoy\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.574216 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574131    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-credential-socket\") pod \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\" (UID: \"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2\") "
Jul 15 18:51:24.574449 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574273    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:51:24.574449 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574355    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:51:24.574449 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574440    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.574634 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574609    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:51:24.574711 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574630    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:51:24.574988 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.574966    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:51:24.576203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.576184    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-kube-api-access-26ft4" (OuterVolumeSpecName: "kube-api-access-26ft4") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "kube-api-access-26ft4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:51:24.576203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.576190    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:51:24.576411 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.576385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:51:24.576501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.576389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" (UID: "635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:51:24.675598 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675572    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26ft4\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-kube-api-access-26ft4\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.675598 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675595    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.675753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675606    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.675753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675614    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.675753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675622    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.675753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675630    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.675753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675638    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.675753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.675646    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:51:24.897827 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.897744    2563 generic.go:356] "Generic (PLEG): container finished" podID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerID="8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7" exitCode=0
Jul 15 18:51:24.897827 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.897798    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"
Jul 15 18:51:24.897996 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.897827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" event={"ID":"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2","Type":"ContainerDied","Data":"8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7"}
Jul 15 18:51:24.897996 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.897872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf" event={"ID":"635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2","Type":"ContainerDied","Data":"a9861c6dcd027c1d57c877ad7c315f7a92ee737fabe7d8ea077ebc8e4b8e5f57"}
Jul 15 18:51:24.897996 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.897893    2563 scope.go:117] "RemoveContainer" containerID="8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7"
Jul 15 18:51:24.907983 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.907964    2563 scope.go:117] "RemoveContainer" containerID="868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78"
Jul 15 18:51:24.916509 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.916491    2563 scope.go:117] "RemoveContainer" containerID="8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7"
Jul 15 18:51:24.916771 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:51:24.916751    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7\": container with ID starting with 8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7 not found: ID does not exist" containerID="8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7"
Jul 15 18:51:24.916821 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.916780    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7"} err="failed to get container status \"8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7\": rpc error: code = NotFound desc = could not find container \"8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7\": container with ID starting with 8e1f5e48981c73c45fecfd6b78472689a485d96ef9bba1a23649f5e6221e5df7 not found: ID does not exist"
Jul 15 18:51:24.916821 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.916798    2563 scope.go:117] "RemoveContainer" containerID="868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78"
Jul 15 18:51:24.917039 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:51:24.917021    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78\": container with ID starting with 868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78 not found: ID does not exist" containerID="868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78"
Jul 15 18:51:24.917086 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.917045    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78"} err="failed to get container status \"868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78\": rpc error: code = NotFound desc = could not find container \"868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78\": container with ID starting with 868865c74835356123aadf2b711cf2005c91f75860ab079fc87c6d0dc533cd78 not found: ID does not exist"
Jul 15 18:51:24.930154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.930133    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"]
Jul 15 18:51:24.935018 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:24.934997    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-24b88ef5-openshift-default-7dfd84dd59-tzxjf"]
Jul 15 18:51:25.377418 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:25.377380    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" path="/var/lib/kubelet/pods/635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2/volumes"
Jul 15 18:51:26.298580 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:26.298548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:26.432590 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:26.432558    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:27.462945 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:27.462912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:27.638856 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:27.638818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:27.929102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:27.929076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:28.053126 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:28.053100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:34.071751 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:34.071713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:34.171935 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:34.171893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:41.021241 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.021199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:41.389964 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.389928    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"]
Jul 15 18:51:41.390300 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.390288    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy"
Jul 15 18:51:41.390345 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.390301    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy"
Jul 15 18:51:41.390345 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.390320    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c69d42-ea4b-46de-8cd8-968b3c748cb7" containerName="maas-api"
Jul 15 18:51:41.390345 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.390326    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c69d42-ea4b-46de-8cd8-968b3c748cb7" containerName="maas-api"
Jul 15 18:51:41.390463 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.390403    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1c69d42-ea4b-46de-8cd8-968b3c748cb7" containerName="maas-api"
Jul 15 18:51:41.390463 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.390411    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy"
Jul 15 18:51:41.393348 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.393332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.398561 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.398537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ba7662e4-openshift-default-dockercfg-svprc\""
Jul 15 18:51:41.417750 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.417721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:41.422208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.422183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"]
Jul 15 18:51:41.506796 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.506760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1c3ed7-4763-414a-b472-2879be939140-istiod-ca-cert\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.506960 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.506813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwb8\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-kube-api-access-mgwb8\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.506960 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.506911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-socket\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.506960 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.506954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-certs\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.507085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.506998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-data\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.507085 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.507071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-istio-token\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.507159 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.507114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-credential-socket\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.507198 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.507167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-envoy\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.507264 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.507249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1c3ed7-4763-414a-b472-2879be939140-istio-podinfo\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.608690 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.608653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1c3ed7-4763-414a-b472-2879be939140-istiod-ca-cert\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.608874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.608701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwb8\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-kube-api-access-mgwb8\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.608874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.608733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-socket\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.608874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.608754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-certs\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.608874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.608782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-data\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.608874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.608828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-istio-token\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-credential-socket\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-envoy\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1c3ed7-4763-414a-b472-2879be939140-istio-podinfo\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-socket\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-certs\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-data\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-credential-socket\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.609735 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.609627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1c3ed7-4763-414a-b472-2879be939140-istiod-ca-cert\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.612001 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.611973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-envoy\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.612175 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.612160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1c3ed7-4763-414a-b472-2879be939140-istio-podinfo\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.625030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.625007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwb8\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-kube-api-access-mgwb8\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.625167 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.625148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-istio-token\") pod \"e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") " pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.670203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.670141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:41.704418 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.704395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:41.904301 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:51:41.904276    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1c3ed7_4763_414a_b472_2879be939140.slice/crio-eeb91c3e7c2b320705beb0935fb4575595641d33603e5308ca06715f92cc2dea WatchSource:0}: Error finding container eeb91c3e7c2b320705beb0935fb4575595641d33603e5308ca06715f92cc2dea: Status 404 returned error can't find the container with id eeb91c3e7c2b320705beb0935fb4575595641d33603e5308ca06715f92cc2dea
Jul 15 18:51:41.904614 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.904593    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"]
Jul 15 18:51:41.906750 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.906717    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:51:41.906842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.906779    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:51:41.906842 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.906808    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:51:41.996914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.996875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" event={"ID":"6c1c3ed7-4763-414a-b472-2879be939140","Type":"ContainerStarted","Data":"1320f768d60049375f3d96ac6d2c89b15276fa24c6a5ee12cdc94365b264f46d"}
Jul 15 18:51:41.997060 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:41.996941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" event={"ID":"6c1c3ed7-4763-414a-b472-2879be939140","Type":"ContainerStarted","Data":"eeb91c3e7c2b320705beb0935fb4575595641d33603e5308ca06715f92cc2dea"}
Jul 15 18:51:42.054179 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:42.054124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" podStartSLOduration=1.054107476 podStartE2EDuration="1.054107476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:42.05086961 +0000 UTC m=+2087.258132904" watchObservedRunningTime="2026-07-15 18:51:42.054107476 +0000 UTC m=+2087.261370758"
Jul 15 18:51:42.705068 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:42.705032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:42.709650 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:42.709627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:43.002730 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:43.002634    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:43.003564 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:43.003537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:44.283306 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.283275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:44.437246 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.437210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:44.577189 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.577162    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"]
Jul 15 18:51:44.577626 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.577611    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy"
Jul 15 18:51:44.577686 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.577628    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy"
Jul 15 18:51:44.577730 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.577692    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="635d2bb2-c8aa-4658-b78c-a9ec62c1c2b2" containerName="istio-proxy"
Jul 15 18:51:44.580877 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.580861    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.584078 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.584063    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ba7662e4-serving-cert\""
Jul 15 18:51:44.625258 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.625230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"]
Jul 15 18:51:44.671376 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.671347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:44.738591 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.738563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/407c3013-afda-41ac-b8e0-ac458e6fd5a5-openshift-service-ca\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.738750 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.738607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.738750 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.738715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjd5\" (UniqueName: \"kubernetes.io/projected/407c3013-afda-41ac-b8e0-ac458e6fd5a5-kube-api-access-bpjd5\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.839925 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.839836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/407c3013-afda-41ac-b8e0-ac458e6fd5a5-openshift-service-ca\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.839925 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.839877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.840113 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.839943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjd5\" (UniqueName: \"kubernetes.io/projected/407c3013-afda-41ac-b8e0-ac458e6fd5a5-kube-api-access-bpjd5\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.840113 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:51:44.840049    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-serving-cert: secret "maas-api-e2e-mt-ba7662e4-serving-cert" not found
Jul 15 18:51:44.840113 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:51:44.840104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls podName:407c3013-afda-41ac-b8e0-ac458e6fd5a5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:45.340089672 +0000 UTC m=+2090.547352938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls") pod "maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v" (UID: "407c3013-afda-41ac-b8e0-ac458e6fd5a5") : secret "maas-api-e2e-mt-ba7662e4-serving-cert" not found
Jul 15 18:51:44.840516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.840498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/407c3013-afda-41ac-b8e0-ac458e6fd5a5-openshift-service-ca\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:44.856481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:44.856455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjd5\" (UniqueName: \"kubernetes.io/projected/407c3013-afda-41ac-b8e0-ac458e6fd5a5-kube-api-access-bpjd5\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:45.181502 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:45.181397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:45.344775 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:45.344741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:45.347082 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:45.347062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls\") pod \"maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:45.491338 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:45.491262    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:45.635326 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:45.635299    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"]
Jul 15 18:51:45.636978 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:51:45.636953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407c3013_afda_41ac_b8e0_ac458e6fd5a5.slice/crio-3a0285c61710b5b9a84e13a09b213dcc2455716206bca55bc9f95cb302f38f8e WatchSource:0}: Error finding container 3a0285c61710b5b9a84e13a09b213dcc2455716206bca55bc9f95cb302f38f8e: Status 404 returned error can't find the container with id 3a0285c61710b5b9a84e13a09b213dcc2455716206bca55bc9f95cb302f38f8e
Jul 15 18:51:45.677655 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:45.677599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:45.772272 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:45.772205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:46.020212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:46.020177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v" event={"ID":"407c3013-afda-41ac-b8e0-ac458e6fd5a5","Type":"ContainerStarted","Data":"3a0285c61710b5b9a84e13a09b213dcc2455716206bca55bc9f95cb302f38f8e"}
Jul 15 18:51:47.028241 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:47.028195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v" event={"ID":"407c3013-afda-41ac-b8e0-ac458e6fd5a5","Type":"ContainerStarted","Data":"90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175"}
Jul 15 18:51:47.028656 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:47.028277    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:47.062609 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:47.062562    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v" podStartSLOduration=2.5833567090000003 podStartE2EDuration="3.062548192s" totalImagesPullingTime="479.191483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:47.058580975 +0000 UTC m=+2092.265844258" watchObservedRunningTime="2026-07-15 18:51:47.062548192 +0000 UTC m=+2092.269811475"
Jul 15 18:51:48.709557 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:48.709521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:53.050730 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:53.050690    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:51:55.451278 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:55.451196    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:51:55.460378 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:55.460348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:51:58.004176 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.004153    2563 patch_prober.go:28] interesting pod/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 18:51:58.004539 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.004209    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 18:51:58.099482 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.099440    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c1c3ed7-4763-414a-b472-2879be939140" containerID="1320f768d60049375f3d96ac6d2c89b15276fa24c6a5ee12cdc94365b264f46d" exitCode=0
Jul 15 18:51:58.099482 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.099453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" event={"ID":"6c1c3ed7-4763-414a-b472-2879be939140","Type":"ContainerDied","Data":"1320f768d60049375f3d96ac6d2c89b15276fa24c6a5ee12cdc94365b264f46d"}
Jul 15 18:51:58.099841 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.099827    2563 scope.go:117] "RemoveContainer" containerID="1320f768d60049375f3d96ac6d2c89b15276fa24c6a5ee12cdc94365b264f46d"
Jul 15 18:51:58.101862 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.100818    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:51:58.101862 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.101371    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:51:58.101862 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.101502    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:51:58.699968 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:58.699937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:59.107188 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:59.107153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" event={"ID":"6c1c3ed7-4763-414a-b472-2879be939140","Type":"ContainerStarted","Data":"f1e940a64476905161dd5dee4c655a86f680bd6092bb4c634e7ab2ceeafc32a8"}
Jul 15 18:51:59.704744 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:59.704713    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:51:59.705006 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:59.704983    2563 patch_prober.go:28] interesting pod/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 18:51:59.705052 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:51:59.705030    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 18:52:00.705642 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:00.705606    2563 patch_prober.go:28] interesting pod/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 18:52:00.706057 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:00.705673    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 18:52:01.705178 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:01.705042    2563 patch_prober.go:28] interesting pod/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 18:52:01.705178 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:01.705095    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 18:52:02.705224 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:02.705182    2563 patch_prober.go:28] interesting pod/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 18:52:02.705721 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:02.705239    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 18:52:03.708584 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:03.708558    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:52:03.708992 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:03.708976    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:52:03.709706 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:03.709688    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:52:27.660350 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.660313    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"]
Jul 15 18:52:27.660888 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.660558    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v" podUID="407c3013-afda-41ac-b8e0-ac458e6fd5a5" containerName="maas-api" containerID="cri-o://90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175" gracePeriod=30
Jul 15 18:52:27.688811 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.688787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:52:27.916491 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.916418    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:52:27.997753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.997731    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/407c3013-afda-41ac-b8e0-ac458e6fd5a5-openshift-service-ca\") pod \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") "
Jul 15 18:52:27.997878 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.997802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpjd5\" (UniqueName: \"kubernetes.io/projected/407c3013-afda-41ac-b8e0-ac458e6fd5a5-kube-api-access-bpjd5\") pod \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") "
Jul 15 18:52:27.997878 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.997848    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls\") pod \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\" (UID: \"407c3013-afda-41ac-b8e0-ac458e6fd5a5\") "
Jul 15 18:52:27.998159 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.998122    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/407c3013-afda-41ac-b8e0-ac458e6fd5a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "407c3013-afda-41ac-b8e0-ac458e6fd5a5" (UID: "407c3013-afda-41ac-b8e0-ac458e6fd5a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:52:27.999843 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.999818    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/407c3013-afda-41ac-b8e0-ac458e6fd5a5-kube-api-access-bpjd5" (OuterVolumeSpecName: "kube-api-access-bpjd5") pod "407c3013-afda-41ac-b8e0-ac458e6fd5a5" (UID: "407c3013-afda-41ac-b8e0-ac458e6fd5a5"). InnerVolumeSpecName "kube-api-access-bpjd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:52:27.999943 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:27.999896    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "407c3013-afda-41ac-b8e0-ac458e6fd5a5" (UID: "407c3013-afda-41ac-b8e0-ac458e6fd5a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:52:28.098810 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.098789    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpjd5\" (UniqueName: \"kubernetes.io/projected/407c3013-afda-41ac-b8e0-ac458e6fd5a5-kube-api-access-bpjd5\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:52:28.098810 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.098811    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/407c3013-afda-41ac-b8e0-ac458e6fd5a5-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:52:28.098955 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.098820    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/407c3013-afda-41ac-b8e0-ac458e6fd5a5-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:52:28.277030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.276969    2563 generic.go:356] "Generic (PLEG): container finished" podID="407c3013-afda-41ac-b8e0-ac458e6fd5a5" containerID="90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175" exitCode=0
Jul 15 18:52:28.277030 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.277010    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"
Jul 15 18:52:28.277208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.277062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v" event={"ID":"407c3013-afda-41ac-b8e0-ac458e6fd5a5","Type":"ContainerDied","Data":"90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175"}
Jul 15 18:52:28.277208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.277127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v" event={"ID":"407c3013-afda-41ac-b8e0-ac458e6fd5a5","Type":"ContainerDied","Data":"3a0285c61710b5b9a84e13a09b213dcc2455716206bca55bc9f95cb302f38f8e"}
Jul 15 18:52:28.277208 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.277157    2563 scope.go:117] "RemoveContainer" containerID="90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175"
Jul 15 18:52:28.286677 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.286661    2563 scope.go:117] "RemoveContainer" containerID="90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175"
Jul 15 18:52:28.286924 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:52:28.286904    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175\": container with ID starting with 90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175 not found: ID does not exist" containerID="90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175"
Jul 15 18:52:28.286966 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.286933    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175"} err="failed to get container status \"90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175\": rpc error: code = NotFound desc = could not find container \"90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175\": container with ID starting with 90b5bbd5988ede0537a90cf7f0a553d576e2dd2c4f5f1bc6e077d51e0522a175 not found: ID does not exist"
Jul 15 18:52:28.299185 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.299162    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"]
Jul 15 18:52:28.303682 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:28.303663    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ba7662e4-85f5d6bf9c-z7g2v"]
Jul 15 18:52:29.376097 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:29.376059    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="407c3013-afda-41ac-b8e0-ac458e6fd5a5" path="/var/lib/kubelet/pods/407c3013-afda-41ac-b8e0-ac458e6fd5a5/volumes"
Jul 15 18:52:32.141929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:32.141895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:52:37.220157 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:52:37.220114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:08.726308 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:08.726269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:09.242140 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:09.242093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:15.050159 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:15.050120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:15.121447 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:15.121389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:24.374339 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:24.374305    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"]
Jul 15 18:53:24.374750 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:24.374566    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy" containerID="cri-o://f1e940a64476905161dd5dee4c655a86f680bd6092bb4c634e7ab2ceeafc32a8" gracePeriod=30
Jul 15 18:53:24.405267 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:24.405229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:24.624678 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:24.624603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:25.688487 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:25.688453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:25.789081 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:25.789056    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:25.887492 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:25.887463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:26.577753 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:26.577718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:26.671787 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:26.671758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:26.767347 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:26.767322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:28.123145 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:28.123103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:29.621385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.621353    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c1c3ed7-4763-414a-b472-2879be939140" containerID="f1e940a64476905161dd5dee4c655a86f680bd6092bb4c634e7ab2ceeafc32a8" exitCode=0
Jul 15 18:53:29.621825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.621441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" event={"ID":"6c1c3ed7-4763-414a-b472-2879be939140","Type":"ContainerDied","Data":"f1e940a64476905161dd5dee4c655a86f680bd6092bb4c634e7ab2ceeafc32a8"}
Jul 15 18:53:29.621825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.621521    2563 scope.go:117] "RemoveContainer" containerID="1320f768d60049375f3d96ac6d2c89b15276fa24c6a5ee12cdc94365b264f46d"
Jul 15 18:53:29.646295 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.646272    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:53:29.660289 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660264    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1c3ed7-4763-414a-b472-2879be939140-istiod-ca-cert\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660438 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660313    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-credential-socket\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660438 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660349    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-socket\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660438 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660373    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-certs\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660438 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1c3ed7-4763-414a-b472-2879be939140-istio-podinfo\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660665 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgwb8\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-kube-api-access-mgwb8\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660665 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660531    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-istio-token\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660665 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-data\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660665 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-envoy\") pod \"6c1c3ed7-4763-414a-b472-2879be939140\" (UID: \"6c1c3ed7-4763-414a-b472-2879be939140\") "
Jul 15 18:53:29.660665 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660640    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:53:29.660665 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:53:29.660980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1c3ed7-4763-414a-b472-2879be939140-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:53:29.660980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660865    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:53:29.660980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660951    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1c3ed7-4763-414a-b472-2879be939140-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.660980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660969    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.661189 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660981    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.661189 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.660994    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.661895 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.661870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:53:29.662928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.662900    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c1c3ed7-4763-414a-b472-2879be939140-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:53:29.663031 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.662960    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:53:29.663246 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.663216    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:53:29.663358 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.663262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-kube-api-access-mgwb8" (OuterVolumeSpecName: "kube-api-access-mgwb8") pod "6c1c3ed7-4763-414a-b472-2879be939140" (UID: "6c1c3ed7-4763-414a-b472-2879be939140"). InnerVolumeSpecName "kube-api-access-mgwb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:53:29.761940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.761900    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.761940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.761924    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1c3ed7-4763-414a-b472-2879be939140-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.761940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.761933    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1c3ed7-4763-414a-b472-2879be939140-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.761940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.761941    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgwb8\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-kube-api-access-mgwb8\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:29.761940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:29.761951    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1c3ed7-4763-414a-b472-2879be939140-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:53:30.628997 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:30.628969    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"
Jul 15 18:53:30.629475 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:30.629021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99" event={"ID":"6c1c3ed7-4763-414a-b472-2879be939140","Type":"ContainerDied","Data":"eeb91c3e7c2b320705beb0935fb4575595641d33603e5308ca06715f92cc2dea"}
Jul 15 18:53:30.629475 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:30.629089    2563 scope.go:117] "RemoveContainer" containerID="f1e940a64476905161dd5dee4c655a86f680bd6092bb4c634e7ab2ceeafc32a8"
Jul 15 18:53:30.697207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:30.697182    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"]
Jul 15 18:53:30.700641 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:30.700621    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ba7662e4-openshift-default-756b97f555-wdr99"]
Jul 15 18:53:31.380935 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:31.380903    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1c3ed7-4763-414a-b472-2879be939140" path="/var/lib/kubelet/pods/6c1c3ed7-4763-414a-b472-2879be939140/volumes"
Jul 15 18:53:34.097891 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:34.097843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:34.198413 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:34.198384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:34.760392 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:34.760361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:40.766885 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:40.766850    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:40.833150 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:40.833124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:40.924805 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:40.924778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:51.493518 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:51.493481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:53:51.846245 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:53:51.846212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:12.845051 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:12.845008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:18.625647 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:18.625571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:18.699519 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:18.699484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:18.975529 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:18.975451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:19.266488 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.266389    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"]
Jul 15 18:54:19.266979 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.266961    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="407c3013-afda-41ac-b8e0-ac458e6fd5a5" containerName="maas-api"
Jul 15 18:54:19.267032 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.266981    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="407c3013-afda-41ac-b8e0-ac458e6fd5a5" containerName="maas-api"
Jul 15 18:54:19.267032 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.267002    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy"
Jul 15 18:54:19.267032 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.267011    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy"
Jul 15 18:54:19.267133 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.267031    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy"
Jul 15 18:54:19.267133 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.267040    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy"
Jul 15 18:54:19.267195 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.267145    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy"
Jul 15 18:54:19.267195 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.267157    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="407c3013-afda-41ac-b8e0-ac458e6fd5a5" containerName="maas-api"
Jul 15 18:54:19.270670 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.270647    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.273574 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.273551    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-cbf10e-openshift-default-dockercfg-2nhfb\""
Jul 15 18:54:19.283354 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.283325    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"]
Jul 15 18:54:19.312921 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.312875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:19.338070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-credential-socket\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-certs\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrltm\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-kube-api-access-lrltm\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-envoy\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338374 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-podinfo\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338374 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-token\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338374 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-socket\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338374 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istiod-ca-cert\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.338544 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.338410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-data\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.439759 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istiod-ca-cert\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.439922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-data\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.439922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-credential-socket\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.439922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-certs\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.439922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrltm\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-kube-api-access-lrltm\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.439922 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-envoy\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-podinfo\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.439988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-token\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.440022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-socket\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.440204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-data\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440389 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.440316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-credential-socket\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440605 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.440570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istiod-ca-cert\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440743 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.440603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-socket\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.440743 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.440664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-certs\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.442353 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.442331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-envoy\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.442709 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.442691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-podinfo\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.448154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.448127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-token\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.448239 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.448223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrltm\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-kube-api-access-lrltm\") pod \"e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") " pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.583718 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.583690    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:19.712182 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.712153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:19.726812 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.726789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"]
Jul 15 18:54:19.728338 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:54:19.728302    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0534a311_4c60_4a90_bf7a_f7be89fd0e1c.slice/crio-4b440ab816d63961f820778f20b2ca1f7d2822aa4aee56e6ddf08c136b82af07 WatchSource:0}: Error finding container 4b440ab816d63961f820778f20b2ca1f7d2822aa4aee56e6ddf08c136b82af07: Status 404 returned error can't find the container with id 4b440ab816d63961f820778f20b2ca1f7d2822aa4aee56e6ddf08c136b82af07
Jul 15 18:54:19.730506 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.730475    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:19.730582 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.730539    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:19.730582 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.730568    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:19.905627 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.905540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" event={"ID":"0534a311-4c60-4a90-bf7a-f7be89fd0e1c","Type":"ContainerStarted","Data":"77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811"}
Jul 15 18:54:19.905627 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.905595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" event={"ID":"0534a311-4c60-4a90-bf7a-f7be89fd0e1c","Type":"ContainerStarted","Data":"4b440ab816d63961f820778f20b2ca1f7d2822aa4aee56e6ddf08c136b82af07"}
Jul 15 18:54:19.930704 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:19.930657    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podStartSLOduration=0.93064304 podStartE2EDuration="930.64304ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:54:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:54:19.928022145 +0000 UTC m=+2245.135285429" watchObservedRunningTime="2026-07-15 18:54:19.93064304 +0000 UTC m=+2245.137906322"
Jul 15 18:54:20.584454 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:20.584409    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:20.589254 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:20.589231    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:20.911512 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:20.911446    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:20.912300 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:20.912280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:21.860128 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:21.860094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:21.935547 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:21.935507    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"]
Jul 15 18:54:21.936259 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:21.936241    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1c3ed7-4763-414a-b472-2879be939140" containerName="istio-proxy"
Jul 15 18:54:21.939951 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:21.939927    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:21.940334 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:21.940308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:21.942340 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:21.942326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-cbf10e-serving-cert\""
Jul 15 18:54:21.950291 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:21.950268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"]
Jul 15 18:54:22.017141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.017115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:22.061240 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.061209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9msqm\" (UniqueName: \"kubernetes.io/projected/8f271563-17a1-4bed-bc42-09a87bfd7e34-kube-api-access-9msqm\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.061383 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.061268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f271563-17a1-4bed-bc42-09a87bfd7e34-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.061530 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.061511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f271563-17a1-4bed-bc42-09a87bfd7e34-maas-api-tls\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.162169 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.162099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f271563-17a1-4bed-bc42-09a87bfd7e34-maas-api-tls\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.162169 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.162156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9msqm\" (UniqueName: \"kubernetes.io/projected/8f271563-17a1-4bed-bc42-09a87bfd7e34-kube-api-access-9msqm\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.162350 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.162188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f271563-17a1-4bed-bc42-09a87bfd7e34-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.162788 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.162763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f271563-17a1-4bed-bc42-09a87bfd7e34-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.164482 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.164466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f271563-17a1-4bed-bc42-09a87bfd7e34-maas-api-tls\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.170049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.170024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9msqm\" (UniqueName: \"kubernetes.io/projected/8f271563-17a1-4bed-bc42-09a87bfd7e34-kube-api-access-9msqm\") pod \"maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.198404 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.198381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:22.253344 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.253321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:22.388567 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.388538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"]
Jul 15 18:54:22.389333 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:54:22.389308    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f271563_17a1_4bed_bc42_09a87bfd7e34.slice/crio-464022bd9d48cec3c59052ece6b3d43734fefd90f118b69aa0dfb938ca384f98 WatchSource:0}: Error finding container 464022bd9d48cec3c59052ece6b3d43734fefd90f118b69aa0dfb938ca384f98: Status 404 returned error can't find the container with id 464022bd9d48cec3c59052ece6b3d43734fefd90f118b69aa0dfb938ca384f98
Jul 15 18:54:22.573385 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.573351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:22.673554 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.673523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:22.925396 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:22.925320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z" event={"ID":"8f271563-17a1-4bed-bc42-09a87bfd7e34","Type":"ContainerStarted","Data":"464022bd9d48cec3c59052ece6b3d43734fefd90f118b69aa0dfb938ca384f98"}
Jul 15 18:54:23.933778 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:23.933740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z" event={"ID":"8f271563-17a1-4bed-bc42-09a87bfd7e34","Type":"ContainerStarted","Data":"23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00"}
Jul 15 18:54:23.934226 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:23.933848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:23.958035 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:23.957986    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z" podStartSLOduration=2.409799909 podStartE2EDuration="2.957973584s" totalImagesPullingTime="548.173675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:54:23.955853366 +0000 UTC m=+2249.163116653" watchObservedRunningTime="2026-07-15 18:54:23.957973584 +0000 UTC m=+2249.165236866"
Jul 15 18:54:26.377839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:26.377800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:26.726484 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:26.726355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:27.015504 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.015396    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"]
Jul 15 18:54:27.019119 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.019090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.022017 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.021999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f83daa-openshift-default-dockercfg-w78cg\""
Jul 15 18:54:27.033933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.033910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"]
Jul 15 18:54:27.050167 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.050143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:27.104076 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-data\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104174 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-credential-socket\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104174 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-token\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104174 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istiod-ca-cert\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104281 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-certs\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104281 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-kube-api-access-8tr5m\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104354 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-podinfo\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104354 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-socket\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.104457 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.104359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-envoy\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205246 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-envoy\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-data\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-credential-socket\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-token\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istiod-ca-cert\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-certs\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205395 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-kube-api-access-8tr5m\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205688 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-podinfo\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205688 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-socket\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.205987 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.205960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-data\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.206096 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.206027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-credential-socket\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.206155 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.206129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-certs\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.206217 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.206156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-socket\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.206446 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.206406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istiod-ca-cert\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.207744 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.207721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-envoy\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.207961 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.207946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-podinfo\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.213748 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.213727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-token\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.214079 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.214057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-kube-api-access-8tr5m\") pod \"e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") " pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.333788 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.333750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:27.382317 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.382292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:27.475317 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.475290    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"]
Jul 15 18:54:27.476485 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:54:27.476458    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecdcc6e_b2e3_44dd_81e4_b9a5f4327fcf.slice/crio-a36b9207f7c2d805cadca04d576ff8733973932eb2a4b907e7151d745809ff4b WatchSource:0}: Error finding container a36b9207f7c2d805cadca04d576ff8733973932eb2a4b907e7151d745809ff4b: Status 404 returned error can't find the container with id a36b9207f7c2d805cadca04d576ff8733973932eb2a4b907e7151d745809ff4b
Jul 15 18:54:27.478844 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.478810    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:27.478931 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.478882    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:27.478931 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.478911    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:27.958075 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.958043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" event={"ID":"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf","Type":"ContainerStarted","Data":"394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c"}
Jul 15 18:54:27.958236 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.958096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" event={"ID":"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf","Type":"ContainerStarted","Data":"a36b9207f7c2d805cadca04d576ff8733973932eb2a4b907e7151d745809ff4b"}
Jul 15 18:54:27.978317 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:27.978274    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podStartSLOduration=1.978260479 podStartE2EDuration="1.978260479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:54:27.978150587 +0000 UTC m=+2253.185413885" watchObservedRunningTime="2026-07-15 18:54:27.978260479 +0000 UTC m=+2253.185523761"
Jul 15 18:54:28.333891 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:28.333856    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:28.340088 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:28.340063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:28.964578 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:28.964548    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:28.965301 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:28.965284    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:29.946937 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:29.946910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:54:29.957138 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:29.957111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:30.047733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.047705    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"]
Jul 15 18:54:30.051242 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.051226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.052636 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.052607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:30.053668 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.053650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f83daa-serving-cert\""
Jul 15 18:54:30.067580 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.067556    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"]
Jul 15 18:54:30.128357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.128329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f361174a-0cbf-4d47-9d0d-79b145c22b5a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.128570 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.128543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.128687 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.128663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwbpn\" (UniqueName: \"kubernetes.io/projected/f361174a-0cbf-4d47-9d0d-79b145c22b5a-kube-api-access-jwbpn\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.228716 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.228619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:30.229767 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.229737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f361174a-0cbf-4d47-9d0d-79b145c22b5a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.230072 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.230053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.230223 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:54:30.230187    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-serving-cert: secret "maas-api-e2e-inf-b-f83daa-serving-cert" not found
Jul 15 18:54:30.230311 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:54:30.230289    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls podName:f361174a-0cbf-4d47-9d0d-79b145c22b5a nodeName:}" failed. No retries permitted until 2026-07-15 18:54:30.730253376 +0000 UTC m=+2255.937516651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls") pod "maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7" (UID: "f361174a-0cbf-4d47-9d0d-79b145c22b5a") : secret "maas-api-e2e-inf-b-f83daa-serving-cert" not found
Jul 15 18:54:30.230543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.230207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwbpn\" (UniqueName: \"kubernetes.io/projected/f361174a-0cbf-4d47-9d0d-79b145c22b5a-kube-api-access-jwbpn\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.230543 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.230466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f361174a-0cbf-4d47-9d0d-79b145c22b5a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.240279 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.240244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwbpn\" (UniqueName: \"kubernetes.io/projected/f361174a-0cbf-4d47-9d0d-79b145c22b5a-kube-api-access-jwbpn\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.462932 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.462898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:30.728059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.728017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:30.736848 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.736811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.740143 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.740117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls\") pod \"maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:30.828566 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.828520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:30.964707 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:30.964672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:31.157844 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:31.157749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"]
Jul 15 18:54:31.984215 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:31.984123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7" event={"ID":"f361174a-0cbf-4d47-9d0d-79b145c22b5a","Type":"ContainerStarted","Data":"afa5f6f5a81fd491f0d878d7f29f773e8a357f54b40f360ac485561173bf0ae8"}
Jul 15 18:54:31.984215 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:31.984178    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:31.984215 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:31.984196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7" event={"ID":"f361174a-0cbf-4d47-9d0d-79b145c22b5a","Type":"ContainerStarted","Data":"d1c154e3f1ac7b69267ae332ccf2f457bfe0fc30e0cc900aa7bbf9f2a0294383"}
Jul 15 18:54:32.002732 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:32.002690    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7" podStartSLOduration=1.5662982140000001 podStartE2EDuration="2.002675864s" totalImagesPullingTime="436.37765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:54:32.00132814 +0000 UTC m=+2257.208591443" watchObservedRunningTime="2026-07-15 18:54:32.002675864 +0000 UTC m=+2257.209939146"
Jul 15 18:54:34.510409 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:34.510375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:36.953586 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:36.953549    2563 patch_prober.go:28] interesting pod/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 18:54:36.953935 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:36.953622    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 18:54:37.994556 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:37.994523    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:54:38.020446 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:38.020408    2563 generic.go:356] "Generic (PLEG): container finished" podID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerID="77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811" exitCode=0
Jul 15 18:54:38.020584 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:38.020479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" event={"ID":"0534a311-4c60-4a90-bf7a-f7be89fd0e1c","Type":"ContainerDied","Data":"77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811"}
Jul 15 18:54:38.020825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:38.020808    2563 scope.go:117] "RemoveContainer" containerID="77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811"
Jul 15 18:54:38.021787 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:38.021761    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:38.021874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:38.021831    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:38.021874 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:38.021864    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:39.029628 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:39.029593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" event={"ID":"0534a311-4c60-4a90-bf7a-f7be89fd0e1c","Type":"ContainerStarted","Data":"3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc"}
Jul 15 18:54:39.584090 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:39.584057    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:39.584282 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:39.584261    2563 patch_prober.go:28] interesting pod/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 18:54:39.584349 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:39.584319    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 18:54:40.584742 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:40.584707    2563 patch_prober.go:28] interesting pod/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 18:54:40.585125 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:40.584801    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 18:54:41.584664 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:41.584627    2563 patch_prober.go:28] interesting pod/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 18:54:41.584847 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:41.584678    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 18:54:42.584888 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:42.584854    2563 patch_prober.go:28] interesting pod/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 18:54:42.585266 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:42.584908    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 18:54:43.588152 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:43.588123    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:43.588641 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:43.588613    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:43.589366 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:43.589344    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:54:43.694581 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:43.694533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:45.006554 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:45.006521    2563 patch_prober.go:28] interesting pod/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 18:54:45.007061 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:45.006585    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 18:54:46.090953 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:46.090921    2563 generic.go:356] "Generic (PLEG): container finished" podID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerID="394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c" exitCode=0
Jul 15 18:54:46.091454 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:46.090999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" event={"ID":"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf","Type":"ContainerDied","Data":"394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c"}
Jul 15 18:54:46.091534 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:46.091483    2563 scope.go:117] "RemoveContainer" containerID="394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c"
Jul 15 18:54:46.092526 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:46.092500    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:46.092601 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:46.092566    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:46.092639 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:46.092601    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:54:46.243150 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:46.243114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:47.098839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:47.098802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" event={"ID":"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf","Type":"ContainerStarted","Data":"0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2"}
Jul 15 18:54:47.338447 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:47.334665    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:47.338447 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:47.334797    2563 patch_prober.go:28] interesting pod/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 18:54:47.338447 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:47.334837    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 18:54:48.334730 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:48.334689    2563 patch_prober.go:28] interesting pod/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 18:54:48.335204 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:48.334752    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 18:54:49.334472 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:49.334438    2563 patch_prober.go:28] interesting pod/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 18:54:49.334758 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:49.334733    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 18:54:50.334231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:50.334189    2563 patch_prober.go:28] interesting pod/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 18:54:50.334460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:50.334259    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 18:54:51.338274 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:51.338241    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:51.338746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:51.338646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:51.339185 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:51.339167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:54:51.595203 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:51.595104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:51.694511 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:51.694472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:54:52.629731 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:54:52.629694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:12.972071 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:12.972030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:14.496362 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:14.496323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:33.468485 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:33.468451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:33.547318 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:33.547287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:46.939256 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:46.939223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:56.977313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:56.977275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:58.089969 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:58.089935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:58.757153 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:58.757074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:55:58.856516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:55:58.856487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:08.962451 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:08.962401    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"]
Jul 15 18:56:08.962971 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:08.962643    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z" podUID="8f271563-17a1-4bed-bc42-09a87bfd7e34" containerName="maas-api" containerID="cri-o://23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00" gracePeriod=30
Jul 15 18:56:09.005089 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.005059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:09.216470 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.216385    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:56:09.315264 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.315232    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f271563-17a1-4bed-bc42-09a87bfd7e34-maas-api-tls\") pod \"8f271563-17a1-4bed-bc42-09a87bfd7e34\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") "
Jul 15 18:56:09.315490 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.315286    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9msqm\" (UniqueName: \"kubernetes.io/projected/8f271563-17a1-4bed-bc42-09a87bfd7e34-kube-api-access-9msqm\") pod \"8f271563-17a1-4bed-bc42-09a87bfd7e34\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") "
Jul 15 18:56:09.315490 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.315310    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f271563-17a1-4bed-bc42-09a87bfd7e34-openshift-service-ca\") pod \"8f271563-17a1-4bed-bc42-09a87bfd7e34\" (UID: \"8f271563-17a1-4bed-bc42-09a87bfd7e34\") "
Jul 15 18:56:09.315768 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.315740    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f271563-17a1-4bed-bc42-09a87bfd7e34-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f271563-17a1-4bed-bc42-09a87bfd7e34" (UID: "8f271563-17a1-4bed-bc42-09a87bfd7e34"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:56:09.317447 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.317397    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f271563-17a1-4bed-bc42-09a87bfd7e34-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f271563-17a1-4bed-bc42-09a87bfd7e34" (UID: "8f271563-17a1-4bed-bc42-09a87bfd7e34"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:56:09.317447 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.317398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f271563-17a1-4bed-bc42-09a87bfd7e34-kube-api-access-9msqm" (OuterVolumeSpecName: "kube-api-access-9msqm") pod "8f271563-17a1-4bed-bc42-09a87bfd7e34" (UID: "8f271563-17a1-4bed-bc42-09a87bfd7e34"). InnerVolumeSpecName "kube-api-access-9msqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:09.416268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.416239    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f271563-17a1-4bed-bc42-09a87bfd7e34-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:09.416268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.416264    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9msqm\" (UniqueName: \"kubernetes.io/projected/8f271563-17a1-4bed-bc42-09a87bfd7e34-kube-api-access-9msqm\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:09.416450 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.416274    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f271563-17a1-4bed-bc42-09a87bfd7e34-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:09.573305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.573273    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f271563-17a1-4bed-bc42-09a87bfd7e34" containerID="23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00" exitCode=0
Jul 15 18:56:09.573481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.573321    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"
Jul 15 18:56:09.573481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.573359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z" event={"ID":"8f271563-17a1-4bed-bc42-09a87bfd7e34","Type":"ContainerDied","Data":"23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00"}
Jul 15 18:56:09.573481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.573413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z" event={"ID":"8f271563-17a1-4bed-bc42-09a87bfd7e34","Type":"ContainerDied","Data":"464022bd9d48cec3c59052ece6b3d43734fefd90f118b69aa0dfb938ca384f98"}
Jul 15 18:56:09.573481 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.573466    2563 scope.go:117] "RemoveContainer" containerID="23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00"
Jul 15 18:56:09.582739 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.582722    2563 scope.go:117] "RemoveContainer" containerID="23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00"
Jul 15 18:56:09.582979 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:56:09.582959    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00\": container with ID starting with 23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00 not found: ID does not exist" containerID="23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00"
Jul 15 18:56:09.583023 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.582988    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00"} err="failed to get container status \"23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00\": rpc error: code = NotFound desc = could not find container \"23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00\": container with ID starting with 23d51f45f874ab7ea40ea1b7fc1084d000e55c7c39444245c983c4fbcd1f1d00 not found: ID does not exist"
Jul 15 18:56:09.591016 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.590980    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"]
Jul 15 18:56:09.595016 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:09.594990    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cbf10e-d55985699-mdv4z"]
Jul 15 18:56:11.377330 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:11.377298    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f271563-17a1-4bed-bc42-09a87bfd7e34" path="/var/lib/kubelet/pods/8f271563-17a1-4bed-bc42-09a87bfd7e34/volumes"
Jul 15 18:56:13.371259 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:13.371194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:19.321484 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:19.321416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:19.421839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:19.421806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:24.090131 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:24.090095    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"]
Jul 15 18:56:24.090528 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:24.090352    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy" containerID="cri-o://3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc" gracePeriod=30
Jul 15 18:56:24.135044 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:24.135014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:24.371866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:24.371778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:25.337621 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:25.337590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:25.617687 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:25.617562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:27.440102 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:27.440042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:27.552369 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:27.552308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:28.591164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:28.591117    2563 patch_prober.go:28] interesting pod/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 18:56:28.591546 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:28.591191    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:56:29.338734 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.338709    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:56:29.394064 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.393993    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-token\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394064 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394028    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-certs\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394064 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-socket\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394317 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-credential-socket\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394317 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394300    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-data\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394442 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:29.394442 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394392    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-envoy\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394442 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394402    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:29.394613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:29.394613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394473    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istiod-ca-cert\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394496    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrltm\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-kube-api-access-lrltm\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394613 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-podinfo\") pod \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\" (UID: \"0534a311-4c60-4a90-bf7a-f7be89fd0e1c\") "
Jul 15 18:56:29.394859 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394829    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:56:29.394859 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394849    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.394965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394866    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.394965 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.394879    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.395281 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.395250    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:29.396918 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.396884    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:29.397049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.396959    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-kube-api-access-lrltm" (OuterVolumeSpecName: "kube-api-access-lrltm") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "kube-api-access-lrltm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:29.397049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.397035    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:29.397151 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.397062    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0534a311-4c60-4a90-bf7a-f7be89fd0e1c" (UID: "0534a311-4c60-4a90-bf7a-f7be89fd0e1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:56:29.495954 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.495915    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.495954 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.495949    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.495954 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.495964    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrltm\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-kube-api-access-lrltm\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.496207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.495977    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.496207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.495989    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.496207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.495999    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0534a311-4c60-4a90-bf7a-f7be89fd0e1c-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:29.693329 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.693232    2563 generic.go:356] "Generic (PLEG): container finished" podID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerID="3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc" exitCode=0
Jul 15 18:56:29.693329 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.693277    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"
Jul 15 18:56:29.693329 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.693318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" event={"ID":"0534a311-4c60-4a90-bf7a-f7be89fd0e1c","Type":"ContainerDied","Data":"3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc"}
Jul 15 18:56:29.693940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.693375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt" event={"ID":"0534a311-4c60-4a90-bf7a-f7be89fd0e1c","Type":"ContainerDied","Data":"4b440ab816d63961f820778f20b2ca1f7d2822aa4aee56e6ddf08c136b82af07"}
Jul 15 18:56:29.693940 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.693398    2563 scope.go:117] "RemoveContainer" containerID="3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc"
Jul 15 18:56:29.703999 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.703981    2563 scope.go:117] "RemoveContainer" containerID="77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811"
Jul 15 18:56:29.712744 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.712723    2563 scope.go:117] "RemoveContainer" containerID="3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc"
Jul 15 18:56:29.713013 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:56:29.712991    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc\": container with ID starting with 3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc not found: ID does not exist" containerID="3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc"
Jul 15 18:56:29.713110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.713025    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc"} err="failed to get container status \"3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc\": rpc error: code = NotFound desc = could not find container \"3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc\": container with ID starting with 3df8df1c253008cbbe78ec5f7d8646d2cba3fa7e862836eafb0821ac928ceecc not found: ID does not exist"
Jul 15 18:56:29.713110 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.713050    2563 scope.go:117] "RemoveContainer" containerID="77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811"
Jul 15 18:56:29.713337 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:56:29.713319    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811\": container with ID starting with 77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811 not found: ID does not exist" containerID="77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811"
Jul 15 18:56:29.713377 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.713343    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811"} err="failed to get container status \"77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811\": rpc error: code = NotFound desc = could not find container \"77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811\": container with ID starting with 77462bb0499b3d2a5ba119190e90d0c27c172834f4c737b4a03083ab677ac811 not found: ID does not exist"
Jul 15 18:56:29.718076 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.718054    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"]
Jul 15 18:56:29.724094 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:29.724071    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-cbf10e-openshift-default-7fd9786b87-5fvgt"]
Jul 15 18:56:31.377821 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:31.377787    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" path="/var/lib/kubelet/pods/0534a311-4c60-4a90-bf7a-f7be89fd0e1c/volumes"
Jul 15 18:56:35.588746 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.588712    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"]
Jul 15 18:56:35.589563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.589518    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7" podUID="f361174a-0cbf-4d47-9d0d-79b145c22b5a" containerName="maas-api" containerID="cri-o://afa5f6f5a81fd491f0d878d7f29f773e8a357f54b40f360ac485561173bf0ae8" gracePeriod=30
Jul 15 18:56:35.667331 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.667298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:35.740899 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.740807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:35.742661 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.742357    2563 generic.go:356] "Generic (PLEG): container finished" podID="f361174a-0cbf-4d47-9d0d-79b145c22b5a" containerID="afa5f6f5a81fd491f0d878d7f29f773e8a357f54b40f360ac485561173bf0ae8" exitCode=0
Jul 15 18:56:35.742661 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.742587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7" event={"ID":"f361174a-0cbf-4d47-9d0d-79b145c22b5a","Type":"ContainerDied","Data":"afa5f6f5a81fd491f0d878d7f29f773e8a357f54b40f360ac485561173bf0ae8"}
Jul 15 18:56:35.856120 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.856097    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:56:35.954469 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.954414    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwbpn\" (UniqueName: \"kubernetes.io/projected/f361174a-0cbf-4d47-9d0d-79b145c22b5a-kube-api-access-jwbpn\") pod \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") "
Jul 15 18:56:35.954614 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.954493    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f361174a-0cbf-4d47-9d0d-79b145c22b5a-openshift-service-ca\") pod \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") "
Jul 15 18:56:35.954614 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.954525    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls\") pod \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\" (UID: \"f361174a-0cbf-4d47-9d0d-79b145c22b5a\") "
Jul 15 18:56:35.954926 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.954901    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f361174a-0cbf-4d47-9d0d-79b145c22b5a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f361174a-0cbf-4d47-9d0d-79b145c22b5a" (UID: "f361174a-0cbf-4d47-9d0d-79b145c22b5a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:56:35.956690 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.956662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f361174a-0cbf-4d47-9d0d-79b145c22b5a-kube-api-access-jwbpn" (OuterVolumeSpecName: "kube-api-access-jwbpn") pod "f361174a-0cbf-4d47-9d0d-79b145c22b5a" (UID: "f361174a-0cbf-4d47-9d0d-79b145c22b5a"). InnerVolumeSpecName "kube-api-access-jwbpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:35.956690 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:35.956673    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f361174a-0cbf-4d47-9d0d-79b145c22b5a" (UID: "f361174a-0cbf-4d47-9d0d-79b145c22b5a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:56:36.055620 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.055591    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwbpn\" (UniqueName: \"kubernetes.io/projected/f361174a-0cbf-4d47-9d0d-79b145c22b5a-kube-api-access-jwbpn\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:36.055620 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.055617    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f361174a-0cbf-4d47-9d0d-79b145c22b5a-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:36.055620 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.055628    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f361174a-0cbf-4d47-9d0d-79b145c22b5a-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:36.749781 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.749752    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"
Jul 15 18:56:36.749781 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.749760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7" event={"ID":"f361174a-0cbf-4d47-9d0d-79b145c22b5a","Type":"ContainerDied","Data":"d1c154e3f1ac7b69267ae332ccf2f457bfe0fc30e0cc900aa7bbf9f2a0294383"}
Jul 15 18:56:36.750287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.749823    2563 scope.go:117] "RemoveContainer" containerID="afa5f6f5a81fd491f0d878d7f29f773e8a357f54b40f360ac485561173bf0ae8"
Jul 15 18:56:36.773178 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.773149    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"]
Jul 15 18:56:36.777217 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:36.777195    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f83daa-56bfd8b6fb-kwsv7"]
Jul 15 18:56:37.377637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:37.377606    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f361174a-0cbf-4d47-9d0d-79b145c22b5a" path="/var/lib/kubelet/pods/f361174a-0cbf-4d47-9d0d-79b145c22b5a/volumes"
Jul 15 18:56:39.664551 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:39.664514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:46.277135 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:46.277097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:46.405417 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:46.405381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:50.387597 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:50.387562    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"]
Jul 15 18:56:50.388051 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:50.387776    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy" containerID="cri-o://0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2" gracePeriod=30
Jul 15 18:56:50.411142 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:50.411115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:50.656736 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:50.656650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:51.009600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:51.009517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:51.339807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:51.339775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:51.340701 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:51.340677    2563 patch_prober.go:28] interesting pod/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 18:56:51.340829 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:51.340741    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:56:51.638899 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:51.638816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:54.596519 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.596485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:54.685126 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.685084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:54.703293 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703263    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"]
Jul 15 18:56:54.703689 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703675    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f361174a-0cbf-4d47-9d0d-79b145c22b5a" containerName="maas-api"
Jul 15 18:56:54.703755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703690    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f361174a-0cbf-4d47-9d0d-79b145c22b5a" containerName="maas-api"
Jul 15 18:56:54.703755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703700    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy"
Jul 15 18:56:54.703755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703706    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy"
Jul 15 18:56:54.703755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703718    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy"
Jul 15 18:56:54.703755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703724    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy"
Jul 15 18:56:54.703755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703736    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f271563-17a1-4bed-bc42-09a87bfd7e34" containerName="maas-api"
Jul 15 18:56:54.703755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703742    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f271563-17a1-4bed-bc42-09a87bfd7e34" containerName="maas-api"
Jul 15 18:56:54.703980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703794    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy"
Jul 15 18:56:54.703980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703803    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f271563-17a1-4bed-bc42-09a87bfd7e34" containerName="maas-api"
Jul 15 18:56:54.703980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703808    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0534a311-4c60-4a90-bf7a-f7be89fd0e1c" containerName="istio-proxy"
Jul 15 18:56:54.703980 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.703815    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f361174a-0cbf-4d47-9d0d-79b145c22b5a" containerName="maas-api"
Jul 15 18:56:54.708211 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.708195    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.710821 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.710800    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a0cde7-serving-cert\""
Jul 15 18:56:54.727554 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.727527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"]
Jul 15 18:56:54.807756 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.807729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:54.828730 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.828702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.828914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.828760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5b19cc-1bd1-4641-a620-78211e1927d7-openshift-service-ca\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.828914 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.828816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm67x\" (UniqueName: \"kubernetes.io/projected/3e5b19cc-1bd1-4641-a620-78211e1927d7-kube-api-access-vm67x\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.930388 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.930306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.930388 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.930359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5b19cc-1bd1-4641-a620-78211e1927d7-openshift-service-ca\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.930388 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.930390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm67x\" (UniqueName: \"kubernetes.io/projected/3e5b19cc-1bd1-4641-a620-78211e1927d7-kube-api-access-vm67x\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.930702 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:56:54.930491    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-serving-cert: secret "maas-api-e2e-api-a-a0cde7-serving-cert" not found
Jul 15 18:56:54.930702 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:56:54.930590    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls podName:3e5b19cc-1bd1-4641-a620-78211e1927d7 nodeName:}" failed. No retries permitted until 2026-07-15 18:56:55.430568589 +0000 UTC m=+2400.637831863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls") pod "maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq" (UID: "3e5b19cc-1bd1-4641-a620-78211e1927d7") : secret "maas-api-e2e-api-a-a0cde7-serving-cert" not found
Jul 15 18:56:54.931194 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.931171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5b19cc-1bd1-4641-a620-78211e1927d7-openshift-service-ca\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:54.939306 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:54.939283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm67x\" (UniqueName: \"kubernetes.io/projected/3e5b19cc-1bd1-4641-a620-78211e1927d7-kube-api-access-vm67x\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:55.309101 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.309070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:55.421703 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.421669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:55.436050 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.436016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:55.438456 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.438413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls\") pod \"maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:55.489453 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.489408    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:56:55.506180 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.506158    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 18:56:55.527464 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.527302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:55.618924 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.618889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:55.659630 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.659606    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:56:55.840051 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.839973    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-kube-api-access-8tr5m\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840051 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840008    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istiod-ca-cert\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840051 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840044    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-podinfo\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840189    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-envoy\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-data\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840313 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-socket\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840510 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840320    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-credential-socket\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840510 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-token\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840510 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840368    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:56:55.840510 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840410    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-certs\") pod \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\" (UID: \"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf\") "
Jul 15 18:56:55.840726 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840555    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.840785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840728    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.840785 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840746    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.840897 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840831    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.840897 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840848    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.840897 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.840861    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.841109 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.841087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.842575 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.842548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:55.842575 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.842564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.842738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.842677    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:56:55.842738 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.842685    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-kube-api-access-8tr5m" (OuterVolumeSpecName: "kube-api-access-8tr5m") pod "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" (UID: "3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf"). InnerVolumeSpecName "kube-api-access-8tr5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:55.863027 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.862966    2563 generic.go:356] "Generic (PLEG): container finished" podID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerID="0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2" exitCode=0
Jul 15 18:56:55.863218 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.863198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" event={"ID":"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf","Type":"ContainerDied","Data":"0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2"}
Jul 15 18:56:55.863348 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.863331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84" event={"ID":"3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf","Type":"ContainerDied","Data":"a36b9207f7c2d805cadca04d576ff8733973932eb2a4b907e7151d745809ff4b"}
Jul 15 18:56:55.863406 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.863390    2563 scope.go:117] "RemoveContainer" containerID="0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2"
Jul 15 18:56:55.863817 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.863708    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"
Jul 15 18:56:55.875591 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.875567    2563 scope.go:117] "RemoveContainer" containerID="394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c"
Jul 15 18:56:55.884713 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.884695    2563 scope.go:117] "RemoveContainer" containerID="0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2"
Jul 15 18:56:55.884991 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:56:55.884974    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2\": container with ID starting with 0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2 not found: ID does not exist" containerID="0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2"
Jul 15 18:56:55.885072 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.885004    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2"} err="failed to get container status \"0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2\": rpc error: code = NotFound desc = could not find container \"0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2\": container with ID starting with 0d7db1c989a7606c61b046e8c83eecede244485d6a79b2213bd54a7843edc7d2 not found: ID does not exist"
Jul 15 18:56:55.885072 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.885025    2563 scope.go:117] "RemoveContainer" containerID="394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c"
Jul 15 18:56:55.885267 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:56:55.885250    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c\": container with ID starting with 394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c not found: ID does not exist" containerID="394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c"
Jul 15 18:56:55.885324 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.885274    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c"} err="failed to get container status \"394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c\": rpc error: code = NotFound desc = could not find container \"394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c\": container with ID starting with 394f60a520727b6b4c62e84292e49102fddfc89e7a869134ff00b8ca7486fd3c not found: ID does not exist"
Jul 15 18:56:55.894767 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.894743    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"]
Jul 15 18:56:55.899654 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.899632    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f83daa-openshift-default-55cc94d577-sht84"]
Jul 15 18:56:55.941967 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.941943    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.941967 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.941966    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.942132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.941974    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.942132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.941982    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.942132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.941997    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-kube-api-access-8tr5m\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.942132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:55.942011    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:56:56.004901 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:56.004871    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"]
Jul 15 18:56:56.005948 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:56:56.005909    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5b19cc_1bd1_4641_a620_78211e1927d7.slice/crio-1f3861818cdbd83eb7c20c88b43e8475ef882b4d5f9b3810d4f0b39888b31ecc WatchSource:0}: Error finding container 1f3861818cdbd83eb7c20c88b43e8475ef882b4d5f9b3810d4f0b39888b31ecc: Status 404 returned error can't find the container with id 1f3861818cdbd83eb7c20c88b43e8475ef882b4d5f9b3810d4f0b39888b31ecc
Jul 15 18:56:56.007306 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:56.007288    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:56:56.870678 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:56.870645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq" event={"ID":"3e5b19cc-1bd1-4641-a620-78211e1927d7","Type":"ContainerStarted","Data":"32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5"}
Jul 15 18:56:56.871207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:56.870709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq" event={"ID":"3e5b19cc-1bd1-4641-a620-78211e1927d7","Type":"ContainerStarted","Data":"1f3861818cdbd83eb7c20c88b43e8475ef882b4d5f9b3810d4f0b39888b31ecc"}
Jul 15 18:56:56.871207 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:56.870809    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:56:56.891086 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:56.891032    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq" podStartSLOduration=2.505844637 podStartE2EDuration="2.891012767s" totalImagesPullingTime="385.16813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:56.889524293 +0000 UTC m=+2402.096787634" watchObservedRunningTime="2026-07-15 18:56:56.891012767 +0000 UTC m=+2402.098276052"
Jul 15 18:56:57.377861 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:57.377822    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" path="/var/lib/kubelet/pods/3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf/volumes"
Jul 15 18:56:59.207268 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:59.207237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:56:59.841787 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:56:59.841752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:00.056220 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.056189    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"]
Jul 15 18:57:00.056600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.056587    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy"
Jul 15 18:57:00.056651 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.056602    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy"
Jul 15 18:57:00.056690 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.056680    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy"
Jul 15 18:57:00.056690 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.056688    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy"
Jul 15 18:57:00.060098 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.060079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.064971 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.064950    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-dc683a-openshift-default-dockercfg-zp2px\""
Jul 15 18:57:00.088084 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.088060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"]
Jul 15 18:57:00.117952 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.117840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:00.180217 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-certs\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-envoy\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-istio-token\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-data\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-credential-socket\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-socket\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa82343-f79f-408e-9d17-7e8af59fc337-istio-podinfo\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7pjw\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-kube-api-access-c7pjw\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.180606 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.180574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa82343-f79f-408e-9d17-7e8af59fc337-istiod-ca-cert\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281178 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-socket\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa82343-f79f-408e-9d17-7e8af59fc337-istio-podinfo\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7pjw\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-kube-api-access-c7pjw\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa82343-f79f-408e-9d17-7e8af59fc337-istiod-ca-cert\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-certs\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-envoy\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-istio-token\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-data\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.281702 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-socket\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.282154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-certs\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.282154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-credential-socket\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.282154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.281839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-data\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.282154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.282095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa82343-f79f-408e-9d17-7e8af59fc337-istiod-ca-cert\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.282154 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.282132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-credential-socket\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.283622 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.283596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-envoy\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.283837 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.283821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa82343-f79f-408e-9d17-7e8af59fc337-istio-podinfo\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.297822 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.297796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-istio-token\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.297930 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.297855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7pjw\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-kube-api-access-c7pjw\") pod \"e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") " pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.365765 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.365726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:00.370737 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.370666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:00.553105 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.553068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"]
Jul 15 18:57:00.556330 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:57:00.556301    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa82343_f79f_408e_9d17_7e8af59fc337.slice/crio-0534649504ec5811b84a427674b058855d68fe34e165fd510c67de3ddc250ef6 WatchSource:0}: Error finding container 0534649504ec5811b84a427674b058855d68fe34e165fd510c67de3ddc250ef6: Status 404 returned error can't find the container with id 0534649504ec5811b84a427674b058855d68fe34e165fd510c67de3ddc250ef6
Jul 15 18:57:00.558645 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.558615    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:57:00.558720 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.558681    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:57:00.558720 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.558712    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:57:00.895106 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.895075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" event={"ID":"daa82343-f79f-408e-9d17-7e8af59fc337","Type":"ContainerStarted","Data":"ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65"}
Jul 15 18:57:00.895309 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.895139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" event={"ID":"daa82343-f79f-408e-9d17-7e8af59fc337","Type":"ContainerStarted","Data":"0534649504ec5811b84a427674b058855d68fe34e165fd510c67de3ddc250ef6"}
Jul 15 18:57:00.924923 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:00.924872    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" podStartSLOduration=0.924856833 podStartE2EDuration="924.856833ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:57:00.922546134 +0000 UTC m=+2406.129809431" watchObservedRunningTime="2026-07-15 18:57:00.924856833 +0000 UTC m=+2406.132120115"
Jul 15 18:57:01.377204 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:01.377176    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:01.377596 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:01.377260    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:01.901440 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:01.901398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:01.902489 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:01.902448    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:02.884357 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:02.884331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:57:02.976849 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:02.976811    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:03.071292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.071259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:03.206839 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.206737    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"]
Jul 15 18:57:03.207552 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.207525    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy"
Jul 15 18:57:03.207552 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.207553    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ecdcc6e-b2e3-44dd-81e4-b9a5f4327fcf" containerName="istio-proxy"
Jul 15 18:57:03.211187 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.211168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.213770 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.213748    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-dc683a-serving-cert\""
Jul 15 18:57:03.222032 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.221957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"]
Jul 15 18:57:03.241600 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.241569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:03.346622 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.346592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:03.411170 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.411137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a38058-1a66-40fe-8721-75797bcbbf0d-maas-api-tls\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.411339 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.411206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a38058-1a66-40fe-8721-75797bcbbf0d-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.411339 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.411231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff5hw\" (UniqueName: \"kubernetes.io/projected/72a38058-1a66-40fe-8721-75797bcbbf0d-kube-api-access-ff5hw\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.512240 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.512140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a38058-1a66-40fe-8721-75797bcbbf0d-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.512240 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.512190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff5hw\" (UniqueName: \"kubernetes.io/projected/72a38058-1a66-40fe-8721-75797bcbbf0d-kube-api-access-ff5hw\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.512538 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.512265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a38058-1a66-40fe-8721-75797bcbbf0d-maas-api-tls\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.512880 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.512854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a38058-1a66-40fe-8721-75797bcbbf0d-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.514637 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.514616    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a38058-1a66-40fe-8721-75797bcbbf0d-maas-api-tls\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.528704 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.528673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff5hw\" (UniqueName: \"kubernetes.io/projected/72a38058-1a66-40fe-8721-75797bcbbf0d-kube-api-access-ff5hw\") pod \"maas-api-e2e-api-b-dc683a-75754df89c-79m44\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.791951 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.791864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:03.824046 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.824015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:03.887791 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.887758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:03.974907 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:03.974880    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"]
Jul 15 18:57:03.975758 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:57:03.975722    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a38058_1a66_40fe_8721_75797bcbbf0d.slice/crio-80a35d834e62377b530e4ac4eb664a49897621b6fdfdd390594df4afdc3e5eea WatchSource:0}: Error finding container 80a35d834e62377b530e4ac4eb664a49897621b6fdfdd390594df4afdc3e5eea: Status 404 returned error can't find the container with id 80a35d834e62377b530e4ac4eb664a49897621b6fdfdd390594df4afdc3e5eea
Jul 15 18:57:04.924770 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:04.924733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44" event={"ID":"72a38058-1a66-40fe-8721-75797bcbbf0d","Type":"ContainerStarted","Data":"4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe"}
Jul 15 18:57:04.925225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:04.924802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44" event={"ID":"72a38058-1a66-40fe-8721-75797bcbbf0d","Type":"ContainerStarted","Data":"80a35d834e62377b530e4ac4eb664a49897621b6fdfdd390594df4afdc3e5eea"}
Jul 15 18:57:04.925225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:04.924911    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:04.947449 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:04.947375    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44" podStartSLOduration=1.467475796 podStartE2EDuration="1.947358871s" totalImagesPullingTime="479.883075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:57:04.944997551 +0000 UTC m=+2410.152260836" watchObservedRunningTime="2026-07-15 18:57:04.947358871 +0000 UTC m=+2410.154622155"
Jul 15 18:57:05.796241 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:05.796201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:07.523261 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:07.523223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:10.940055 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:10.940029    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:16.536597 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:16.536550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:16.636820 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:16.636786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:20.025141 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:20.025054    2563 generic.go:356] "Generic (PLEG): container finished" podID="daa82343-f79f-408e-9d17-7e8af59fc337" containerID="ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65" exitCode=0
Jul 15 18:57:20.025670 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:20.025135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" event={"ID":"daa82343-f79f-408e-9d17-7e8af59fc337","Type":"ContainerDied","Data":"ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65"}
Jul 15 18:57:20.025741 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:20.025690    2563 scope.go:117] "RemoveContainer" containerID="ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65"
Jul 15 18:57:20.026772 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:20.026740    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:57:20.026879 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:20.026817    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:57:20.026879 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:20.026851    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:57:21.036550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:21.036511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" event={"ID":"daa82343-f79f-408e-9d17-7e8af59fc337","Type":"ContainerStarted","Data":"e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1"}
Jul 15 18:57:21.371170 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:21.371131    2563 patch_prober.go:28] interesting pod/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 18:57:21.371355 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:21.371192    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 18:57:21.376707 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:21.376682    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:22.371175 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:22.371138    2563 patch_prober.go:28] interesting pod/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 18:57:22.371677 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:22.371199    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 18:57:23.371524 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:23.371482    2563 patch_prober.go:28] interesting pod/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 18:57:23.371929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:23.371554    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 18:57:24.371075 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:24.371033    2563 patch_prober.go:28] interesting pod/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 18:57:24.371294 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:24.371113    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 18:57:24.676283 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:24.676199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:24.777255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:24.777217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:25.376863 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:25.376836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:25.377145 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:25.377119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:25.377799 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:25.377782    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:57:26.744112 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:26.744079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:26.843054 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:26.843020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:27.009189 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.009102    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"]
Jul 15 18:57:27.009460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.009416    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq" podUID="3e5b19cc-1bd1-4641-a620-78211e1927d7" containerName="maas-api" containerID="cri-o://32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5" gracePeriod=30
Jul 15 18:57:27.046446 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.046404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:27.268807 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.268752    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:57:27.345755 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.345726    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls\") pod \"3e5b19cc-1bd1-4641-a620-78211e1927d7\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") "
Jul 15 18:57:27.345905 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.345800    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5b19cc-1bd1-4641-a620-78211e1927d7-openshift-service-ca\") pod \"3e5b19cc-1bd1-4641-a620-78211e1927d7\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") "
Jul 15 18:57:27.345972 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.345955    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm67x\" (UniqueName: \"kubernetes.io/projected/3e5b19cc-1bd1-4641-a620-78211e1927d7-kube-api-access-vm67x\") pod \"3e5b19cc-1bd1-4641-a620-78211e1927d7\" (UID: \"3e5b19cc-1bd1-4641-a620-78211e1927d7\") "
Jul 15 18:57:27.346120 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.346097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e5b19cc-1bd1-4641-a620-78211e1927d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e5b19cc-1bd1-4641-a620-78211e1927d7" (UID: "3e5b19cc-1bd1-4641-a620-78211e1927d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:57:27.346305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.346290    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5b19cc-1bd1-4641-a620-78211e1927d7-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:57:27.347885 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.347859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e5b19cc-1bd1-4641-a620-78211e1927d7" (UID: "3e5b19cc-1bd1-4641-a620-78211e1927d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:57:27.348002 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.347931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5b19cc-1bd1-4641-a620-78211e1927d7-kube-api-access-vm67x" (OuterVolumeSpecName: "kube-api-access-vm67x") pod "3e5b19cc-1bd1-4641-a620-78211e1927d7" (UID: "3e5b19cc-1bd1-4641-a620-78211e1927d7"). InnerVolumeSpecName "kube-api-access-vm67x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:57:27.446899 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.446865    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm67x\" (UniqueName: \"kubernetes.io/projected/3e5b19cc-1bd1-4641-a620-78211e1927d7-kube-api-access-vm67x\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:57:27.446899 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:27.446894    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5b19cc-1bd1-4641-a620-78211e1927d7-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:57:28.085520 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.085487    2563 generic.go:356] "Generic (PLEG): container finished" podID="3e5b19cc-1bd1-4641-a620-78211e1927d7" containerID="32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5" exitCode=0
Jul 15 18:57:28.085928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.085532    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"
Jul 15 18:57:28.085928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.085568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq" event={"ID":"3e5b19cc-1bd1-4641-a620-78211e1927d7","Type":"ContainerDied","Data":"32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5"}
Jul 15 18:57:28.085928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.085615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq" event={"ID":"3e5b19cc-1bd1-4641-a620-78211e1927d7","Type":"ContainerDied","Data":"1f3861818cdbd83eb7c20c88b43e8475ef882b4d5f9b3810d4f0b39888b31ecc"}
Jul 15 18:57:28.085928 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.085638    2563 scope.go:117] "RemoveContainer" containerID="32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5"
Jul 15 18:57:28.097292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.097194    2563 scope.go:117] "RemoveContainer" containerID="32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5"
Jul 15 18:57:28.097702 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:57:28.097680    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5\": container with ID starting with 32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5 not found: ID does not exist" containerID="32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5"
Jul 15 18:57:28.097786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.097709    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5"} err="failed to get container status \"32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5\": rpc error: code = NotFound desc = could not find container \"32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5\": container with ID starting with 32d9c8e2359ac316797c7d1d12524843c5837703f09a90a67fff99b2b927b9e5 not found: ID does not exist"
Jul 15 18:57:28.102620 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.102599    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"]
Jul 15 18:57:28.106326 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:28.106307    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a0cde7-84c56f58c-9crcq"]
Jul 15 18:57:29.377267 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:29.377231    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e5b19cc-1bd1-4641-a620-78211e1927d7" path="/var/lib/kubelet/pods/3e5b19cc-1bd1-4641-a620-78211e1927d7/volumes"
Jul 15 18:57:30.992103 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:30.992068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:36.882854 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:36.882817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:36.983373 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:36.983338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:41.748699 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:41.748667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:41.988664 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:41.988632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:42.726649 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:42.726616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:42.826389 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:42.826355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:52.723256 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:52.723222    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"]
Jul 15 18:57:52.723799 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:52.723458    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44" podUID="72a38058-1a66-40fe-8721-75797bcbbf0d" containerName="maas-api" containerID="cri-o://4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe" gracePeriod=30
Jul 15 18:57:52.948929 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:52.948887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:57:52.979256 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:52.979200    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:53.078981 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.078950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a38058-1a66-40fe-8721-75797bcbbf0d-maas-api-tls\") pod \"72a38058-1a66-40fe-8721-75797bcbbf0d\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") "
Jul 15 18:57:53.078981 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.078984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a38058-1a66-40fe-8721-75797bcbbf0d-openshift-service-ca\") pod \"72a38058-1a66-40fe-8721-75797bcbbf0d\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") "
Jul 15 18:57:53.079175 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.079007    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff5hw\" (UniqueName: \"kubernetes.io/projected/72a38058-1a66-40fe-8721-75797bcbbf0d-kube-api-access-ff5hw\") pod \"72a38058-1a66-40fe-8721-75797bcbbf0d\" (UID: \"72a38058-1a66-40fe-8721-75797bcbbf0d\") "
Jul 15 18:57:53.079364 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.079338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a38058-1a66-40fe-8721-75797bcbbf0d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72a38058-1a66-40fe-8721-75797bcbbf0d" (UID: "72a38058-1a66-40fe-8721-75797bcbbf0d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:57:53.081075 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.081046    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72a38058-1a66-40fe-8721-75797bcbbf0d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72a38058-1a66-40fe-8721-75797bcbbf0d" (UID: "72a38058-1a66-40fe-8721-75797bcbbf0d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:57:53.081075 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.081054    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a38058-1a66-40fe-8721-75797bcbbf0d-kube-api-access-ff5hw" (OuterVolumeSpecName: "kube-api-access-ff5hw") pod "72a38058-1a66-40fe-8721-75797bcbbf0d" (UID: "72a38058-1a66-40fe-8721-75797bcbbf0d"). InnerVolumeSpecName "kube-api-access-ff5hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:57:53.180164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.180132    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a38058-1a66-40fe-8721-75797bcbbf0d-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:57:53.180164 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.180160    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a38058-1a66-40fe-8721-75797bcbbf0d-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:57:53.180338 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.180174    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff5hw\" (UniqueName: \"kubernetes.io/projected/72a38058-1a66-40fe-8721-75797bcbbf0d-kube-api-access-ff5hw\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:57:53.235584 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.235503    2563 generic.go:356] "Generic (PLEG): container finished" podID="72a38058-1a66-40fe-8721-75797bcbbf0d" containerID="4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe" exitCode=0
Jul 15 18:57:53.235584 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.235561    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"
Jul 15 18:57:53.235768 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.235592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44" event={"ID":"72a38058-1a66-40fe-8721-75797bcbbf0d","Type":"ContainerDied","Data":"4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe"}
Jul 15 18:57:53.235768 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.235649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44" event={"ID":"72a38058-1a66-40fe-8721-75797bcbbf0d","Type":"ContainerDied","Data":"80a35d834e62377b530e4ac4eb664a49897621b6fdfdd390594df4afdc3e5eea"}
Jul 15 18:57:53.235768 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.235672    2563 scope.go:117] "RemoveContainer" containerID="4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe"
Jul 15 18:57:53.245292 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.245272    2563 scope.go:117] "RemoveContainer" containerID="4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe"
Jul 15 18:57:53.245570 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:57:53.245550    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe\": container with ID starting with 4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe not found: ID does not exist" containerID="4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe"
Jul 15 18:57:53.245625 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.245580    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe"} err="failed to get container status \"4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe\": rpc error: code = NotFound desc = could not find container \"4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe\": container with ID starting with 4e2eda6b0bdff7f0f14b350f8ec3eae8216cb1d00e753d7c5a6715c6a3e51ebe not found: ID does not exist"
Jul 15 18:57:53.257866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.257846    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"]
Jul 15 18:57:53.263545 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.263524    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc683a-75754df89c-79m44"]
Jul 15 18:57:53.377024 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:53.376986    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a38058-1a66-40fe-8721-75797bcbbf0d" path="/var/lib/kubelet/pods/72a38058-1a66-40fe-8721-75797bcbbf0d/volumes"
Jul 15 18:57:57.253674 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:57:57.253638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:03.542677 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:03.542639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:03.641838 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:03.641802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:08.083183 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:08.083152    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"]
Jul 15 18:58:08.083635 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:08.083356    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy" containerID="cri-o://e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1" gracePeriod=30
Jul 15 18:58:08.126629 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:08.126587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:08.346460 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:08.346348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:08.754550 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:08.754466    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:09.134408 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:09.134369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:09.502553 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:09.502473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:10.378924 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:10.378887    2563 patch_prober.go:28] interesting pod/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 18:58:10.379309 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:10.378946    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:58:12.006412 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.006376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:12.093677 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.093642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:12.103825 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.103795    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"]
Jul 15 18:58:12.104211 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.104198    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5b19cc-1bd1-4641-a620-78211e1927d7" containerName="maas-api"
Jul 15 18:58:12.104255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.104212    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5b19cc-1bd1-4641-a620-78211e1927d7" containerName="maas-api"
Jul 15 18:58:12.104255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.104223    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a38058-1a66-40fe-8721-75797bcbbf0d" containerName="maas-api"
Jul 15 18:58:12.104255 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.104229    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a38058-1a66-40fe-8721-75797bcbbf0d" containerName="maas-api"
Jul 15 18:58:12.104351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.104284    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a38058-1a66-40fe-8721-75797bcbbf0d" containerName="maas-api"
Jul 15 18:58:12.104351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.104296    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5b19cc-1bd1-4641-a620-78211e1927d7" containerName="maas-api"
Jul 15 18:58:12.107414 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.107398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.110295 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.110276    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-401e9f-serving-cert\""
Jul 15 18:58:12.121786 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.121767    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"]
Jul 15 18:58:12.156287 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.156258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7764d\" (UniqueName: \"kubernetes.io/projected/419534a1-fd39-4f92-8331-f27791fc4d2d-kube-api-access-7764d\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.156516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.156334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.156516 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.156385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419534a1-fd39-4f92-8331-f27791fc4d2d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.257191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.257091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.257191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.257138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419534a1-fd39-4f92-8331-f27791fc4d2d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.257404 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.257239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7764d\" (UniqueName: \"kubernetes.io/projected/419534a1-fd39-4f92-8331-f27791fc4d2d-kube-api-access-7764d\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.257404 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:12.257270    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-serving-cert: secret "maas-api-e2e-shared-a-401e9f-serving-cert" not found
Jul 15 18:58:12.257404 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:12.257365    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls podName:419534a1-fd39-4f92-8331-f27791fc4d2d nodeName:}" failed. No retries permitted until 2026-07-15 18:58:12.757341737 +0000 UTC m=+2477.964605003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls") pod "maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc" (UID: "419534a1-fd39-4f92-8331-f27791fc4d2d") : secret "maas-api-e2e-shared-a-401e9f-serving-cert" not found
Jul 15 18:58:12.257963 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.257935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419534a1-fd39-4f92-8331-f27791fc4d2d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.272342 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.272317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7764d\" (UniqueName: \"kubernetes.io/projected/419534a1-fd39-4f92-8331-f27791fc4d2d-kube-api-access-7764d\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.308764 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.308738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:12.581351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.581316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:12.763019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.762986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.765596 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.765564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls\") pod \"maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:12.980908 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:12.980829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:13.017856 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.017826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:13.190533 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.190511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"]
Jul 15 18:58:13.191859 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:58:13.191819    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419534a1_fd39_4f92_8331_f27791fc4d2d.slice/crio-c2c1da1df8bc09cb2d5a6cc69657925c0ea6553bb74955a40832d2650408c953 WatchSource:0}: Error finding container c2c1da1df8bc09cb2d5a6cc69657925c0ea6553bb74955a40832d2650408c953: Status 404 returned error can't find the container with id c2c1da1df8bc09cb2d5a6cc69657925c0ea6553bb74955a40832d2650408c953
Jul 15 18:58:13.197946 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.197924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:13.340212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.340184    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:58:13.356243 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.356215    2563 generic.go:356] "Generic (PLEG): container finished" podID="daa82343-f79f-408e-9d17-7e8af59fc337" containerID="e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1" exitCode=0
Jul 15 18:58:13.356407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.356268    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"
Jul 15 18:58:13.356407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.356291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" event={"ID":"daa82343-f79f-408e-9d17-7e8af59fc337","Type":"ContainerDied","Data":"e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1"}
Jul 15 18:58:13.356407 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.356359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v" event={"ID":"daa82343-f79f-408e-9d17-7e8af59fc337","Type":"ContainerDied","Data":"0534649504ec5811b84a427674b058855d68fe34e165fd510c67de3ddc250ef6"}
Jul 15 18:58:13.356570 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.356396    2563 scope.go:117] "RemoveContainer" containerID="e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1"
Jul 15 18:58:13.357627 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.357605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc" event={"ID":"419534a1-fd39-4f92-8331-f27791fc4d2d","Type":"ContainerStarted","Data":"c2c1da1df8bc09cb2d5a6cc69657925c0ea6553bb74955a40832d2650408c953"}
Jul 15 18:58:13.365672 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.365500    2563 scope.go:117] "RemoveContainer" containerID="ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65"
Jul 15 18:58:13.376335 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.376315    2563 scope.go:117] "RemoveContainer" containerID="e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1"
Jul 15 18:58:13.376675 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:13.376649    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1\": container with ID starting with e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1 not found: ID does not exist" containerID="e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1"
Jul 15 18:58:13.376793 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.376685    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1"} err="failed to get container status \"e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1\": rpc error: code = NotFound desc = could not find container \"e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1\": container with ID starting with e2533e8a882ad3589ea03694fd4a5813cdde2ca252b678e20b261d4bf2d543a1 not found: ID does not exist"
Jul 15 18:58:13.376793 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.376702    2563 scope.go:117] "RemoveContainer" containerID="ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65"
Jul 15 18:58:13.376981 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:13.376961    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65\": container with ID starting with ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65 not found: ID does not exist" containerID="ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65"
Jul 15 18:58:13.377048 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.376983    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65"} err="failed to get container status \"ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65\": rpc error: code = NotFound desc = could not find container \"ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65\": container with ID starting with ff4a0b0c3e141655c51df2cef31445ab814c422ae3464367c361e599ad2c0f65 not found: ID does not exist"
Jul 15 18:58:13.469695 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469667    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-certs\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.469866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa82343-f79f-408e-9d17-7e8af59fc337-istiod-ca-cert\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.469866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469769    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7pjw\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-kube-api-access-c7pjw\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.469866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-credential-socket\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.469866 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469815    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-socket\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.470059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469878    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-envoy\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.470059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-data\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.470059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469955    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-istio-token\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.470059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.469981    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:58:13.470059 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470003    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa82343-f79f-408e-9d17-7e8af59fc337-istio-podinfo\") pod \"daa82343-f79f-408e-9d17-7e8af59fc337\" (UID: \"daa82343-f79f-408e-9d17-7e8af59fc337\") "
Jul 15 18:58:13.470309 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470112    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:58:13.470309 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470172    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:58:13.470309 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daa82343-f79f-408e-9d17-7e8af59fc337-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:58:13.470501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470373    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.470501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470394    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa82343-f79f-408e-9d17-7e8af59fc337-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.470501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470408    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.470501 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470439    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.470797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.470774    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-data" (OuterVolumeSpecName: "istio-data") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:58:13.472474 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.472441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-kube-api-access-c7pjw" (OuterVolumeSpecName: "kube-api-access-c7pjw") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "kube-api-access-c7pjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:58:13.472599 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.472527    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:58:13.472599 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.472577    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-istio-token" (OuterVolumeSpecName: "istio-token") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:58:13.472745 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.472729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/daa82343-f79f-408e-9d17-7e8af59fc337-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "daa82343-f79f-408e-9d17-7e8af59fc337" (UID: "daa82343-f79f-408e-9d17-7e8af59fc337"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:58:13.571402 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.571362    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7pjw\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-kube-api-access-c7pjw\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.571402 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.571395    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.571402 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.571406    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa82343-f79f-408e-9d17-7e8af59fc337-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.571679 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.571416    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa82343-f79f-408e-9d17-7e8af59fc337-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.571679 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.571448    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa82343-f79f-408e-9d17-7e8af59fc337-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 18:58:13.686846 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.686814    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"]
Jul 15 18:58:13.698346 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:13.698313    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-dc683a-openshift-default-5c4d8dbf5f-sng4v"]
Jul 15 18:58:14.366048 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:14.366013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc" event={"ID":"419534a1-fd39-4f92-8331-f27791fc4d2d","Type":"ContainerStarted","Data":"0d00dfa79286e9bfb51e66d1ac0a2a60dbb104bb08884c351a1d8e1ec4dfea00"}
Jul 15 18:58:14.372479 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:14.366654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:14.392810 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:14.392748    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc" podStartSLOduration=1.554886651 podStartE2EDuration="2.39273194s" totalImagesPullingTime="837.845289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:14.390712235 +0000 UTC m=+2479.597975519" watchObservedRunningTime="2026-07-15 18:58:14.39273194 +0000 UTC m=+2479.599995222"
Jul 15 18:58:15.377630 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:15.377600    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" path="/var/lib/kubelet/pods/daa82343-f79f-408e-9d17-7e8af59fc337/volumes"
Jul 15 18:58:16.518639 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:16.518610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:16.849257 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:16.849213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:17.164252 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.164176    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"]
Jul 15 18:58:17.164625 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.164603    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy"
Jul 15 18:58:17.164625 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.164622    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy"
Jul 15 18:58:17.164797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.164708    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy"
Jul 15 18:58:17.164797 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.164718    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy"
Jul 15 18:58:17.168049 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.168032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.171286 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.171268    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-46e17a-openshift-default-dockercfg-frvrh\""
Jul 15 18:58:17.188244 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.188228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"]
Jul 15 18:58:17.222477 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.222448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:17.297986 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.297939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:17.305363 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-credential-socket\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305465 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrmhn\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-kube-api-access-xrmhn\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305465 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-certs\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305544 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istiod-ca-cert\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305544 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-envoy\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305610 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-data\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305610 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-podinfo\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305682 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-token\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.305682 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.305647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-socket\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406685 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-credential-socket\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406685 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrmhn\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-kube-api-access-xrmhn\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-certs\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istiod-ca-cert\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-envoy\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-data\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-podinfo\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-token\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.406933 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.406909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-socket\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.407307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.407082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-credential-socket\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.407307 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.407296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-certs\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.407399 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.407337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-socket\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.407399 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.407390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-data\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.407628 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.407604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istiod-ca-cert\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.409225 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.409201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-envoy\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.409377 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.409357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-podinfo\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.415646 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.415591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-token\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.415796 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.415779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrmhn\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-kube-api-access-xrmhn\") pod \"e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") " pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.480378 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.480349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:17.640671 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.640646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"]
Jul 15 18:58:17.642410 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:58:17.642384    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20e99ac_ddd9_40e6_b858_f47ab62c4d40.slice/crio-8d6f41a9489e719814aa121ad55ae30c11ba8782a15153ef4e6b70c76640a00c WatchSource:0}: Error finding container 8d6f41a9489e719814aa121ad55ae30c11ba8782a15153ef4e6b70c76640a00c: Status 404 returned error can't find the container with id 8d6f41a9489e719814aa121ad55ae30c11ba8782a15153ef4e6b70c76640a00c
Jul 15 18:58:17.645224 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.645189    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:58:17.645305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.645259    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:58:17.645305 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:17.645295    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:58:18.390937 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:18.390900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" event={"ID":"d20e99ac-ddd9-40e6-b858-f47ab62c4d40","Type":"ContainerStarted","Data":"e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075"}
Jul 15 18:58:18.391118 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:18.390961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" event={"ID":"d20e99ac-ddd9-40e6-b858-f47ab62c4d40","Type":"ContainerStarted","Data":"8d6f41a9489e719814aa121ad55ae30c11ba8782a15153ef4e6b70c76640a00c"}
Jul 15 18:58:18.413373 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:18.413325    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" podStartSLOduration=1.413310958 podStartE2EDuration="1.413310958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:18.412234219 +0000 UTC m=+2483.619497514" watchObservedRunningTime="2026-07-15 18:58:18.413310958 +0000 UTC m=+2483.620574241"
Jul 15 18:58:18.481243 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:18.481208    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:18.486717 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:18.486692    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:19.396648 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:19.396614    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:19.397792 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:19.397764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:20.378598 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.378568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 18:58:20.556850 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.556813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:20.651629 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.651552    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"]
Jul 15 18:58:20.652191 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.652169    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy"
Jul 15 18:58:20.652273 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.652194    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa82343-f79f-408e-9d17-7e8af59fc337" containerName="istio-proxy"
Jul 15 18:58:20.656238 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.656215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.661231 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.661210    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-46e17a-serving-cert\""
Jul 15 18:58:20.667858 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.667831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:20.675019 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.674997    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"]
Jul 15 18:58:20.737578 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.737545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.737770 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.737609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.737770 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.737697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9h8m\" (UniqueName: \"kubernetes.io/projected/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-kube-api-access-x9h8m\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.781212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.781173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:20.839212 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.839181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9h8m\" (UniqueName: \"kubernetes.io/projected/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-kube-api-access-x9h8m\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.839405 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.839263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.839405 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:20.839359    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-serving-cert: secret "maas-api-e2e-shared-b-46e17a-serving-cert" not found
Jul 15 18:58:20.839565 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:20.839413    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls podName:c4f994a4-b5f7-4541-8f0c-921fe69fa8ca nodeName:}" failed. No retries permitted until 2026-07-15 18:58:21.339393398 +0000 UTC m=+2486.546656679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls") pod "maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" (UID: "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca") : secret "maas-api-e2e-shared-b-46e17a-serving-cert" not found
Jul 15 18:58:20.839565 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.839461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.840070 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.840052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:20.855327 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:20.855297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9h8m\" (UniqueName: \"kubernetes.io/projected/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-kube-api-access-x9h8m\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:21.345181 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:21.345151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:21.345353 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:21.345281    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-serving-cert: secret "maas-api-e2e-shared-b-46e17a-serving-cert" not found
Jul 15 18:58:21.345353 ip-10-0-135-84 kubenswrapper[2563]: E0715 18:58:21.345332    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls podName:c4f994a4-b5f7-4541-8f0c-921fe69fa8ca nodeName:}" failed. No retries permitted until 2026-07-15 18:58:22.345319294 +0000 UTC m=+2487.552582555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls") pod "maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" (UID: "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca") : secret "maas-api-e2e-shared-b-46e17a-serving-cert" not found
Jul 15 18:58:21.378745 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:21.378705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:21.477923 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:21.477893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:21.577705 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:21.577673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:22.354781 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:22.354746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:22.357134 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:22.357117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:22.468132 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:22.468102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:22.607123 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:22.607101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"]
Jul 15 18:58:22.609345 ip-10-0-135-84 kubenswrapper[2563]: W0715 18:58:22.609320    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f994a4_b5f7_4541_8f0c_921fe69fa8ca.slice/crio-ef8f3068e4cda7fa0d53baaf27c2e720e899f5b61ff096604feb581b469cf579 WatchSource:0}: Error finding container ef8f3068e4cda7fa0d53baaf27c2e720e899f5b61ff096604feb581b469cf579: Status 404 returned error can't find the container with id ef8f3068e4cda7fa0d53baaf27c2e720e899f5b61ff096604feb581b469cf579
Jul 15 18:58:23.421563 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:23.421525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" event={"ID":"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca","Type":"ContainerStarted","Data":"21466ffdd5b2744bffb432b42c686f0a22e42e862d5f3dd90ebfb319fe8cc9c2"}
Jul 15 18:58:23.421733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:23.421579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" event={"ID":"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca","Type":"ContainerStarted","Data":"ef8f3068e4cda7fa0d53baaf27c2e720e899f5b61ff096604feb581b469cf579"}
Jul 15 18:58:23.421733 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:23.421636    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:25.159870 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:25.159829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:29.435247 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:29.435211    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 18:58:29.455896 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:29.455824    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" podStartSLOduration=8.82628646 podStartE2EDuration="9.455800409s" totalImagesPullingTime="629.513949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:23.459200871 +0000 UTC m=+2488.666464153" watchObservedRunningTime="2026-07-15 18:58:29.455800409 +0000 UTC m=+2494.663063778"
Jul 15 18:58:32.487545 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:32.487513    2563 generic.go:356] "Generic (PLEG): container finished" podID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerID="e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075" exitCode=0
Jul 15 18:58:32.487966 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:32.487589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" event={"ID":"d20e99ac-ddd9-40e6-b858-f47ab62c4d40","Type":"ContainerDied","Data":"e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075"}
Jul 15 18:58:32.488038 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:32.488023    2563 scope.go:117] "RemoveContainer" containerID="e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075"
Jul 15 18:58:32.489010 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:32.488982    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:58:32.489116 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:32.489048    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:58:32.489116 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:32.489078    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 18:58:33.495876 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:33.495839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" event={"ID":"d20e99ac-ddd9-40e6-b858-f47ab62c4d40","Type":"ContainerStarted","Data":"f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409"}
Jul 15 18:58:34.397147 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:34.397112    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:34.481321 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:34.481285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:34.482299 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:34.482276    2563 patch_prober.go:28] interesting pod/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 15 18:58:34.482398 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:34.482325    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 15 18:58:34.519248 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:34.519219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:34.797351 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:34.797267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:35.481489 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:35.481451    2563 patch_prober.go:28] interesting pod/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 15 18:58:35.481675 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:35.481511    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 15 18:58:36.481327 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:36.481289    2563 patch_prober.go:28] interesting pod/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 15 18:58:36.481761 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:36.481380    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 15 18:58:37.480982 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:37.480941    2563 patch_prober.go:28] interesting pod/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 15 18:58:37.481157 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:37.481006    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 15 18:58:38.485486 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:38.485454    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:38.486443 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:38.486410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 18:58:42.030312 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:42.030285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:42.337291 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:42.337256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:58:42.847145 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:58:42.847112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:59:05.040670 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:59:05.040619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 18:59:59.741947 ip-10-0-135-84 kubenswrapper[2563]: I0715 18:59:59.741905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:00:00.149295 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:00.149258    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd"]
Jul 15 19:00:00.153178 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:00.153157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd"
Jul 15 19:00:00.158124 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:00.158102    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d2zdm\""
Jul 15 19:00:00.164694 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:00.164670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd"
Jul 15 19:00:00.168467 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:00.168413    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd"]
Jul 15 19:00:00.304160 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:00.304136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd"]
Jul 15 19:00:01.013927 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:01.013892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd" event={"ID":"d6abf53f-25d7-44ad-ac12-78dfe1f9d846","Type":"ContainerStarted","Data":"7fe13dbeff2160ef0805aee695c711c31e0b6cb60db74795d0d5ce6a709d4d96"}
Jul 15 19:00:01.014335 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:01.013948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd" event={"ID":"d6abf53f-25d7-44ad-ac12-78dfe1f9d846","Type":"ContainerStarted","Data":"99fe5706a6a517b7d1a4f8a27487843905a42c1216379d4511e789313e86e06b"}
Jul 15 19:00:01.033216 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:01.033167    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd" podStartSLOduration=1.033150434 podStartE2EDuration="1.033150434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:00:01.031798925 +0000 UTC m=+2586.239062211" watchObservedRunningTime="2026-07-15 19:00:01.033150434 +0000 UTC m=+2586.240413716"
Jul 15 19:00:01.268750 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:01.268664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:00:02.021253 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:02.021222    2563 generic.go:356] "Generic (PLEG): container finished" podID="d6abf53f-25d7-44ad-ac12-78dfe1f9d846" containerID="7fe13dbeff2160ef0805aee695c711c31e0b6cb60db74795d0d5ce6a709d4d96" exitCode=0
Jul 15 19:00:02.021657 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:02.021311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd" event={"ID":"d6abf53f-25d7-44ad-ac12-78dfe1f9d846","Type":"ContainerDied","Data":"7fe13dbeff2160ef0805aee695c711c31e0b6cb60db74795d0d5ce6a709d4d96"}
Jul 15 19:00:03.163167 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:03.163142    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd"
Jul 15 19:00:04.034203 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:04.034166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd" event={"ID":"d6abf53f-25d7-44ad-ac12-78dfe1f9d846","Type":"ContainerDied","Data":"99fe5706a6a517b7d1a4f8a27487843905a42c1216379d4511e789313e86e06b"}
Jul 15 19:00:04.034203 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:04.034186    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735700-ntldd"
Jul 15 19:00:04.034488 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:00:04.034240    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99fe5706a6a517b7d1a4f8a27487843905a42c1216379d4511e789313e86e06b"
Jul 15 19:01:06.588216 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:06.588180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:01:07.686969 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:07.686938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:01:14.536561 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:14.536527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:01:28.243006 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:28.242962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:01:28.340438 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:28.340394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:01:49.444219 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:49.444185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:01:55.525921 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:55.525895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 19:01:55.544557 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:55.544536    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcsfh_a6259e05-38dd-498e-8b71-5c65d5ce02ed/ovn-acl-logging/0.log"
Jul 15 19:01:57.029657 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:01:57.029626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:02:11.171894 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:02:11.171861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:02:12.463438 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:02:12.463403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:02:31.001165 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:02:31.001134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:02:35.027258 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:02:35.027221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:02:35.885062 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:02:35.885035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:02:54.423408 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:02:54.423375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:03:35.068464 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:03:35.068409    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:03:35.170606 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:03:35.170575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:03:39.731762 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:03:39.731728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:03:43.124287 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:03:43.124255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:03:43.227144 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:03:43.227114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:04:23.555212 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:23.555178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:04:24.331177 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:24.331147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:04:25.314438 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.314386    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7130-140263871136944"]
Jul 15 19:04:25.314823 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.314787    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6abf53f-25d7-44ad-ac12-78dfe1f9d846" containerName="cleanup"
Jul 15 19:04:25.314823 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.314799    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6abf53f-25d7-44ad-ac12-78dfe1f9d846" containerName="cleanup"
Jul 15 19:04:25.314907 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.314872    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6abf53f-25d7-44ad-ac12-78dfe1f9d846" containerName="cleanup"
Jul 15 19:04:25.318029 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.318013    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871136944"
Jul 15 19:04:25.320897 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.320874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-trk8x\""
Jul 15 19:04:25.325026 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.324696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871136944"]
Jul 15 19:04:25.449138 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.449112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2bh\" (UniqueName: \"kubernetes.io/projected/674f6473-8eba-430b-9c7d-9441e9afba00-kube-api-access-kq2bh\") pod \"test-curl-7130-140263871136944\" (UID: \"674f6473-8eba-430b-9c7d-9441e9afba00\") " pod="opendatahub/test-curl-7130-140263871136944"
Jul 15 19:04:25.550165 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.550141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2bh\" (UniqueName: \"kubernetes.io/projected/674f6473-8eba-430b-9c7d-9441e9afba00-kube-api-access-kq2bh\") pod \"test-curl-7130-140263871136944\" (UID: \"674f6473-8eba-430b-9c7d-9441e9afba00\") " pod="opendatahub/test-curl-7130-140263871136944"
Jul 15 19:04:25.559372 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.559345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2bh\" (UniqueName: \"kubernetes.io/projected/674f6473-8eba-430b-9c7d-9441e9afba00-kube-api-access-kq2bh\") pod \"test-curl-7130-140263871136944\" (UID: \"674f6473-8eba-430b-9c7d-9441e9afba00\") " pod="opendatahub/test-curl-7130-140263871136944"
Jul 15 19:04:25.628510 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.628458    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871136944"
Jul 15 19:04:25.761754 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.761716    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871136944"]
Jul 15 19:04:25.763480 ip-10-0-135-84 kubenswrapper[2563]: W0715 19:04:25.763449    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod674f6473_8eba_430b_9c7d_9441e9afba00.slice/crio-34aae4740fef7d301969ab3aff114e742faa68cb0bb649a7fbfcaaeb376543b9 WatchSource:0}: Error finding container 34aae4740fef7d301969ab3aff114e742faa68cb0bb649a7fbfcaaeb376543b9: Status 404 returned error can't find the container with id 34aae4740fef7d301969ab3aff114e742faa68cb0bb649a7fbfcaaeb376543b9
Jul 15 19:04:25.765353 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:25.765329    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:04:26.555863 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:26.555838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871136944" event={"ID":"674f6473-8eba-430b-9c7d-9441e9afba00","Type":"ContainerStarted","Data":"fd4b6dff040341afccf907cfe238de1627a240c8c056059d31088817f36fd834"}
Jul 15 19:04:26.556140 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:26.555877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871136944" event={"ID":"674f6473-8eba-430b-9c7d-9441e9afba00","Type":"ContainerStarted","Data":"34aae4740fef7d301969ab3aff114e742faa68cb0bb649a7fbfcaaeb376543b9"}
Jul 15 19:04:26.571091 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:26.571041    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7130-140263871136944" podStartSLOduration=0.861553057 podStartE2EDuration="1.571021566s" totalImagesPullingTime="709.468509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:04:26.57066276 +0000 UTC m=+2851.777926043" watchObservedRunningTime="2026-07-15 19:04:26.571021566 +0000 UTC m=+2851.778284849"
Jul 15 19:04:26.672863 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:26.672842    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7130-140263871136944_674f6473-8eba-430b-9c7d-9441e9afba00/test-curl-7130-140263871136944/0.log"
Jul 15 19:04:27.562673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:27.562639    2563 generic.go:356] "Generic (PLEG): container finished" podID="674f6473-8eba-430b-9c7d-9441e9afba00" containerID="fd4b6dff040341afccf907cfe238de1627a240c8c056059d31088817f36fd834" exitCode=0
Jul 15 19:04:27.563039 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:27.562676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871136944" event={"ID":"674f6473-8eba-430b-9c7d-9441e9afba00","Type":"ContainerDied","Data":"fd4b6dff040341afccf907cfe238de1627a240c8c056059d31088817f36fd834"}
Jul 15 19:04:28.705091 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.705069    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871136944"
Jul 15 19:04:28.750700 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.750674    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7130-140263871136944"]
Jul 15 19:04:28.761034 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.761012    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7130-140263871136944"]
Jul 15 19:04:28.774892 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.774871    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq2bh\" (UniqueName: \"kubernetes.io/projected/674f6473-8eba-430b-9c7d-9441e9afba00-kube-api-access-kq2bh\") pod \"674f6473-8eba-430b-9c7d-9441e9afba00\" (UID: \"674f6473-8eba-430b-9c7d-9441e9afba00\") "
Jul 15 19:04:28.776799 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.776778    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674f6473-8eba-430b-9c7d-9441e9afba00-kube-api-access-kq2bh" (OuterVolumeSpecName: "kube-api-access-kq2bh") pod "674f6473-8eba-430b-9c7d-9441e9afba00" (UID: "674f6473-8eba-430b-9c7d-9441e9afba00"). InnerVolumeSpecName "kube-api-access-kq2bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:28.876355 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.876306    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq2bh\" (UniqueName: \"kubernetes.io/projected/674f6473-8eba-430b-9c7d-9441e9afba00-kube-api-access-kq2bh\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:28.896914 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.896891    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7130-140263871139632"]
Jul 15 19:04:28.897269 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.897256    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674f6473-8eba-430b-9c7d-9441e9afba00" containerName="test-curl-7130-140263871136944"
Jul 15 19:04:28.897315 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.897270    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="674f6473-8eba-430b-9c7d-9441e9afba00" containerName="test-curl-7130-140263871136944"
Jul 15 19:04:28.897351 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.897342    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="674f6473-8eba-430b-9c7d-9441e9afba00" containerName="test-curl-7130-140263871136944"
Jul 15 19:04:28.900272 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.900258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:28.905989 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.905965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871139632"]
Jul 15 19:04:28.976911 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:28.976886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mv8m\" (UniqueName: \"kubernetes.io/projected/27cdf7d8-ab90-48d4-98c9-a04d198396c1-kube-api-access-8mv8m\") pod \"test-curl-7130-140263871139632\" (UID: \"27cdf7d8-ab90-48d4-98c9-a04d198396c1\") " pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:29.077736 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.077711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mv8m\" (UniqueName: \"kubernetes.io/projected/27cdf7d8-ab90-48d4-98c9-a04d198396c1-kube-api-access-8mv8m\") pod \"test-curl-7130-140263871139632\" (UID: \"27cdf7d8-ab90-48d4-98c9-a04d198396c1\") " pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:29.086177 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.086156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mv8m\" (UniqueName: \"kubernetes.io/projected/27cdf7d8-ab90-48d4-98c9-a04d198396c1-kube-api-access-8mv8m\") pod \"test-curl-7130-140263871139632\" (UID: \"27cdf7d8-ab90-48d4-98c9-a04d198396c1\") " pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:29.210671 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.210617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:29.377083 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.377051    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674f6473-8eba-430b-9c7d-9441e9afba00" path="/var/lib/kubelet/pods/674f6473-8eba-430b-9c7d-9441e9afba00/volumes"
Jul 15 19:04:29.551565 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.551540    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871139632"]
Jul 15 19:04:29.552094 ip-10-0-135-84 kubenswrapper[2563]: W0715 19:04:29.552073    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27cdf7d8_ab90_48d4_98c9_a04d198396c1.slice/crio-beff523c151670cf38da17cca7d6a9637c198d5562763202f9940def6abe562d WatchSource:0}: Error finding container beff523c151670cf38da17cca7d6a9637c198d5562763202f9940def6abe562d: Status 404 returned error can't find the container with id beff523c151670cf38da17cca7d6a9637c198d5562763202f9940def6abe562d
Jul 15 19:04:29.576410 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.576387    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871136944"
Jul 15 19:04:29.576559 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.576459    2563 scope.go:117] "RemoveContainer" containerID="fd4b6dff040341afccf907cfe238de1627a240c8c056059d31088817f36fd834"
Jul 15 19:04:29.577737 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:29.577716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871139632" event={"ID":"27cdf7d8-ab90-48d4-98c9-a04d198396c1","Type":"ContainerStarted","Data":"beff523c151670cf38da17cca7d6a9637c198d5562763202f9940def6abe562d"}
Jul 15 19:04:30.585825 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:30.585789    2563 generic.go:356] "Generic (PLEG): container finished" podID="27cdf7d8-ab90-48d4-98c9-a04d198396c1" containerID="c01d257d5d204d45f75d5b2dc424d151eaf31b6cc11ff390bebfdbd1cba01bc6" exitCode=0
Jul 15 19:04:30.586234 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:30.585875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871139632" event={"ID":"27cdf7d8-ab90-48d4-98c9-a04d198396c1","Type":"ContainerDied","Data":"c01d257d5d204d45f75d5b2dc424d151eaf31b6cc11ff390bebfdbd1cba01bc6"}
Jul 15 19:04:31.732854 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.732832    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:31.758924 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.758905    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7130-140263871139632_27cdf7d8-ab90-48d4-98c9-a04d198396c1/test-curl-7130-140263871139632/0.log"
Jul 15 19:04:31.782543 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.782516    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7130-140263871139632"]
Jul 15 19:04:31.784904 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.784885    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7130-140263871139632"]
Jul 15 19:04:31.801465 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.801448    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mv8m\" (UniqueName: \"kubernetes.io/projected/27cdf7d8-ab90-48d4-98c9-a04d198396c1-kube-api-access-8mv8m\") pod \"27cdf7d8-ab90-48d4-98c9-a04d198396c1\" (UID: \"27cdf7d8-ab90-48d4-98c9-a04d198396c1\") "
Jul 15 19:04:31.803394 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.803365    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27cdf7d8-ab90-48d4-98c9-a04d198396c1-kube-api-access-8mv8m" (OuterVolumeSpecName: "kube-api-access-8mv8m") pod "27cdf7d8-ab90-48d4-98c9-a04d198396c1" (UID: "27cdf7d8-ab90-48d4-98c9-a04d198396c1"). InnerVolumeSpecName "kube-api-access-8mv8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:31.902785 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.902725    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mv8m\" (UniqueName: \"kubernetes.io/projected/27cdf7d8-ab90-48d4-98c9-a04d198396c1-kube-api-access-8mv8m\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:31.940813 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.940794    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:31.941184 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.941171    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27cdf7d8-ab90-48d4-98c9-a04d198396c1" containerName="test-curl-7130-140263871139632"
Jul 15 19:04:31.941226 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.941185    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27cdf7d8-ab90-48d4-98c9-a04d198396c1" containerName="test-curl-7130-140263871139632"
Jul 15 19:04:31.941271 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.941263    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="27cdf7d8-ab90-48d4-98c9-a04d198396c1" containerName="test-curl-7130-140263871139632"
Jul 15 19:04:31.944291 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.944276    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:31.951845 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:31.951813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:32.104235 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.104213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9sqp\" (UniqueName: \"kubernetes.io/projected/2ce060d3-b19f-4ec8-bff7-0ddcda191700-kube-api-access-q9sqp\") pod \"test-curl-7130-140263871200256\" (UID: \"2ce060d3-b19f-4ec8-bff7-0ddcda191700\") " pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:32.204975 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.204919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9sqp\" (UniqueName: \"kubernetes.io/projected/2ce060d3-b19f-4ec8-bff7-0ddcda191700-kube-api-access-q9sqp\") pod \"test-curl-7130-140263871200256\" (UID: \"2ce060d3-b19f-4ec8-bff7-0ddcda191700\") " pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:32.214577 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.214558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9sqp\" (UniqueName: \"kubernetes.io/projected/2ce060d3-b19f-4ec8-bff7-0ddcda191700-kube-api-access-q9sqp\") pod \"test-curl-7130-140263871200256\" (UID: \"2ce060d3-b19f-4ec8-bff7-0ddcda191700\") " pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:32.255132 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.255113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:32.390257 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.390233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:32.391742 ip-10-0-135-84 kubenswrapper[2563]: W0715 19:04:32.391716    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ce060d3_b19f_4ec8_bff7_0ddcda191700.slice/crio-8d4c0b5bbba1809e3c8e6c26f4071885752f63c021f75d34dca46c3ff8ad2d48 WatchSource:0}: Error finding container 8d4c0b5bbba1809e3c8e6c26f4071885752f63c021f75d34dca46c3ff8ad2d48: Status 404 returned error can't find the container with id 8d4c0b5bbba1809e3c8e6c26f4071885752f63c021f75d34dca46c3ff8ad2d48
Jul 15 19:04:32.600620 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.600596    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beff523c151670cf38da17cca7d6a9637c198d5562763202f9940def6abe562d"
Jul 15 19:04:32.600620 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.600601    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:32.601791 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:32.601767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871200256" event={"ID":"2ce060d3-b19f-4ec8-bff7-0ddcda191700","Type":"ContainerStarted","Data":"8d4c0b5bbba1809e3c8e6c26f4071885752f63c021f75d34dca46c3ff8ad2d48"}
Jul 15 19:04:32.611055 ip-10-0-135-84 kubenswrapper[2563]: E0715 19:04:32.611032    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7130-140263871139632\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="27cdf7d8-ab90-48d4-98c9-a04d198396c1" pod="opendatahub/test-curl-7130-140263871139632"
Jul 15 19:04:33.377251 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:33.377221    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27cdf7d8-ab90-48d4-98c9-a04d198396c1" path="/var/lib/kubelet/pods/27cdf7d8-ab90-48d4-98c9-a04d198396c1/volumes"
Jul 15 19:04:33.609803 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:33.609774    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ce060d3-b19f-4ec8-bff7-0ddcda191700" containerID="eadd13898552f5c3b0c5d6aecbe24d119397f224386e1a2269d85fe7f35581c6" exitCode=0
Jul 15 19:04:33.609939 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:33.609852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871200256" event={"ID":"2ce060d3-b19f-4ec8-bff7-0ddcda191700","Type":"ContainerDied","Data":"eadd13898552f5c3b0c5d6aecbe24d119397f224386e1a2269d85fe7f35581c6"}
Jul 15 19:04:34.751912 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.751893    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:34.777284 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.777261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7130-140263871200256_2ce060d3-b19f-4ec8-bff7-0ddcda191700/test-curl-7130-140263871200256/0.log"
Jul 15 19:04:34.801484 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.801456    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:34.805520 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.805498    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:34.824411 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.824386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9sqp\" (UniqueName: \"kubernetes.io/projected/2ce060d3-b19f-4ec8-bff7-0ddcda191700-kube-api-access-q9sqp\") pod \"2ce060d3-b19f-4ec8-bff7-0ddcda191700\" (UID: \"2ce060d3-b19f-4ec8-bff7-0ddcda191700\") "
Jul 15 19:04:34.826437 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.826390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ce060d3-b19f-4ec8-bff7-0ddcda191700-kube-api-access-q9sqp" (OuterVolumeSpecName: "kube-api-access-q9sqp") pod "2ce060d3-b19f-4ec8-bff7-0ddcda191700" (UID: "2ce060d3-b19f-4ec8-bff7-0ddcda191700"). InnerVolumeSpecName "kube-api-access-q9sqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:34.925950 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.925892    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9sqp\" (UniqueName: \"kubernetes.io/projected/2ce060d3-b19f-4ec8-bff7-0ddcda191700-kube-api-access-q9sqp\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:34.936617 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.936596    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:34.936982 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.936971    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce060d3-b19f-4ec8-bff7-0ddcda191700" containerName="test-curl-7130-140263871200256"
Jul 15 19:04:34.937024 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.936983    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce060d3-b19f-4ec8-bff7-0ddcda191700" containerName="test-curl-7130-140263871200256"
Jul 15 19:04:34.937066 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.937053    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ce060d3-b19f-4ec8-bff7-0ddcda191700" containerName="test-curl-7130-140263871200256"
Jul 15 19:04:34.940068 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.940054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:34.946828 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:34.946808    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:35.026229 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.026198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b6lk\" (UniqueName: \"kubernetes.io/projected/ea530a6a-08e6-4496-974c-184e9037949d-kube-api-access-9b6lk\") pod \"test-curl-7130-140263871200256\" (UID: \"ea530a6a-08e6-4496-974c-184e9037949d\") " pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:35.127121 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.127099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b6lk\" (UniqueName: \"kubernetes.io/projected/ea530a6a-08e6-4496-974c-184e9037949d-kube-api-access-9b6lk\") pod \"test-curl-7130-140263871200256\" (UID: \"ea530a6a-08e6-4496-974c-184e9037949d\") " pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:35.136173 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.136150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b6lk\" (UniqueName: \"kubernetes.io/projected/ea530a6a-08e6-4496-974c-184e9037949d-kube-api-access-9b6lk\") pod \"test-curl-7130-140263871200256\" (UID: \"ea530a6a-08e6-4496-974c-184e9037949d\") " pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:35.249406 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.249351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:35.379775 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.379743    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ce060d3-b19f-4ec8-bff7-0ddcda191700" path="/var/lib/kubelet/pods/2ce060d3-b19f-4ec8-bff7-0ddcda191700/volumes"
Jul 15 19:04:35.382197 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.382176    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:35.383257 ip-10-0-135-84 kubenswrapper[2563]: W0715 19:04:35.383238    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea530a6a_08e6_4496_974c_184e9037949d.slice/crio-18d24027b7b05542ba01cd6ca246e7a9162db0df6e88bf964fdc33fd262caaa3 WatchSource:0}: Error finding container 18d24027b7b05542ba01cd6ca246e7a9162db0df6e88bf964fdc33fd262caaa3: Status 404 returned error can't find the container with id 18d24027b7b05542ba01cd6ca246e7a9162db0df6e88bf964fdc33fd262caaa3
Jul 15 19:04:35.621997 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.621972    2563 scope.go:117] "RemoveContainer" containerID="eadd13898552f5c3b0c5d6aecbe24d119397f224386e1a2269d85fe7f35581c6"
Jul 15 19:04:35.622112 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.621966    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:35.623319 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:35.623226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871200256" event={"ID":"ea530a6a-08e6-4496-974c-184e9037949d","Type":"ContainerStarted","Data":"18d24027b7b05542ba01cd6ca246e7a9162db0df6e88bf964fdc33fd262caaa3"}
Jul 15 19:04:36.632254 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:36.632221    2563 generic.go:356] "Generic (PLEG): container finished" podID="ea530a6a-08e6-4496-974c-184e9037949d" containerID="4917731c819e2d8ddf69ee096f0f3fe568a1707c168591f840da95825ae7db69" exitCode=0
Jul 15 19:04:36.632254 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:36.632256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871200256" event={"ID":"ea530a6a-08e6-4496-974c-184e9037949d","Type":"ContainerDied","Data":"4917731c819e2d8ddf69ee096f0f3fe568a1707c168591f840da95825ae7db69"}
Jul 15 19:04:37.777135 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.777111    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:37.800081 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.800057    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7130-140263871200256_ea530a6a-08e6-4496-974c-184e9037949d/test-curl-7130-140263871200256/0.log"
Jul 15 19:04:37.827049 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.827026    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:37.830810 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.830789    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7130-140263871200256"]
Jul 15 19:04:37.948666 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.948611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b6lk\" (UniqueName: \"kubernetes.io/projected/ea530a6a-08e6-4496-974c-184e9037949d-kube-api-access-9b6lk\") pod \"ea530a6a-08e6-4496-974c-184e9037949d\" (UID: \"ea530a6a-08e6-4496-974c-184e9037949d\") "
Jul 15 19:04:37.950615 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.950590    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea530a6a-08e6-4496-974c-184e9037949d-kube-api-access-9b6lk" (OuterVolumeSpecName: "kube-api-access-9b6lk") pod "ea530a6a-08e6-4496-974c-184e9037949d" (UID: "ea530a6a-08e6-4496-974c-184e9037949d"). InnerVolumeSpecName "kube-api-access-9b6lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:37.958024 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.957982    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:37.958652 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.958626    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea530a6a-08e6-4496-974c-184e9037949d" containerName="test-curl-7130-140263871200256"
Jul 15 19:04:37.958652 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.958651    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea530a6a-08e6-4496-974c-184e9037949d" containerName="test-curl-7130-140263871200256"
Jul 15 19:04:37.958795 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.958767    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea530a6a-08e6-4496-974c-184e9037949d" containerName="test-curl-7130-140263871200256"
Jul 15 19:04:37.961943 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.961929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:37.967847 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:37.967826    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:38.049478 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.049456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l682s\" (UniqueName: \"kubernetes.io/projected/c83fde0c-5128-4e35-bb60-30803fe7e89f-kube-api-access-l682s\") pod \"test-curl-7130-140263871201120\" (UID: \"c83fde0c-5128-4e35-bb60-30803fe7e89f\") " pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:38.049589 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.049531    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b6lk\" (UniqueName: \"kubernetes.io/projected/ea530a6a-08e6-4496-974c-184e9037949d-kube-api-access-9b6lk\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:38.150599 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.150568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l682s\" (UniqueName: \"kubernetes.io/projected/c83fde0c-5128-4e35-bb60-30803fe7e89f-kube-api-access-l682s\") pod \"test-curl-7130-140263871201120\" (UID: \"c83fde0c-5128-4e35-bb60-30803fe7e89f\") " pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:38.158687 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.158668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l682s\" (UniqueName: \"kubernetes.io/projected/c83fde0c-5128-4e35-bb60-30803fe7e89f-kube-api-access-l682s\") pod \"test-curl-7130-140263871201120\" (UID: \"c83fde0c-5128-4e35-bb60-30803fe7e89f\") " pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:38.272917 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.272859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:38.403199 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.403180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:38.405404 ip-10-0-135-84 kubenswrapper[2563]: W0715 19:04:38.405371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc83fde0c_5128_4e35_bb60_30803fe7e89f.slice/crio-7cb7ee773d588e4bb51359ffd79bf827e7bb984186b2605ea3b779118497b663 WatchSource:0}: Error finding container 7cb7ee773d588e4bb51359ffd79bf827e7bb984186b2605ea3b779118497b663: Status 404 returned error can't find the container with id 7cb7ee773d588e4bb51359ffd79bf827e7bb984186b2605ea3b779118497b663
Jul 15 19:04:38.646298 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.646267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871201120" event={"ID":"c83fde0c-5128-4e35-bb60-30803fe7e89f","Type":"ContainerStarted","Data":"7cb7ee773d588e4bb51359ffd79bf827e7bb984186b2605ea3b779118497b663"}
Jul 15 19:04:38.647471 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.647450    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18d24027b7b05542ba01cd6ca246e7a9162db0df6e88bf964fdc33fd262caaa3"
Jul 15 19:04:38.647540 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:38.647489    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:38.657660 ip-10-0-135-84 kubenswrapper[2563]: E0715 19:04:38.657633    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7130-140263871200256\" is forbidden: User \"system:node:ip-10-0-135-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-84.ec2.internal' and this object" podUID="ea530a6a-08e6-4496-974c-184e9037949d" pod="opendatahub/test-curl-7130-140263871200256"
Jul 15 19:04:39.377445 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:39.377402    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea530a6a-08e6-4496-974c-184e9037949d" path="/var/lib/kubelet/pods/ea530a6a-08e6-4496-974c-184e9037949d/volumes"
Jul 15 19:04:39.655335 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:39.655252    2563 generic.go:356] "Generic (PLEG): container finished" podID="c83fde0c-5128-4e35-bb60-30803fe7e89f" containerID="73dae2ceda737d64caddb31b5801add7e44266c6767e5731aa1318b910467e35" exitCode=0
Jul 15 19:04:39.655335 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:39.655309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871201120" event={"ID":"c83fde0c-5128-4e35-bb60-30803fe7e89f","Type":"ContainerDied","Data":"73dae2ceda737d64caddb31b5801add7e44266c6767e5731aa1318b910467e35"}
Jul 15 19:04:40.796298 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:40.796276    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:40.820765 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:40.820714    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7130-140263871201120_c83fde0c-5128-4e35-bb60-30803fe7e89f/test-curl-7130-140263871201120/0.log"
Jul 15 19:04:40.848171 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:40.848140    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:40.852688 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:40.852664    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:40.969151 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:40.969091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l682s\" (UniqueName: \"kubernetes.io/projected/c83fde0c-5128-4e35-bb60-30803fe7e89f-kube-api-access-l682s\") pod \"c83fde0c-5128-4e35-bb60-30803fe7e89f\" (UID: \"c83fde0c-5128-4e35-bb60-30803fe7e89f\") "
Jul 15 19:04:40.970989 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:40.970967    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c83fde0c-5128-4e35-bb60-30803fe7e89f-kube-api-access-l682s" (OuterVolumeSpecName: "kube-api-access-l682s") pod "c83fde0c-5128-4e35-bb60-30803fe7e89f" (UID: "c83fde0c-5128-4e35-bb60-30803fe7e89f"). InnerVolumeSpecName "kube-api-access-l682s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:41.070685 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:41.070650    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l682s\" (UniqueName: \"kubernetes.io/projected/c83fde0c-5128-4e35-bb60-30803fe7e89f-kube-api-access-l682s\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:41.376778 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:41.376750    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c83fde0c-5128-4e35-bb60-30803fe7e89f" path="/var/lib/kubelet/pods/c83fde0c-5128-4e35-bb60-30803fe7e89f/volumes"
Jul 15 19:04:41.668830 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:41.668757    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:41.669410 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:41.668825    2563 scope.go:117] "RemoveContainer" containerID="73dae2ceda737d64caddb31b5801add7e44266c6767e5731aa1318b910467e35"
Jul 15 19:04:44.679125 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:44.679085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:04:44.779406 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:44.779381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:04:54.499049 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:54.499011    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"]
Jul 15 19:04:54.499603 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:54.499305    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc" podUID="419534a1-fd39-4f92-8331-f27791fc4d2d" containerName="maas-api" containerID="cri-o://0d00dfa79286e9bfb51e66d1ac0a2a60dbb104bb08884c351a1d8e1ec4dfea00" gracePeriod=30
Jul 15 19:04:54.524455 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:54.524378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:04:54.962832 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:54.962810    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 19:04:55.083215 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.083186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419534a1-fd39-4f92-8331-f27791fc4d2d-openshift-service-ca\") pod \"419534a1-fd39-4f92-8331-f27791fc4d2d\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") "
Jul 15 19:04:55.083347 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.083256    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls\") pod \"419534a1-fd39-4f92-8331-f27791fc4d2d\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") "
Jul 15 19:04:55.083347 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.083301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7764d\" (UniqueName: \"kubernetes.io/projected/419534a1-fd39-4f92-8331-f27791fc4d2d-kube-api-access-7764d\") pod \"419534a1-fd39-4f92-8331-f27791fc4d2d\" (UID: \"419534a1-fd39-4f92-8331-f27791fc4d2d\") "
Jul 15 19:04:55.083528 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.083506    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419534a1-fd39-4f92-8331-f27791fc4d2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "419534a1-fd39-4f92-8331-f27791fc4d2d" (UID: "419534a1-fd39-4f92-8331-f27791fc4d2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:04:55.083593 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.083580    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419534a1-fd39-4f92-8331-f27791fc4d2d-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:55.085284 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.085262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "419534a1-fd39-4f92-8331-f27791fc4d2d" (UID: "419534a1-fd39-4f92-8331-f27791fc4d2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:04:55.085377 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.085312    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/419534a1-fd39-4f92-8331-f27791fc4d2d-kube-api-access-7764d" (OuterVolumeSpecName: "kube-api-access-7764d") pod "419534a1-fd39-4f92-8331-f27791fc4d2d" (UID: "419534a1-fd39-4f92-8331-f27791fc4d2d"). InnerVolumeSpecName "kube-api-access-7764d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:55.184843 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.184821    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419534a1-fd39-4f92-8331-f27791fc4d2d-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:55.184843 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.184843    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7764d\" (UniqueName: \"kubernetes.io/projected/419534a1-fd39-4f92-8331-f27791fc4d2d-kube-api-access-7764d\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:04:55.730553 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.730486    2563 scope.go:117] "RemoveContainer" containerID="0d00dfa79286e9bfb51e66d1ac0a2a60dbb104bb08884c351a1d8e1ec4dfea00"
Jul 15 19:04:55.758249 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.758231    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"
Jul 15 19:04:55.758374 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.758285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc" event={"ID":"419534a1-fd39-4f92-8331-f27791fc4d2d","Type":"ContainerDied","Data":"0d00dfa79286e9bfb51e66d1ac0a2a60dbb104bb08884c351a1d8e1ec4dfea00"}
Jul 15 19:04:55.758374 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.758331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc" event={"ID":"419534a1-fd39-4f92-8331-f27791fc4d2d","Type":"ContainerDied","Data":"c2c1da1df8bc09cb2d5a6cc69657925c0ea6553bb74955a40832d2650408c953"}
Jul 15 19:04:55.778251 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.778229    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"]
Jul 15 19:04:55.782544 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:55.782525    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-401e9f-67598b4b59-ktdnc"]
Jul 15 19:04:57.377087 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:57.377054    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="419534a1-fd39-4f92-8331-f27791fc4d2d" path="/var/lib/kubelet/pods/419534a1-fd39-4f92-8331-f27791fc4d2d/volumes"
Jul 15 19:04:59.124494 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:04:59.124464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:05.445473 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:05.445443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:07.461259 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:07.461224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:07.957682 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:07.957650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:08.059298 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:08.059272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:09.982290 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:09.982254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:10.159029 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:10.158987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:11.154030 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:11.153998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:11.271677 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:11.271648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:20.769615 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:20.769585    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"]
Jul 15 19:05:20.769988 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:20.769801    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" podUID="c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" containerName="maas-api" containerID="cri-o://21466ffdd5b2744bffb432b42c686f0a22e42e862d5f3dd90ebfb319fe8cc9c2" gracePeriod=30
Jul 15 19:05:20.820694 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:20.820664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:20.907860 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:20.907835    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" containerID="21466ffdd5b2744bffb432b42c686f0a22e42e862d5f3dd90ebfb319fe8cc9c2" exitCode=0
Jul 15 19:05:20.907991 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:20.907908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" event={"ID":"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca","Type":"ContainerDied","Data":"21466ffdd5b2744bffb432b42c686f0a22e42e862d5f3dd90ebfb319fe8cc9c2"}
Jul 15 19:05:21.024046 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.023974    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 19:05:21.072004 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.071980    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls\") pod \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") "
Jul 15 19:05:21.072156 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.072017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-openshift-service-ca\") pod \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") "
Jul 15 19:05:21.072156 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.072036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9h8m\" (UniqueName: \"kubernetes.io/projected/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-kube-api-access-x9h8m\") pod \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\" (UID: \"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca\") "
Jul 15 19:05:21.072380 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.072358    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" (UID: "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:05:21.073983 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.073961    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" (UID: "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:05:21.074119 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.074106    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-kube-api-access-x9h8m" (OuterVolumeSpecName: "kube-api-access-x9h8m") pod "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" (UID: "c4f994a4-b5f7-4541-8f0c-921fe69fa8ca"). InnerVolumeSpecName "kube-api-access-x9h8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:05:21.173530 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.173504    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-maas-api-tls\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:21.173530 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.173530    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-openshift-service-ca\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:21.173669 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.173543    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9h8m\" (UniqueName: \"kubernetes.io/projected/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca-kube-api-access-x9h8m\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:21.914650 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.914624    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"
Jul 15 19:05:21.915025 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.914648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54" event={"ID":"c4f994a4-b5f7-4541-8f0c-921fe69fa8ca","Type":"ContainerDied","Data":"ef8f3068e4cda7fa0d53baaf27c2e720e899f5b61ff096604feb581b469cf579"}
Jul 15 19:05:21.915025 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.914725    2563 scope.go:117] "RemoveContainer" containerID="21466ffdd5b2744bffb432b42c686f0a22e42e862d5f3dd90ebfb319fe8cc9c2"
Jul 15 19:05:21.931529 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.931504    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"]
Jul 15 19:05:21.933821 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:21.933796    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e17a-776c8f78c7-d8b54"]
Jul 15 19:05:23.378515 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:23.378483    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" path="/var/lib/kubelet/pods/c4f994a4-b5f7-4541-8f0c-921fe69fa8ca/volumes"
Jul 15 19:05:25.371666 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:25.371631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:31.744274 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:31.744241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:31.849395 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:31.849368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:36.087099 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:36.087060    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"]
Jul 15 19:05:36.087659 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:36.087309    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy" containerID="cri-o://f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409" gracePeriod=30
Jul 15 19:05:36.119778 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:36.119747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:36.338417 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:36.338330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:36.775474 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:36.775374    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84497cb946-6kfz2_a5c779d0-5ad3-4414-9129-098bcf513c00/authorino/0.log"
Jul 15 19:05:38.488496 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:38.488453    2563 patch_prober.go:28] interesting pod/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:05:38.488898 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:38.488514    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:05:41.343969 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.343944    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 19:05:41.424737 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424680    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-certs\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.424737 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-token\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.424890 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424769    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istiod-ca-cert\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.424890 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424829    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-data\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.424890 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424859    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-podinfo\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.425017 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424889    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrmhn\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-kube-api-access-xrmhn\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.425017 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:05:41.425017 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.424984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-socket\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.425157 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425028    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-credential-socket\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.425157 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-envoy\") pod \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\" (UID: \"d20e99ac-ddd9-40e6-b858-f47ab62c4d40\") "
Jul 15 19:05:41.425327 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:05:41.425415 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425314    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:05:41.425415 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425318    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:05:41.425569 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425512    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.425569 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425534    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-credential-socket\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.425569 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425550    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-workload-certs\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.425569 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425564    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istiod-ca-cert\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.425818 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.425794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-data" (OuterVolumeSpecName: "istio-data") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:05:41.427102 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.427077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-kube-api-access-xrmhn" (OuterVolumeSpecName: "kube-api-access-xrmhn") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "kube-api-access-xrmhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:05:41.427308 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.427291    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:05:41.427469 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.427444    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-token" (OuterVolumeSpecName: "istio-token") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:05:41.427556 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.427474    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d20e99ac-ddd9-40e6-b858-f47ab62c4d40" (UID: "d20e99ac-ddd9-40e6-b858-f47ab62c4d40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:05:41.526010 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.525980    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrmhn\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-kube-api-access-xrmhn\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.526010 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.526006    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-envoy\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.526159 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.526019    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-token\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.526159 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.526030    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-data\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:41.526159 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:41.526043    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20e99ac-ddd9-40e6-b858-f47ab62c4d40-istio-podinfo\") on node \"ip-10-0-135-84.ec2.internal\" DevicePath \"\""
Jul 15 19:05:42.037232 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.037191    2563 generic.go:356] "Generic (PLEG): container finished" podID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerID="f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409" exitCode=0
Jul 15 19:05:42.037410 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.037254    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"
Jul 15 19:05:42.037410 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.037275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" event={"ID":"d20e99ac-ddd9-40e6-b858-f47ab62c4d40","Type":"ContainerDied","Data":"f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409"}
Jul 15 19:05:42.037410 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.037345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q" event={"ID":"d20e99ac-ddd9-40e6-b858-f47ab62c4d40","Type":"ContainerDied","Data":"8d6f41a9489e719814aa121ad55ae30c11ba8782a15153ef4e6b70c76640a00c"}
Jul 15 19:05:42.037410 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.037371    2563 scope.go:117] "RemoveContainer" containerID="f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409"
Jul 15 19:05:42.052253 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.049841    2563 scope.go:117] "RemoveContainer" containerID="e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075"
Jul 15 19:05:42.060095 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.060076    2563 scope.go:117] "RemoveContainer" containerID="f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409"
Jul 15 19:05:42.060405 ip-10-0-135-84 kubenswrapper[2563]: E0715 19:05:42.060385    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409\": container with ID starting with f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409 not found: ID does not exist" containerID="f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409"
Jul 15 19:05:42.060477 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.060412    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409"} err="failed to get container status \"f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409\": rpc error: code = NotFound desc = could not find container \"f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409\": container with ID starting with f2cec4b87247d54b6340c3b60634f9151c90bed56c8ab6d6a61ffec82f2ab409 not found: ID does not exist"
Jul 15 19:05:42.060477 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.060454    2563 scope.go:117] "RemoveContainer" containerID="e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075"
Jul 15 19:05:42.060709 ip-10-0-135-84 kubenswrapper[2563]: E0715 19:05:42.060692    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075\": container with ID starting with e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075 not found: ID does not exist" containerID="e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075"
Jul 15 19:05:42.060751 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.060714    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075"} err="failed to get container status \"e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075\": rpc error: code = NotFound desc = could not find container \"e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075\": container with ID starting with e43120591a733874be92908c9f923178041e20719b1fa0d0abfe813f48e7b075 not found: ID does not exist"
Jul 15 19:05:42.061710 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.061688    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"]
Jul 15 19:05:42.067681 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.067657    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-46e17a-openshift-default-56b4c7988c-vcf4q"]
Jul 15 19:05:42.401287 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.401259    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-q6bd9_a1dbfb8b-f08f-4b65-b082-067f77c37201/manager/0.log"
Jul 15 19:05:42.538718 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.538698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z4k6m_2bb157c4-603f-4f54-be56-18bdacaeef55/manager/0.log"
Jul 15 19:05:42.668497 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.668443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6588c6cddf-lfgzf_728cbbb0-54ee-4bcb-b7e2-ef23a55136e9/manager/0.log"
Jul 15 19:05:42.815442 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:42.815404    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s859k_ef07a2d6-a664-4afd-8260-9b4396345263/server/0.log"
Jul 15 19:05:43.209641 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:43.209612    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-m2pzc_a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb/manager/0.log"
Jul 15 19:05:43.220489 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:43.220466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-m2pzc_a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb/copy-manifests/0.log"
Jul 15 19:05:43.378532 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:43.378503    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" path="/var/lib/kubelet/pods/d20e99ac-ddd9-40e6-b858-f47ab62c4d40/volumes"
Jul 15 19:05:43.708805 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:43.708780    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5787bbc746-8wttw_7541ff8c-3365-42e3-b5ad-292efda43ad9/maas-api/0.log"
Jul 15 19:05:43.822714 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:43.822694    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735670-98jlx_57074b01-3c60-4cc5-91dc-6bb86c5855e7/cleanup/0.log"
Jul 15 19:05:44.060050 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:44.060029    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735700-ntldd_d6abf53f-25d7-44ad-ac12-78dfe1f9d846/cleanup/0.log"
Jul 15 19:05:46.410862 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.410829    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7_4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d/util/0.log"
Jul 15 19:05:46.417676 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.417649    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7_4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d/pull/0.log"
Jul 15 19:05:46.424323 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.424301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7_4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d/extract/0.log"
Jul 15 19:05:46.547537 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.547511    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964_0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd/util/0.log"
Jul 15 19:05:46.554749 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.554727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964_0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd/pull/0.log"
Jul 15 19:05:46.561800 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.561781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964_0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd/extract/0.log"
Jul 15 19:05:46.673416 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.673356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n_e1d7c64f-7120-47b3-b617-b093d0f96d16/util/0.log"
Jul 15 19:05:46.679783 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.679761    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n_e1d7c64f-7120-47b3-b617-b093d0f96d16/pull/0.log"
Jul 15 19:05:46.686866 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.686831    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n_e1d7c64f-7120-47b3-b617-b093d0f96d16/extract/0.log"
Jul 15 19:05:46.802390 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.802371    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r_85b93b3c-1e22-4523-94ec-9c48f7cee885/util/0.log"
Jul 15 19:05:46.808505 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.808490    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r_85b93b3c-1e22-4523-94ec-9c48f7cee885/pull/0.log"
Jul 15 19:05:46.814438 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.814409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r_85b93b3c-1e22-4523-94ec-9c48f7cee885/extract/0.log"
Jul 15 19:05:46.936949 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:46.936887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84497cb946-6kfz2_a5c779d0-5ad3-4414-9129-098bcf513c00/authorino/0.log"
Jul 15 19:05:47.074692 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:47.074673    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nvxvq_5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d/manager/0.log"
Jul 15 19:05:47.196195 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:47.196142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2v65s_dabe02e8-08d8-4093-9351-10b76f92272d/manager/0.log"
Jul 15 19:05:47.318164 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:47.318141    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fsc77_565896c9-203e-4dd0-af9e-976276ab1e62/kuadrant-console-plugin/0.log"
Jul 15 19:05:47.450076 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:47.450011    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hfz6q_18b9a93c-b3c4-4a88-8418-17d764729260/registry-server/0.log"
Jul 15 19:05:47.580944 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:47.580924    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fmgp6_17b175a1-6414-4f94-8335-b5b04c7f193c/manager/0.log"
Jul 15 19:05:47.851664 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:47.851641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xpshs_185483cf-c424-4421-8027-78dbfd2ecbba/manager/0.log"
Jul 15 19:05:48.493320 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:48.493287    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-c757l_eae91f25-0b21-4d81-9c36-8b87f0f7a838/kube-auth-proxy/0.log"
Jul 15 19:05:48.741435 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:48.741402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spk4h_f6b498b3-801a-4550-a7f6-890243927f5b/istio-proxy/1.log"
Jul 15 19:05:49.109588 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:49.109558    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747c86b468-tkw4q_1ee39a41-b482-41df-bf00-531086353273/router/0.log"
Jul 15 19:05:49.587327 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:49.587302    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fgb4l_5c0b3378-b639-4b68-bf16-c76af8b6db35/main/0.log"
Jul 15 19:05:56.157788 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.157757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:56.225048 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225023    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-858dh/must-gather-xcmfp"]
Jul 15 19:05:56.225389 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225376    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c83fde0c-5128-4e35-bb60-30803fe7e89f" containerName="test-curl-7130-140263871201120"
Jul 15 19:05:56.225460 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225390    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c83fde0c-5128-4e35-bb60-30803fe7e89f" containerName="test-curl-7130-140263871201120"
Jul 15 19:05:56.225460 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225400    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy"
Jul 15 19:05:56.225460 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225406    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy"
Jul 15 19:05:56.225460 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225433    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" containerName="maas-api"
Jul 15 19:05:56.225460 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225441    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" containerName="maas-api"
Jul 15 19:05:56.225460 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225452    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419534a1-fd39-4f92-8331-f27791fc4d2d" containerName="maas-api"
Jul 15 19:05:56.225460 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225460    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="419534a1-fd39-4f92-8331-f27791fc4d2d" containerName="maas-api"
Jul 15 19:05:56.225673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225553    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f994a4-b5f7-4541-8f0c-921fe69fa8ca" containerName="maas-api"
Jul 15 19:05:56.225673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225561    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy"
Jul 15 19:05:56.225673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225566    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c83fde0c-5128-4e35-bb60-30803fe7e89f" containerName="test-curl-7130-140263871201120"
Jul 15 19:05:56.225673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225572    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy"
Jul 15 19:05:56.225673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225578    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="419534a1-fd39-4f92-8331-f27791fc4d2d" containerName="maas-api"
Jul 15 19:05:56.225673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225637    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy"
Jul 15 19:05:56.225673 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.225642    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20e99ac-ddd9-40e6-b858-f47ab62c4d40" containerName="istio-proxy"
Jul 15 19:05:56.227852 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.227830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log" limit=1024
Jul 15 19:05:56.230062 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.230047    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.232556 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.232540    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-858dh\"/\"kube-root-ca.crt\""
Jul 15 19:05:56.232650 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.232636    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-858dh\"/\"openshift-service-ca.crt\""
Jul 15 19:05:56.233594 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.233577    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-858dh\"/\"default-dockercfg-td7m4\""
Jul 15 19:05:56.239919 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.239898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858dh/must-gather-xcmfp"]
Jul 15 19:05:56.337248 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.337218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71f74a4b-bdda-41e9-b47f-b63637ad6a75-must-gather-output\") pod \"must-gather-xcmfp\" (UID: \"71f74a4b-bdda-41e9-b47f-b63637ad6a75\") " pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.337349 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.337263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxdxw\" (UniqueName: \"kubernetes.io/projected/71f74a4b-bdda-41e9-b47f-b63637ad6a75-kube-api-access-mxdxw\") pod \"must-gather-xcmfp\" (UID: \"71f74a4b-bdda-41e9-b47f-b63637ad6a75\") " pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.438016 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.437954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71f74a4b-bdda-41e9-b47f-b63637ad6a75-must-gather-output\") pod \"must-gather-xcmfp\" (UID: \"71f74a4b-bdda-41e9-b47f-b63637ad6a75\") " pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.438016 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.438010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxdxw\" (UniqueName: \"kubernetes.io/projected/71f74a4b-bdda-41e9-b47f-b63637ad6a75-kube-api-access-mxdxw\") pod \"must-gather-xcmfp\" (UID: \"71f74a4b-bdda-41e9-b47f-b63637ad6a75\") " pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.438415 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.438395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71f74a4b-bdda-41e9-b47f-b63637ad6a75-must-gather-output\") pod \"must-gather-xcmfp\" (UID: \"71f74a4b-bdda-41e9-b47f-b63637ad6a75\") " pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.447051 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.447026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxdxw\" (UniqueName: \"kubernetes.io/projected/71f74a4b-bdda-41e9-b47f-b63637ad6a75-kube-api-access-mxdxw\") pod \"must-gather-xcmfp\" (UID: \"71f74a4b-bdda-41e9-b47f-b63637ad6a75\") " pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.539723 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.539700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858dh/must-gather-xcmfp"
Jul 15 19:05:56.678962 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:56.678935    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858dh/must-gather-xcmfp"]
Jul 15 19:05:56.680449 ip-10-0-135-84 kubenswrapper[2563]: W0715 19:05:56.680405    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71f74a4b_bdda_41e9_b47f_b63637ad6a75.slice/crio-8d0c7abd36c2fd971298b809925ccc66906a139463b17729026ea74b37a46828 WatchSource:0}: Error finding container 8d0c7abd36c2fd971298b809925ccc66906a139463b17729026ea74b37a46828: Status 404 returned error can't find the container with id 8d0c7abd36c2fd971298b809925ccc66906a139463b17729026ea74b37a46828
Jul 15 19:05:57.133692 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:57.133658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858dh/must-gather-xcmfp" event={"ID":"71f74a4b-bdda-41e9-b47f-b63637ad6a75","Type":"ContainerStarted","Data":"8d0c7abd36c2fd971298b809925ccc66906a139463b17729026ea74b37a46828"}
Jul 15 19:05:58.145207 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:58.145164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858dh/must-gather-xcmfp" event={"ID":"71f74a4b-bdda-41e9-b47f-b63637ad6a75","Type":"ContainerStarted","Data":"93ca01050f2d51d2a0e902bbae57090652ce479474b3f86b4c01d9b68430fa4e"}
Jul 15 19:05:58.145656 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:58.145222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858dh/must-gather-xcmfp" event={"ID":"71f74a4b-bdda-41e9-b47f-b63637ad6a75","Type":"ContainerStarted","Data":"721a22dd714f6ac2e3f4d847c17b2fe36679b924e119c69d62c946533ebefd94"}
Jul 15 19:05:58.165116 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:58.165020    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-858dh/must-gather-xcmfp" podStartSLOduration=0.942013005 podStartE2EDuration="2.164999626s" totalImagesPullingTime="1.222986621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:05:58.163061273 +0000 UTC m=+2943.370324557" watchObservedRunningTime="2026-07-15 19:05:58.164999626 +0000 UTC m=+2943.372262910"
Jul 15 19:05:59.515186 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:59.515151    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9f264_d53a3b94-2590-4925-ba9a-5c729a1e9e27/global-pull-secret-syncer/0.log"
Jul 15 19:05:59.616226 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:59.616164    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sdpbf_ed8cb2cb-be58-4fa5-8a2b-26fc9cc03505/konnectivity-agent/0.log"
Jul 15 19:05:59.763478 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:05:59.763448    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-84.ec2.internal_996dc6e33536e0334a4ae6997f784794/haproxy/0.log"
Jul 15 19:06:04.264072 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.264034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7_4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d/extract/0.log"
Jul 15 19:06:04.300580 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.300546    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7_4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d/util/0.log"
Jul 15 19:06:04.326207 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.326174    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljzn7_4e2f2dc6-5e20-4f33-a36d-feaa5dcfc58d/pull/0.log"
Jul 15 19:06:04.357100 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.357070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964_0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd/extract/0.log"
Jul 15 19:06:04.383748 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.383717    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964_0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd/util/0.log"
Jul 15 19:06:04.425845 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.425708    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk964_0b9e50c3-2e8f-4f70-90ce-9b9a1f0de7dd/pull/0.log"
Jul 15 19:06:04.456021 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.455971    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n_e1d7c64f-7120-47b3-b617-b093d0f96d16/extract/0.log"
Jul 15 19:06:04.489380 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.489353    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n_e1d7c64f-7120-47b3-b617-b093d0f96d16/util/0.log"
Jul 15 19:06:04.520560 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.520473    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v622n_e1d7c64f-7120-47b3-b617-b093d0f96d16/pull/0.log"
Jul 15 19:06:04.552597 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.552564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r_85b93b3c-1e22-4523-94ec-9c48f7cee885/extract/0.log"
Jul 15 19:06:04.578070 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.578046    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r_85b93b3c-1e22-4523-94ec-9c48f7cee885/util/0.log"
Jul 15 19:06:04.603338 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:04.603283    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17xl8r_85b93b3c-1e22-4523-94ec-9c48f7cee885/pull/0.log"
Jul 15 19:06:05.037570 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:05.037345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84497cb946-6kfz2_a5c779d0-5ad3-4414-9129-098bcf513c00/authorino/0.log"
Jul 15 19:06:05.079303 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:05.079275    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nvxvq_5277eb50-cd7c-4d3b-b8c3-dbc2ece08b0d/manager/0.log"
Jul 15 19:06:05.107445 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:05.107334    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2v65s_dabe02e8-08d8-4093-9351-10b76f92272d/manager/0.log"
Jul 15 19:06:05.138613 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:05.138510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fsc77_565896c9-203e-4dd0-af9e-976276ab1e62/kuadrant-console-plugin/0.log"
Jul 15 19:06:05.192247 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:05.192205    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hfz6q_18b9a93c-b3c4-4a88-8418-17d764729260/registry-server/0.log"
Jul 15 19:06:05.347873 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:05.346914    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fmgp6_17b175a1-6414-4f94-8335-b5b04c7f193c/manager/0.log"
Jul 15 19:06:05.477550 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:05.474954    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xpshs_185483cf-c424-4421-8027-78dbfd2ecbba/manager/0.log"
Jul 15 19:06:07.246408 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:07.246321    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-8hd2k_906bf707-f2cb-4427-a5ec-31ecae5c73e4/cluster-monitoring-operator/0.log"
Jul 15 19:06:07.493806 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:07.493775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r9prz_27b75cc7-5411-4ffd-9ef6-f0c51befacf7/node-exporter/0.log"
Jul 15 19:06:07.516078 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:07.516007    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r9prz_27b75cc7-5411-4ffd-9ef6-f0c51befacf7/kube-rbac-proxy/0.log"
Jul 15 19:06:07.541493 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:07.541469    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r9prz_27b75cc7-5411-4ffd-9ef6-f0c51befacf7/init-textfile/0.log"
Jul 15 19:06:08.114503 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:08.114466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87c97d87-gc8hq_f7d0cdc6-664a-46f9-876a-30348099e5a5/telemeter-client/0.log"
Jul 15 19:06:08.137770 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:08.137742    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87c97d87-gc8hq_f7d0cdc6-664a-46f9-876a-30348099e5a5/reload/0.log"
Jul 15 19:06:08.160974 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:08.160941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87c97d87-gc8hq_f7d0cdc6-664a-46f9-876a-30348099e5a5/kube-rbac-proxy/0.log"
Jul 15 19:06:09.839667 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.839631    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"]
Jul 15 19:06:09.848865 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.848834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:09.862318 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.862293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"]
Jul 15 19:06:09.972378 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.972276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-sys\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:09.972378 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.972334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-podres\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:09.972378 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.972385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-proc\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:09.972701 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.972453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-lib-modules\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:09.972701 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:09.972490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qcx\" (UniqueName: \"kubernetes.io/projected/074a27e6-d2ea-42e9-aa01-7da33434f21e-kube-api-access-x4qcx\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.073612 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.073580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qcx\" (UniqueName: \"kubernetes.io/projected/074a27e6-d2ea-42e9-aa01-7da33434f21e-kube-api-access-x4qcx\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.073806 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.073696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-sys\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.073806 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.073726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-podres\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.073806 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.073774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-proc\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.073968 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.073810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-lib-modules\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.074028 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.073977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-lib-modules\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.074195 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.074173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-podres\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.074340 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.074314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-proc\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.074450 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.074393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/074a27e6-d2ea-42e9-aa01-7da33434f21e-sys\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.087009 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.086977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qcx\" (UniqueName: \"kubernetes.io/projected/074a27e6-d2ea-42e9-aa01-7da33434f21e-kube-api-access-x4qcx\") pod \"perf-node-gather-daemonset-66j77\" (UID: \"074a27e6-d2ea-42e9-aa01-7da33434f21e\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.167533 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.167234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:10.344846 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.344817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"]
Jul 15 19:06:10.631385 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:10.631341    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-nxvwr_f411633c-6b26-4345-bd15-3a70f9a3c7e1/download-server/0.log"
Jul 15 19:06:11.273998 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:11.273945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77" event={"ID":"074a27e6-d2ea-42e9-aa01-7da33434f21e","Type":"ContainerStarted","Data":"3cf28c25a00b569426e2252295f5b41f35a0395ace70d120a7686468eaab222f"}
Jul 15 19:06:11.274476 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:11.274022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77" event={"ID":"074a27e6-d2ea-42e9-aa01-7da33434f21e","Type":"ContainerStarted","Data":"020abca9e6cfa057833c262379cff1b3f758cb6471a31b20c602d7aec586e37a"}
Jul 15 19:06:11.274867 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:11.274840    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:11.295128 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:11.295076    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77" podStartSLOduration=2.295057193 podStartE2EDuration="2.295057193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:06:11.293005868 +0000 UTC m=+2956.500269161" watchObservedRunningTime="2026-07-15 19:06:11.295057193 +0000 UTC m=+2956.502320477"
Jul 15 19:06:12.266477 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:12.266448    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x5ssz_ae976dd6-1554-48b9-b47e-0cf4c16aa1fb/dns/0.log"
Jul 15 19:06:12.292049 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:12.292019    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x5ssz_ae976dd6-1554-48b9-b47e-0cf4c16aa1fb/kube-rbac-proxy/0.log"
Jul 15 19:06:12.414718 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:12.414692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gppmk_705b5981-93d7-4af4-bbcd-5be67cefd26a/dns-node-resolver/0.log"
Jul 15 19:06:13.000318 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:13.000295    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slsgg_8734cf12-bfe6-438e-865c-49b06f669d2b/node-ca/0.log"
Jul 15 19:06:14.212474 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:14.212410    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-c757l_eae91f25-0b21-4d81-9c36-8b87f0f7a838/kube-auth-proxy/0.log"
Jul 15 19:06:14.272986 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:14.272943    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spk4h_f6b498b3-801a-4550-a7f6-890243927f5b/istio-proxy/0.log"
Jul 15 19:06:14.311187 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:14.311161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spk4h_f6b498b3-801a-4550-a7f6-890243927f5b/istio-proxy/1.log"
Jul 15 19:06:14.410279 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:14.410242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747c86b468-tkw4q_1ee39a41-b482-41df-bf00-531086353273/router/0.log"
Jul 15 19:06:15.127958 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:15.127926    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmh4k_8baba4c0-1b57-495f-8d85-ed87c1299bcd/serve-healthcheck-canary/0.log"
Jul 15 19:06:15.632039 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:15.631983    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7fzfw_3dfa7522-42d5-41a3-aa9d-6902aa7db748/insights-operator/0.log"
Jul 15 19:06:15.632786 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:15.632673    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7fzfw_3dfa7522-42d5-41a3-aa9d-6902aa7db748/insights-operator/1.log"
Jul 15 19:06:15.656389 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:15.656359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nr7b_ac81d8a2-2a17-4c71-894e-ce7dc9cd8752/kube-rbac-proxy/0.log"
Jul 15 19:06:15.681683 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:15.681658    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nr7b_ac81d8a2-2a17-4c71-894e-ce7dc9cd8752/exporter/0.log"
Jul 15 19:06:15.704834 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:15.704803    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nr7b_ac81d8a2-2a17-4c71-894e-ce7dc9cd8752/extractor/0.log"
Jul 15 19:06:17.976236 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:17.976165    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-q6bd9_a1dbfb8b-f08f-4b65-b082-067f77c37201/manager/0.log"
Jul 15 19:06:18.150572 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:18.150525    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z4k6m_2bb157c4-603f-4f54-be56-18bdacaeef55/manager/0.log"
Jul 15 19:06:18.286636 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:18.286565    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6588c6cddf-lfgzf_728cbbb0-54ee-4bcb-b7e2-ef23a55136e9/manager/0.log"
Jul 15 19:06:18.298188 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:18.298162    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-66j77"
Jul 15 19:06:18.308382 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:18.308363    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s859k_ef07a2d6-a664-4afd-8260-9b4396345263/server/0.log"
Jul 15 19:06:18.581048 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:18.581009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-m2pzc_a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb/manager/0.log"
Jul 15 19:06:18.599352 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:18.599324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-m2pzc_a0c8fd63-d18a-46f7-826f-9f9f5e2ebbfb/copy-manifests/0.log"
Jul 15 19:06:19.529626 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:19.529596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-c757l_eae91f25-0b21-4d81-9c36-8b87f0f7a838/kube-auth-proxy/0.log"
Jul 15 19:06:19.577915 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:19.577887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spk4h_f6b498b3-801a-4550-a7f6-890243927f5b/istio-proxy/0.log"
Jul 15 19:06:19.612855 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:19.612833    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spk4h_f6b498b3-801a-4550-a7f6-890243927f5b/istio-proxy/1.log"
Jul 15 19:06:19.682877 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:19.682848    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747c86b468-tkw4q_1ee39a41-b482-41df-bf00-531086353273/router/0.log"
Jul 15 19:06:19.991209 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:19.991145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9jx2r_4d46d0af-f380-4aa6-b05f-4d83b00287f8/openshift-lws-operator/0.log"
Jul 15 19:06:21.314719 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:21.314694    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-c757l_eae91f25-0b21-4d81-9c36-8b87f0f7a838/kube-auth-proxy/0.log"
Jul 15 19:06:21.351313 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:21.351179    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spk4h_f6b498b3-801a-4550-a7f6-890243927f5b/istio-proxy/0.log"
Jul 15 19:06:21.400858 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:21.400819    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spk4h_f6b498b3-801a-4550-a7f6-890243927f5b/istio-proxy/1.log"
Jul 15 19:06:21.471416 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:21.471377    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747c86b468-tkw4q_1ee39a41-b482-41df-bf00-531086353273/router/0.log"
Jul 15 19:06:27.010402 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.010376    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzxlr_30120d8d-84a9-40ea-b346-a5327afb5299/kube-multus-additional-cni-plugins/0.log"
Jul 15 19:06:27.041488 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.041460    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzxlr_30120d8d-84a9-40ea-b346-a5327afb5299/egress-router-binary-copy/0.log"
Jul 15 19:06:27.066835 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.066808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzxlr_30120d8d-84a9-40ea-b346-a5327afb5299/cni-plugins/0.log"
Jul 15 19:06:27.092911 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.092889    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzxlr_30120d8d-84a9-40ea-b346-a5327afb5299/bond-cni-plugin/0.log"
Jul 15 19:06:27.115809 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.115784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzxlr_30120d8d-84a9-40ea-b346-a5327afb5299/routeoverride-cni/0.log"
Jul 15 19:06:27.138880 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.138862    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzxlr_30120d8d-84a9-40ea-b346-a5327afb5299/whereabouts-cni-bincopy/0.log"
Jul 15 19:06:27.166394 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.166375    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzxlr_30120d8d-84a9-40ea-b346-a5327afb5299/whereabouts-cni/0.log"
Jul 15 19:06:27.241300 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.241277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xlvqg_edf1cbdf-52b1-46ad-89df-a6c4f3d75c98/kube-multus/0.log"
Jul 15 19:06:27.386614 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.386584    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qpjch_5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d/network-metrics-daemon/0.log"
Jul 15 19:06:27.407922 ip-10-0-135-84 kubenswrapper[2563]: I0715 19:06:27.407900    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qpjch_5d8ab412-0f60-48f6-8e5a-0ce7a509dd9d/kube-rbac-proxy/0.log"