Jul 10 18:01:01.856602 ip-10-0-135-41 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 18:01:01.856615 ip-10-0-135-41 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 18:01:01.856625 ip-10-0-135-41 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 18:01:01.857050 ip-10-0-135-41 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 18:01:13.272040 ip-10-0-135-41 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 18:01:13.272056 ip-10-0-135-41 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot cb5b4bd70d5542908c2b381d83baf6f0 --
Jul 10 18:03:14.704030 ip-10-0-135-41 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.163092    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170179    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170204    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170213    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170216    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170220    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170223    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170226    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:03:15.230138 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170229    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170232    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170235    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170238    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170240    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170244    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170246    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170249    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170252    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170255    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170258    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170266    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170270    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170273    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170278    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170282    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170286    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170289    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170292    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:03:15.231190 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170295    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170298    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170301    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170304    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170308    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170311    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170314    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170318    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170321    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170324    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170328    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170331    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170334    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170337    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170339    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170343    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170346    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170348    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170351    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170354    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:03:15.231775 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170358    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170360    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170363    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170366    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170369    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170372    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170375    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170378    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170381    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170384    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170387    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170390    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170393    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170396    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170402    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170406    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170410    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170414    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170417    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170420    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:03:15.232350 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170423    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170426    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170429    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170432    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170435    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170441    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170445    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170449    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170452    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170455    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170458    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170461    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170464    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170467    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170470    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170473    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170476    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170480    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170482    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170485    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:03:15.232984 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170488    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170491    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170493    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170497    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170500    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170503    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170506    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170509    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170512    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170515    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170518    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170520    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.170523    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172243    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172253    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172257    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172260    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172263    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172267    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172271    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:03:15.233546 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172274    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172278    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172281    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172283    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172286    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172289    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172292    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172295    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172298    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172301    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172304    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172307    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172310    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172313    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172316    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172324    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172328    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172330    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172333    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172336    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:03:15.234219 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172339    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172342    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172345    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172348    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172351    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172353    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172356    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172359    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172361    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172364    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172367    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172370    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172373    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172376    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172379    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172384    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172387    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172390    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172392    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172395    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:03:15.234846 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172398    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172402    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172405    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172408    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172410    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172413    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172415    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172422    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172426    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172429    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172433    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172436    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172439    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172442    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172445    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172448    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172451    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172454    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:03:15.235481 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172457    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172461    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172465    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172468    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172471    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172474    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172478    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172481    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172484    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172488    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172492    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172496    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172499    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172502    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172506    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172509    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172512    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172514    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172517    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:03:15.236193 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172520    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172523    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172528    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172531    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172534    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172537    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172540    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172546    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172549    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172552    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172555    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172558    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172560    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.172563    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173025    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173032    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173035    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173038    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173042    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:03:15.236816 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173045    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173050    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173056    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173059    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173063    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173066    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173069    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173072    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173075    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173078    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173081    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173083    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173087    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173089    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173094    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173097    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173100    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173103    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173106    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:03:15.237455 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173108    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173111    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173114    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173117    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173119    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173122    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173125    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173128    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173131    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173134    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173136    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173139    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173142    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173145    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173148    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173154    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173157    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173160    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173163    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173165    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:03:15.238210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173168    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173171    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173174    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173176    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173180    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173183    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173186    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173190    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173192    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173195    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173198    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173201    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173204    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173207    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173210    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173213    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173215    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173218    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173221    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173223    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:03:15.239204 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173226    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173229    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173232    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173235    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173237    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173240    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173244    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173248    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173251    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173254    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173257    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173260    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173262    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173265    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173268    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173270    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173273    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173277    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173280    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173286    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:03:15.240740 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173289    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173292    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173295    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173299    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173301    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173304    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173308    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173311    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173314    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173318    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173321    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173323    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173326    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173329    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.173332    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173420    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173436    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173444    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173449    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173456    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173460    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 18:03:15.241825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173464    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173471    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173475    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173478    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173482    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173486    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173489    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173493    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173496    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173500    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173505    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173508    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173513    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173516    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173519    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173523    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173527    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173531    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173534    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173538    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173541    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173545    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173548    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173551    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 18:03:15.242679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173555    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173558    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173563    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173566    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173569    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173572    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173577    2565 flags.go:64] FLAG: --enable-server="true"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173581    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173586    2565 flags.go:64] FLAG: --event-burst="100"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173590    2565 flags.go:64] FLAG: --event-qps="50"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173593    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173596    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173599    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173604    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173607    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173610    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173613    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173617    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173622    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173626    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173629    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173632    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173635    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173638    2565 flags.go:64] FLAG: --feature-gates=""
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173643    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 18:03:15.243585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173646    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173650    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173653    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173657    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173660    2565 flags.go:64] FLAG: --help="false"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173663    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173667    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173670    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173673    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173676    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173680    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173683    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173686    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173690    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173693    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173697    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173700    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173703    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173706    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173732    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173736    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173739    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173742    2565 flags.go:64] FLAG: --lock-file=""
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173745    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 18:03:15.244469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173748    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173754    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173760    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173763    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173767    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173770    2565 flags.go:64] FLAG: --logging-format="text"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173773    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173777    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173780    2565 flags.go:64] FLAG: --manifest-url=""
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173783    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173788    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173792    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173797    2565 flags.go:64] FLAG: --max-pods="110"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173800    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173803    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173806    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173810    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173813    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173816    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173819    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173828    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173833    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173836    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 18:03:15.245508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173840    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173844    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173852    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173855    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173858    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173861    2565 flags.go:64] FLAG: --port="10250"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173864    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173867    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04e474d2897387c40"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173871    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173874    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173878    2565 flags.go:64] FLAG: --register-node="true"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173882    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173886    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173889    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173893    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173896    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173900    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173903    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173906    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173910    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173913    2565 flags.go:64] FLAG: --runonce="false"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173916    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173919    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173923    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173927    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 18:03:15.246398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173930    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173933    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173937    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173940    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173943    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173949    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173952    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173955    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173958    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173962    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173966    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173971    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173975    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173978    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173982    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173986    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173989    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173992    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173996    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.173999    2565 flags.go:64] FLAG: --v="2"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.174004    2565 flags.go:64] FLAG: --version="false"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.174008    2565 flags.go:64] FLAG: --vmodule=""
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.174012    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.174016    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174150    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:03:15.247564 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174154    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174157    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174160    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174164    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174166    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174170    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174173    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174176    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174179    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174182    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174184    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174187    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174192    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174194    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174197    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174200    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174203    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174206    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174209    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174212    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:03:15.248898 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174214    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174217    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174220    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174223    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174226    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174230    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174233    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174236    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174238    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174241    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174244    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174247    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174250    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174252    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174255    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174258    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174261    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174264    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174268    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:03:15.249949 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174272    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:03:15.250525 ip-10-0-135-41 systemd[1]: Started Kubernetes Kubelet.
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174275    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174278    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174281    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174284    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174289    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174292    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174294    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174297    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174302    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174305    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174310    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174313    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174317    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174320    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174324    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174326    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174329    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174334    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:03:15.251024 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174336    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174339    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174342    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174345    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174348    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174351    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174353    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174356    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174358    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174362    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174364    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174367    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174370    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174373    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174375    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174378    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174380    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174383    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174387    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174390    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:03:15.459878 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174393    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174395    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174398    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174401    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174403    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174407    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174410    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174412    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174415    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174418    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174420    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174435    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174439    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174442    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174445    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174448    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174451    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174454    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174457    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:03:15.477189 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.174459    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.175117    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.186698    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.186736    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.186761    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.186773    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186842    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186848    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186851    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186855    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186860    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186870    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186873    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186876    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:03:15.478137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186880    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186883    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186886    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186888    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186893    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186895    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186898    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186903    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186907    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186910    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186913    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186918    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186921    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186924    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186927    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186930    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186933    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186935    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186939    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186942    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:03:15.478768 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186947    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186950    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186953    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186956    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186958    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186961    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186965    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186967    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186970    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186974    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186977    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186980    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186983    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186986    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186989    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186992    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186994    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.186998    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187001    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187003    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:03:15.479567 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187006    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187009    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187012    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187017    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187020    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187023    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187026    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187029    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187031    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187035    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187037    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187041    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187044    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187048    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187051    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187054    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187057    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187061    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187065    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187067    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:03:15.480978 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187071    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187075    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187077    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187080    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187083    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187085    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187088    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187091    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187093    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187098    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187101    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187105    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187108    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187111    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187114    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187120    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187123    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187126    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187128    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:03:15.481739 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187131    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187134    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187137    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187140    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187143    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187145    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187149    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187152    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187155    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187158    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187161    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187163    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.187170    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187331    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:03:15.482487 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187340    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187343    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187346    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187349    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187352    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187355    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187358    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187361    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187364    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187368    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187371    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187374    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187377    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187380    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187383    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187388    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187391    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187393    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187396    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187399    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:03:15.483212 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187402    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187405    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187407    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187410    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187413    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187417    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187436    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187440    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187443    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187446    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187449    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187453    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187457    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187460    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187463    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187466    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187469    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187473    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187477    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:03:15.483938 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187479    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187483    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187486    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187488    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187491    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187494    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187497    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187500    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187504    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187507    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187510    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187513    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187516    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187519    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187522    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187526    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187530    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187533    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187536    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187539    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:03:15.484601 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187543    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187547    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187550    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187553    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187556    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187560    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187563    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187566    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187569    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187572    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187575    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187577    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187580    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187583    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187586    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187589    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187592    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187594    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187597    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187599    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:03:15.694751 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187604    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187607    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187609    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187612    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187615    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187618    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187621    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187624    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187626    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187630    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187633    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187636    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187638    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187642    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187645    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187648    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187651    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187655    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:03:15.695554 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:15.187658    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.187663    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.187830    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.190344    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.191810    2565 server.go:1019] "Starting client certificate rotation"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.191939    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.191993    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.200236    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.201573    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.212925    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.216298    2565 log.go:25] "Validated CRI v1 image API"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.217919    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 18:03:15.696336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.220805    2565 fs.go:135] Filesystem UUIDs: map[1aaacb5e-804d-40fd-8956-cb7b99949858:/dev/nvme0n1p3 6d05e0f6-d7b1-4d88-a2d9-4fe4ad7c812b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 10 18:03:15.696802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.220834    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.228987    2565 manager.go:216] Machine: {Timestamp:2026-07-10 18:03:15.227116877 +0000 UTC m=+0.385834706 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089396 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec247805c2eba00e78ae5ba0ab0f6b6b SystemUUID:ec247805-c2eb-a00e-78ae-5ba0ab0f6b6b BootID:cb5b4bd7-0d55-4290-8c2b-381d83baf6f0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:93:65:fd:3e:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:93:65:fd:3e:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:36:2c:ca:2d:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.229168    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.229322    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.230580    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.230621    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.231427    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.231441    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 18:03:15.697068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.231451    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.232250    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.233597    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.235911    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.237228    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.237464    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.237499    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.237514    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.237526    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.237538    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.237549    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.238034    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.238056    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.240876    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243116    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243166    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243416    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243430    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243440    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243450    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243459    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243466    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243960    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243971    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243989    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.243997    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.244007    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.244015    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.244602    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.244610    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.249144    2565 server.go:1268] "Started kubelet"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.249765    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.250060    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.250835    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.250959    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.251059    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.251124    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.251602    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.252612    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ktwln"
Jul 10 18:03:15.697436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.256673    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.259857    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0ffb2a957f846  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-10 18:03:15.249092678 +0000 UTC m=+0.407810499,LastTimestamp:2026-07-10 18:03:15.249092678 +0000 UTC m=+0.407810499,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.261010    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ktwln"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.261409    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.261430    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.261574    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.262511    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.262527    2565 factory.go:55] Registering systemd factory
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.262536    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.262593    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.263172    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.262728    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.262809    2565 factory.go:153] Registering CRI-O factory
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.263229    2565 factory.go:223] Registration of the crio container factory successfully
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.263261    2565 factory.go:103] Registering Raw factory
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.262700    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.263282    2565 manager.go:1196] Started watching for new ooms in manager
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.263308    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.263316    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.263963    2565 manager.go:349] Starting recovery of all containers
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.274126    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.276085    2565 manager.go:354] Recovery completed
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.277094    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.285115    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.287529    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.287569    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.287584    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.288202    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.288214    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.288236    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.288250    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.289283    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.289314    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.289328    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.289537    2565 policy_none.go:49] "None policy: Start"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.289557    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 18:03:15.698580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.289569    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.290644    2565 policy_none.go:47] "Start"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.331498    2565 manager.go:337] "Starting Device Plugin manager"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.331561    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.331578    2565 server.go:87] "Starting device plugin registration server"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.331932    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.331948    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.332032    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.332139    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.332150    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.332818    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.332880    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.436766    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.438025    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.438058    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.438073    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.438104    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.447140    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.447168    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-41.ec2.internal\": node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.465614    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.521106    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.522614    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.522670    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.522707    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.522795    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.529341    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.566082    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.626861    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"]
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.626983    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.629026    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.629057    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.629067    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.630395    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.630511    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.630542    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.633892    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.633923    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:03:15.699787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.633934    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.633893    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.634018    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.634033    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.635356    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.635404    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.636400    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.636430    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.636441    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.657679    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.662910    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.700935 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.666377    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.765831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.765871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.765891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/daf4e3bb9336c51a7b1e768dcaf8ad41-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"daf4e3bb9336c51a7b1e768dcaf8ad41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.766890    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.866416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.866469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.866491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/daf4e3bb9336c51a7b1e768dcaf8ad41-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"daf4e3bb9336c51a7b1e768dcaf8ad41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.866532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/daf4e3bb9336c51a7b1e768dcaf8ad41-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"daf4e3bb9336c51a7b1e768dcaf8ad41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.866534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.866522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.867529    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.966322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:15.966322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:15.996596 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:15.967689    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:16.068440    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:16.169747    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.191496    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.191717    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.191716    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.265725    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 17:58:15 +0000 UTC" deadline="2028-04-05 09:18:49.627500084 +0000 UTC"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.265761    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15231h15m33.361742522s"
Jul 10 18:03:16.284951 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:16.269866    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:16.491824 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:16.370356    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:16.491824 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:16.473510    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:16.764832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.527442    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:03:16.764832 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:16.562527    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf4e3bb9336c51a7b1e768dcaf8ad41.slice/crio-64b2a084271dbd3ab665a42c90deb1ccaaba3bc78ac6b6b8d257ed05760cad3c WatchSource:0}: Error finding container 64b2a084271dbd3ab665a42c90deb1ccaaba3bc78ac6b6b8d257ed05760cad3c: Status 404 returned error can't find the container with id 64b2a084271dbd3ab665a42c90deb1ccaaba3bc78ac6b6b8d257ed05760cad3c
Jul 10 18:03:16.764832 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:16.564485    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ea56247a743af792af701f2d2e5eef.slice/crio-a8c930160cdc4224e91207e3cecda2152f8792456093d230dc384fcb8d1e887a WatchSource:0}: Error finding container a8c930160cdc4224e91207e3cecda2152f8792456093d230dc384fcb8d1e887a: Status 404 returned error can't find the container with id a8c930160cdc4224e91207e3cecda2152f8792456093d230dc384fcb8d1e887a
Jul 10 18:03:16.764832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.569820    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:03:16.764832 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:16.573751    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 10 18:03:16.764832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.668609    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:03:16.764832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.762835    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:17.005327 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.775313    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:03:17.005327 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.776557    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 10 18:03:17.005327 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:16.786007    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:03:17.255513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.239048    2565 apiserver.go:52] "Watching apiserver"
Jul 10 18:03:17.255513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.249338    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 18:03:17.255513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.250044    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lkmgq","kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal","openshift-multus/multus-xg288","openshift-network-operator/iptables-alerter-hf2vs","openshift-ovn-kubernetes/ovnkube-node-g9tmd","kube-system/konnectivity-agent-62552","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4","openshift-cluster-node-tuning-operator/tuned-stfm9","openshift-dns/node-resolver-dp4kp","openshift-image-registry/node-ca-58vxb","openshift-multus/multus-additional-cni-plugins-f7cvb","openshift-multus/network-metrics-daemon-h67nc","openshift-network-diagnostics/network-check-target-hqksc"]
Jul 10 18:03:17.255513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.253097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.257615 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.256786    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dwl5b\""
Jul 10 18:03:17.257615 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.256792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 18:03:17.257615 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.257103    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 18:03:17.257615 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.257368    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 18:03:17.257615 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.257488    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.260269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.260981    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.260993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kbqb8\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.261006    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.262874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.263037    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.264638    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.270087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.271224    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.271285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sj2zt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.271224    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.272848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.275699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.275831    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.277089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s45xp\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.277468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.277917    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.278157    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.278414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.278502    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.278627    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.278770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.278931    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n8p2z\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279040    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279155    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279207    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279368    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279412    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 18:03:17.335283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-netns\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-conf-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysctl-d\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-kubelet\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279635    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-hostroot\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysconfig\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-host\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-tmp\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-cni-multus\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-etc-kubernetes\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jm7pt\""
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-host-slash\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.279957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-var-lib-kubelet\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.339283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-system-cni-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-iptables-alerter-script\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-device-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-modprobe-d\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-cnibin\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-os-release\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-socket-dir-parent\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-multus-certs\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-kubernetes\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysctl-conf\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-lib-modules\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.280970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-tuned\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b75791fd-840a-4528-9f09-a2cff62bf90a-konnectivity-ca\") pod \"konnectivity-agent-62552\" (UID: \"b75791fd-840a-4528-9f09-a2cff62bf90a\") " pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-cni-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.340225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17966e87-b173-49bf-adcc-9f65e446ceed-cni-binary-copy\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17966e87-b173-49bf-adcc-9f65e446ceed-multus-daemon-config\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-socket-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-systemd\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-cni-bin\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7p2m\" (UniqueName: \"kubernetes.io/projected/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-kube-api-access-g7p2m\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-registration-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-sys-fs\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-run\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-sys\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwbhg\" (UniqueName: \"kubernetes.io/projected/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-kube-api-access-vwbhg\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnrjz\" (UniqueName: \"kubernetes.io/projected/17966e87-b173-49bf-adcc-9f65e446ceed-kube-api-access-fnrjz\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.341631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9k6s\" (UniqueName: \"kubernetes.io/projected/a43a1088-70ad-4d14-80c7-ba929717e496-kube-api-access-s9k6s\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b75791fd-840a-4528-9f09-a2cff62bf90a-agent-certs\") pod \"konnectivity-agent-62552\" (UID: \"b75791fd-840a-4528-9f09-a2cff62bf90a\") " pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.281982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-k8s-cni-cncf-io\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.282745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.285494    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.285895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.291444    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.326932    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-px75d"
Jul 10 18:03:17.342340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.326957    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-px75d"
Jul 10 18:03:17.383792 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7p2m\" (UniqueName: \"kubernetes.io/projected/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-kube-api-access-g7p2m\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.383792 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-kubelet-config\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.384007 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-registration-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.384007 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-sys-fs\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.384007 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-run\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384007 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-sys\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384007 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwbhg\" (UniqueName: \"kubernetes.io/projected/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-kube-api-access-vwbhg\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384007 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.383971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnrjz\" (UniqueName: \"kubernetes.io/projected/17966e87-b173-49bf-adcc-9f65e446ceed-kube-api-access-fnrjz\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9k6s\" (UniqueName: \"kubernetes.io/projected/a43a1088-70ad-4d14-80c7-ba929717e496-kube-api-access-s9k6s\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b75791fd-840a-4528-9f09-a2cff62bf90a-agent-certs\") pod \"konnectivity-agent-62552\" (UID: \"b75791fd-840a-4528-9f09-a2cff62bf90a\") " pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-k8s-cni-cncf-io\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-netns\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-conf-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysctl-d\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-kubelet\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-hostroot\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-dbus\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysconfig\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-host\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-tmp\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-cni-multus\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-etc-kubernetes\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-host-slash\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-var-lib-kubelet\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-system-cni-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-iptables-alerter-script\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.384730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-device-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-modprobe-d\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-cnibin\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-os-release\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-socket-dir-parent\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-multus-certs\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-kubernetes\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysctl-conf\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.384984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-lib-modules\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-tuned\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b75791fd-840a-4528-9f09-a2cff62bf90a-konnectivity-ca\") pod \"konnectivity-agent-62552\" (UID: \"b75791fd-840a-4528-9f09-a2cff62bf90a\") " pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-cni-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17966e87-b173-49bf-adcc-9f65e446ceed-cni-binary-copy\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17966e87-b173-49bf-adcc-9f65e446ceed-multus-daemon-config\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.385959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-socket-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.385959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-systemd\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.385959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-cni-bin\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-cni-bin\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.385959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-sys-fs\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.385959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-run\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.385959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.385785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-sys\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.388997    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pn24c\""
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.389487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysctl-conf\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.389642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.389673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-modprobe-d\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.389806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-var-lib-kubelet\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.389879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-device-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.389978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390083    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-socket-dir-parent\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-cnibin\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b75791fd-840a-4528-9f09-a2cff62bf90a-konnectivity-ca\") pod \"konnectivity-agent-62552\" (UID: \"b75791fd-840a-4528-9f09-a2cff62bf90a\") " pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390588    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-cni-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-os-release\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-iptables-alerter-script\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-system-cni-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.391031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-systemd\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.390998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-socket-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-host-slash\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a43a1088-70ad-4d14-80c7-ba929717e496-registration-dir\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-multus-certs\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17966e87-b173-49bf-adcc-9f65e446ceed-multus-daemon-config\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17966e87-b173-49bf-adcc-9f65e446ceed-cni-binary-copy\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-kubelet\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-netns\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-lib-modules\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.392059 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-run-k8s-cni-cncf-io\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.394237 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.394056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.394237 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.394202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-host-var-lib-cni-multus\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.394237 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.394228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-tuned\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.394489 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.391536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-multus-conf-dir\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.396185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.394803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysctl-d\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.396185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.394874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-host\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.396185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.395106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-sysconfig\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.396185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.395292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-hostroot\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.396185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.395329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-etc-kubernetes\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.396185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.395448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17966e87-b173-49bf-adcc-9f65e446ceed-etc-kubernetes\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.399333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.398874    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 18:03:17.399333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.399128    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 18:03:17.399333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.399189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7p2m\" (UniqueName: \"kubernetes.io/projected/20a3a91d-5b91-4bcc-b886-7c08a966c8b1-kube-api-access-g7p2m\") pod \"iptables-alerter-hf2vs\" (UID: \"20a3a91d-5b91-4bcc-b886-7c08a966c8b1\") " pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.399592 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.399350    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 18:03:17.399655 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.399610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.400044 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.399837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-68kwh\""
Jul 10 18:03:17.400044 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.399897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b75791fd-840a-4528-9f09-a2cff62bf90a-agent-certs\") pod \"konnectivity-agent-62552\" (UID: \"b75791fd-840a-4528-9f09-a2cff62bf90a\") " pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.409279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.402529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-tmp\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.409279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.406423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnrjz\" (UniqueName: \"kubernetes.io/projected/17966e87-b173-49bf-adcc-9f65e446ceed-kube-api-access-fnrjz\") pod \"multus-xg288\" (UID: \"17966e87-b173-49bf-adcc-9f65e446ceed\") " pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.409279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.407328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwbhg\" (UniqueName: \"kubernetes.io/projected/0ed971bc-c8c1-4ab0-930d-24fdb447dfa2-kube-api-access-vwbhg\") pod \"tuned-stfm9\" (UID: \"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2\") " pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.409279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.407459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dz8t5\""
Jul 10 18:03:17.409279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.407686    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 18:03:17.409279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.407860    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 18:03:17.409754 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.409452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9k6s\" (UniqueName: \"kubernetes.io/projected/a43a1088-70ad-4d14-80c7-ba929717e496-kube-api-access-s9k6s\") pod \"aws-ebs-csi-driver-node-d7jp4\" (UID: \"a43a1088-70ad-4d14-80c7-ba929717e496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.410278 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.410250    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:17.410665 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.410636    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:17.414953 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.414927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:17.415215 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.415189    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:17.429399 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.429367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hf2vs"
Jul 10 18:03:17.448093 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:17.447901    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a3a91d_5b91_4bcc_b886_7c08a966c8b1.slice/crio-83837bfa4367c63ae44af62f01d51c50fed6c0477017b45495a37a3ff7fde0b3 WatchSource:0}: Error finding container 83837bfa4367c63ae44af62f01d51c50fed6c0477017b45495a37a3ff7fde0b3: Status 404 returned error can't find the container with id 83837bfa4367c63ae44af62f01d51c50fed6c0477017b45495a37a3ff7fde0b3
Jul 10 18:03:17.465210 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.465179    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 18:03:17.474443 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.474407    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:03:17.485834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.485795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/411a9b95-29e8-4e06-a2bf-771e3a6507d9-hosts-file\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.486049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.485847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-systemd\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.485888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-node-log\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.485917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.486049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.485947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-slash\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.485974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/741e0c1d-a790-453a-8222-93dacf76c03c-serviceca\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.486049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vclwz\" (UniqueName: \"kubernetes.io/projected/9a47b623-fe71-4336-b9e7-a68d1e38a9db-kube-api-access-vclwz\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/741e0c1d-a790-453a-8222-93dacf76c03c-host\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-cni-netd\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-var-lib-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-cni-bin\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cnibin\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a9b95-29e8-4e06-a2bf-771e3a6507d9-tmp-dir\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-kubelet\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.486425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-system-cni-dir\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-dbus\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-run-netns\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xklxw\" (UniqueName: \"kubernetes.io/projected/411a9b95-29e8-4e06-a2bf-771e3a6507d9-kube-api-access-xklxw\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-etc-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-ovn\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.486909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-env-overrides\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovnkube-script-lib\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrlf\" (UniqueName: \"kubernetes.io/projected/37698526-7a93-4eb5-b448-eaf8bde7fd7e-kube-api-access-lhrlf\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-dbus\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovn-node-metrics-cert\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-os-release\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-systemd-units\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-log-socket\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-kubelet-config\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovnkube-config\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.487634 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-kubelet-config\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.488169 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6gf\" (UniqueName: \"kubernetes.io/projected/dd67c2f8-794d-4d25-80a3-75acecb9e39e-kube-api-access-7d6gf\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.488169 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.487714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmdc\" (UniqueName: \"kubernetes.io/projected/741e0c1d-a790-453a-8222-93dacf76c03c-kube-api-access-ghmdc\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.530746 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.530621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hf2vs" event={"ID":"20a3a91d-5b91-4bcc-b886-7c08a966c8b1","Type":"ContainerStarted","Data":"83837bfa4367c63ae44af62f01d51c50fed6c0477017b45495a37a3ff7fde0b3"}
Jul 10 18:03:17.532478 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.532437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerStarted","Data":"a8c930160cdc4224e91207e3cecda2152f8792456093d230dc384fcb8d1e887a"}
Jul 10 18:03:17.534031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.533997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" event={"ID":"daf4e3bb9336c51a7b1e768dcaf8ad41","Type":"ContainerStarted","Data":"64b2a084271dbd3ab665a42c90deb1ccaaba3bc78ac6b6b8d257ed05760cad3c"}
Jul 10 18:03:17.575037 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.574736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4"
Jul 10 18:03:17.588869 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.588828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/411a9b95-29e8-4e06-a2bf-771e3a6507d9-hosts-file\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.588886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-systemd\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.588918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-node-log\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.588948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.588966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/411a9b95-29e8-4e06-a2bf-771e3a6507d9-hosts-file\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-systemd\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-slash\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.588979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-slash\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-node-log\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/741e0c1d-a790-453a-8222-93dacf76c03c-serviceca\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vclwz\" (UniqueName: \"kubernetes.io/projected/9a47b623-fe71-4336-b9e7-a68d1e38a9db-kube-api-access-vclwz\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/741e0c1d-a790-453a-8222-93dacf76c03c-host\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/741e0c1d-a790-453a-8222-93dacf76c03c-host\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-cni-netd\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589321    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-var-lib-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-cni-bin\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589436    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cnibin\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a9b95-29e8-4e06-a2bf-771e3a6507d9-tmp-dir\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-kubelet\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.589638 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-system-cni-dir\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-run-netns\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/741e0c1d-a790-453a-8222-93dacf76c03c-serviceca\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xklxw\" (UniqueName: \"kubernetes.io/projected/411a9b95-29e8-4e06-a2bf-771e3a6507d9-kube-api-access-xklxw\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-etc-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-ovn\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-env-overrides\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovnkube-script-lib\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrlf\" (UniqueName: \"kubernetes.io/projected/37698526-7a93-4eb5-b448-eaf8bde7fd7e-kube-api-access-lhrlf\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovn-node-metrics-cert\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.589993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-os-release\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-systemd-units\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-log-socket\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovnkube-config\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6gf\" (UniqueName: \"kubernetes.io/projected/dd67c2f8-794d-4d25-80a3-75acecb9e39e-kube-api-access-7d6gf\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmdc\" (UniqueName: \"kubernetes.io/projected/741e0c1d-a790-453a-8222-93dacf76c03c-kube-api-access-ghmdc\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-systemd-units\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590551    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-log-socket\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovnkube-script-lib\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd67c2f8-794d-4d25-80a3-75acecb9e39e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.590940 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.590809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-cni-netd\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.591018    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovnkube-config\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.591114    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs podName:9a47b623-fe71-4336-b9e7-a68d1e38a9db nodeName:}" failed. No retries permitted until 2026-07-10 18:03:18.091070996 +0000 UTC m=+3.249788825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs") pod "network-metrics-daemon-h67nc" (UID: "9a47b623-fe71-4336-b9e7-a68d1e38a9db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-os-release\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-var-lib-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-system-cni-dir\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-cni-bin\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.591371    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.591418    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret podName:dc3cf1fc-a022-4cdc-8aba-146d23d84f5a nodeName:}" failed. No retries permitted until 2026-07-10 18:03:18.091401314 +0000 UTC m=+3.250119128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret") pod "global-pull-secret-syncer-lkmgq" (UID: "dc3cf1fc-a022-4cdc-8aba-146d23d84f5a") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd67c2f8-794d-4d25-80a3-75acecb9e39e-cnibin\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-run-netns\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.591575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-etc-openvswitch\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.592469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-host-kubelet\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.592469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37698526-7a93-4eb5-b448-eaf8bde7fd7e-run-ovn\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.592469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.591804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/411a9b95-29e8-4e06-a2bf-771e3a6507d9-tmp-dir\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.592469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.592195    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37698526-7a93-4eb5-b448-eaf8bde7fd7e-env-overrides\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.592469 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:17.592234    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43a1088_70ad_4d14_80c7_ba929717e496.slice/crio-08464f0a5accbe1429726b3927de90900a72a00f33492d175d02db8ce050e9fe WatchSource:0}: Error finding container 08464f0a5accbe1429726b3927de90900a72a00f33492d175d02db8ce050e9fe: Status 404 returned error can't find the container with id 08464f0a5accbe1429726b3927de90900a72a00f33492d175d02db8ce050e9fe
Jul 10 18:03:17.594140 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.594115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37698526-7a93-4eb5-b448-eaf8bde7fd7e-ovn-node-metrics-cert\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.600276 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.600247    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:03:17.600404 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.600282    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:03:17.600404 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.600299    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hzdfq for pod openshift-network-diagnostics/network-check-target-hqksc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:17.600404 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:17.600373    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq podName:8547ac92-2602-4a73-8d2d-41acf5cc91d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:03:18.100346806 +0000 UTC m=+3.259064623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hzdfq" (UniqueName: "kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq") pod "network-check-target-hqksc" (UID: "8547ac92-2602-4a73-8d2d-41acf5cc91d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:17.604991 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.604954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrlf\" (UniqueName: \"kubernetes.io/projected/37698526-7a93-4eb5-b448-eaf8bde7fd7e-kube-api-access-lhrlf\") pod \"ovnkube-node-g9tmd\" (UID: \"37698526-7a93-4eb5-b448-eaf8bde7fd7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.605141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.605032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vclwz\" (UniqueName: \"kubernetes.io/projected/9a47b623-fe71-4336-b9e7-a68d1e38a9db-kube-api-access-vclwz\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:17.605510 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.605484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xklxw\" (UniqueName: \"kubernetes.io/projected/411a9b95-29e8-4e06-a2bf-771e3a6507d9-kube-api-access-xklxw\") pod \"node-resolver-dp4kp\" (UID: \"411a9b95-29e8-4e06-a2bf-771e3a6507d9\") " pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.606042 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.606011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6gf\" (UniqueName: \"kubernetes.io/projected/dd67c2f8-794d-4d25-80a3-75acecb9e39e-kube-api-access-7d6gf\") pod \"multus-additional-cni-plugins-f7cvb\" (UID: \"dd67c2f8-794d-4d25-80a3-75acecb9e39e\") " pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:17.607244 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.607219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmdc\" (UniqueName: \"kubernetes.io/projected/741e0c1d-a790-453a-8222-93dacf76c03c-kube-api-access-ghmdc\") pod \"node-ca-58vxb\" (UID: \"741e0c1d-a790-453a-8222-93dacf76c03c\") " pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.628353 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.628310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-stfm9"
Jul 10 18:03:17.639007 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:17.638963    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed971bc_c8c1_4ab0_930d_24fdb447dfa2.slice/crio-55328be487b118e5c7f732da8a830a82ca845d17e9fe33eea5d67548e2761bb7 WatchSource:0}: Error finding container 55328be487b118e5c7f732da8a830a82ca845d17e9fe33eea5d67548e2761bb7: Status 404 returned error can't find the container with id 55328be487b118e5c7f732da8a830a82ca845d17e9fe33eea5d67548e2761bb7
Jul 10 18:03:17.686555 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.686505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xg288"
Jul 10 18:03:17.686555 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.686534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:17.738883 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.738850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:17.747858 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.747821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dp4kp"
Jul 10 18:03:17.756019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.755984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-58vxb"
Jul 10 18:03:17.763312 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:17.763276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f7cvb"
Jul 10 18:03:18.094659 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.094592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:18.094873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.094702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:18.094941 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.094873    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:18.094941 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.094891    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:18.095011 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.094966    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs podName:9a47b623-fe71-4336-b9e7-a68d1e38a9db nodeName:}" failed. No retries permitted until 2026-07-10 18:03:19.094940779 +0000 UTC m=+4.253658590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs") pod "network-metrics-daemon-h67nc" (UID: "9a47b623-fe71-4336-b9e7-a68d1e38a9db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:18.095011 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.094990    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret podName:dc3cf1fc-a022-4cdc-8aba-146d23d84f5a nodeName:}" failed. No retries permitted until 2026-07-10 18:03:19.094978537 +0000 UTC m=+4.253696359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret") pod "global-pull-secret-syncer-lkmgq" (UID: "dc3cf1fc-a022-4cdc-8aba-146d23d84f5a") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:18.195704 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.195616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:18.195929 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.195829    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:03:18.195929 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.195852    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:03:18.195929 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.195867    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hzdfq for pod openshift-network-diagnostics/network-check-target-hqksc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:18.196117 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.195940    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq podName:8547ac92-2602-4a73-8d2d-41acf5cc91d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:03:19.195918781 +0000 UTC m=+4.354636606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzdfq" (UniqueName: "kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq") pod "network-check-target-hqksc" (UID: "8547ac92-2602-4a73-8d2d-41acf5cc91d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:18.391534 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.391407    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:58:17 +0000 UTC" deadline="2027-12-16 20:27:57.548220646 +0000 UTC"
Jul 10 18:03:18.391534 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.391457    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12578h24m39.156768669s"
Jul 10 18:03:18.524110 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.524055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:18.524301 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.524231    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:18.524364 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.524295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:18.524464 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:18.524431    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:18.538233 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.538140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-stfm9" event={"ID":"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2","Type":"ContainerStarted","Data":"55328be487b118e5c7f732da8a830a82ca845d17e9fe33eea5d67548e2761bb7"}
Jul 10 18:03:18.539586 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:18.539541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4" event={"ID":"a43a1088-70ad-4d14-80c7-ba929717e496","Type":"ContainerStarted","Data":"08464f0a5accbe1429726b3927de90900a72a00f33492d175d02db8ce050e9fe"}
Jul 10 18:03:18.909662 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:18.909608    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741e0c1d_a790_453a_8222_93dacf76c03c.slice/crio-46456aba9fee12fbdb6f824ea7187f04a63c9ba33dcfec1cf4b7ad6a1fec3546 WatchSource:0}: Error finding container 46456aba9fee12fbdb6f824ea7187f04a63c9ba33dcfec1cf4b7ad6a1fec3546: Status 404 returned error can't find the container with id 46456aba9fee12fbdb6f824ea7187f04a63c9ba33dcfec1cf4b7ad6a1fec3546
Jul 10 18:03:18.914120 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:18.914072    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17966e87_b173_49bf_adcc_9f65e446ceed.slice/crio-06330694fc0540e42175499c1e4a20a36af66229c698d5ef167702e97c842da4 WatchSource:0}: Error finding container 06330694fc0540e42175499c1e4a20a36af66229c698d5ef167702e97c842da4: Status 404 returned error can't find the container with id 06330694fc0540e42175499c1e4a20a36af66229c698d5ef167702e97c842da4
Jul 10 18:03:18.917027 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:18.916997    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75791fd_840a_4528_9f09_a2cff62bf90a.slice/crio-dc9a24504dd74357ca83560875b0c4c1ba63f878e685c24e059f450ff15c14ea WatchSource:0}: Error finding container dc9a24504dd74357ca83560875b0c4c1ba63f878e685c24e059f450ff15c14ea: Status 404 returned error can't find the container with id dc9a24504dd74357ca83560875b0c4c1ba63f878e685c24e059f450ff15c14ea
Jul 10 18:03:18.941210 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:18.941171    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411a9b95_29e8_4e06_a2bf_771e3a6507d9.slice/crio-976e46e231373990b50c207143fc2dab83f53c76349a7475305bfa8c4d6b71b9 WatchSource:0}: Error finding container 976e46e231373990b50c207143fc2dab83f53c76349a7475305bfa8c4d6b71b9: Status 404 returned error can't find the container with id 976e46e231373990b50c207143fc2dab83f53c76349a7475305bfa8c4d6b71b9
Jul 10 18:03:18.941776 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:18.941746    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37698526_7a93_4eb5_b448_eaf8bde7fd7e.slice/crio-eaa44af1fed3454ac4ab8fd314cf82c36cf7e630098fe55a07378265733a843b WatchSource:0}: Error finding container eaa44af1fed3454ac4ab8fd314cf82c36cf7e630098fe55a07378265733a843b: Status 404 returned error can't find the container with id eaa44af1fed3454ac4ab8fd314cf82c36cf7e630098fe55a07378265733a843b
Jul 10 18:03:18.943159 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:03:18.943116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd67c2f8_794d_4d25_80a3_75acecb9e39e.slice/crio-25ef9658b52c3e425fa08483eff94ad7f39122f527837fc087a3b93f2a2cdf53 WatchSource:0}: Error finding container 25ef9658b52c3e425fa08483eff94ad7f39122f527837fc087a3b93f2a2cdf53: Status 404 returned error can't find the container with id 25ef9658b52c3e425fa08483eff94ad7f39122f527837fc087a3b93f2a2cdf53
Jul 10 18:03:19.104966 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.104622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:19.105163 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.105054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:19.105228 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.104945    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:19.105303 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.105263    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret podName:dc3cf1fc-a022-4cdc-8aba-146d23d84f5a nodeName:}" failed. No retries permitted until 2026-07-10 18:03:21.105243584 +0000 UTC m=+6.263961407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret") pod "global-pull-secret-syncer-lkmgq" (UID: "dc3cf1fc-a022-4cdc-8aba-146d23d84f5a") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:19.105654 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.105189    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:19.105809 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.105702    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs podName:9a47b623-fe71-4336-b9e7-a68d1e38a9db nodeName:}" failed. No retries permitted until 2026-07-10 18:03:21.105683909 +0000 UTC m=+6.264401731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs") pod "network-metrics-daemon-h67nc" (UID: "9a47b623-fe71-4336-b9e7-a68d1e38a9db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:19.205909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.205805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:19.206091 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.206045    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:03:19.206091 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.206071    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:03:19.206091 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.206085    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hzdfq for pod openshift-network-diagnostics/network-check-target-hqksc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:19.206283 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.206155    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq podName:8547ac92-2602-4a73-8d2d-41acf5cc91d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:03:21.206133742 +0000 UTC m=+6.364851553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzdfq" (UniqueName: "kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq") pod "network-check-target-hqksc" (UID: "8547ac92-2602-4a73-8d2d-41acf5cc91d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:19.392087 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.392016    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:58:17 +0000 UTC" deadline="2027-12-21 21:26:22.696450231 +0000 UTC"
Jul 10 18:03:19.392087 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.392073    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12699h23m3.304382946s"
Jul 10 18:03:19.523898 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.523765    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:19.524109 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:19.523976    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:19.544005 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.543959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"eaa44af1fed3454ac4ab8fd314cf82c36cf7e630098fe55a07378265733a843b"}
Jul 10 18:03:19.545892 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.545847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xg288" event={"ID":"17966e87-b173-49bf-adcc-9f65e446ceed","Type":"ContainerStarted","Data":"06330694fc0540e42175499c1e4a20a36af66229c698d5ef167702e97c842da4"}
Jul 10 18:03:19.547408 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.547354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-58vxb" event={"ID":"741e0c1d-a790-453a-8222-93dacf76c03c","Type":"ContainerStarted","Data":"46456aba9fee12fbdb6f824ea7187f04a63c9ba33dcfec1cf4b7ad6a1fec3546"}
Jul 10 18:03:19.549263 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.549219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerStarted","Data":"25ef9658b52c3e425fa08483eff94ad7f39122f527837fc087a3b93f2a2cdf53"}
Jul 10 18:03:19.550741 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.550689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dp4kp" event={"ID":"411a9b95-29e8-4e06-a2bf-771e3a6507d9","Type":"ContainerStarted","Data":"976e46e231373990b50c207143fc2dab83f53c76349a7475305bfa8c4d6b71b9"}
Jul 10 18:03:19.552445 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:19.552398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-62552" event={"ID":"b75791fd-840a-4528-9f09-a2cff62bf90a","Type":"ContainerStarted","Data":"dc9a24504dd74357ca83560875b0c4c1ba63f878e685c24e059f450ff15c14ea"}
Jul 10 18:03:20.523965 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:20.523868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:20.524459 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:20.524016    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:20.524459 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:20.524446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:20.524595 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:20.524547    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:20.566742 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:20.566687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerStarted","Data":"bd3e78371fe8b43019c0c03b2ef68f8da6d12bc4ab3833f2c6b604c98e9842a7"}
Jul 10 18:03:20.580682 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:20.580633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" event={"ID":"daf4e3bb9336c51a7b1e768dcaf8ad41","Type":"ContainerStarted","Data":"cf98aacafc74eda4990f448002a9b081ce1887eb587b586219f18f5a352eadbc"}
Jul 10 18:03:21.126544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:21.126156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:21.126544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:21.126248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:21.126544 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.126385    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:21.126544 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.126424    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:21.126544 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.126491    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret podName:dc3cf1fc-a022-4cdc-8aba-146d23d84f5a nodeName:}" failed. No retries permitted until 2026-07-10 18:03:25.126466003 +0000 UTC m=+10.285183816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret") pod "global-pull-secret-syncer-lkmgq" (UID: "dc3cf1fc-a022-4cdc-8aba-146d23d84f5a") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:21.126544 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.126512    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs podName:9a47b623-fe71-4336-b9e7-a68d1e38a9db nodeName:}" failed. No retries permitted until 2026-07-10 18:03:25.126501263 +0000 UTC m=+10.285219084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs") pod "network-metrics-daemon-h67nc" (UID: "9a47b623-fe71-4336-b9e7-a68d1e38a9db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:21.228484 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:21.227682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:21.228484 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.227930    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:03:21.228484 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.227956    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:03:21.228484 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.227970    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hzdfq for pod openshift-network-diagnostics/network-check-target-hqksc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:21.228484 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.228033    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq podName:8547ac92-2602-4a73-8d2d-41acf5cc91d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:03:25.22801261 +0000 UTC m=+10.386730422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzdfq" (UniqueName: "kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq") pod "network-check-target-hqksc" (UID: "8547ac92-2602-4a73-8d2d-41acf5cc91d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:21.524611 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:21.524169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:21.524611 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:21.524325    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:22.523958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:22.523797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:22.523958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:22.523844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:22.523958 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:22.523945    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:22.524408 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:22.524353    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:23.523543 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:23.523503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:23.524043 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:23.523677    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:23.592479 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:23.592429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dp4kp" event={"ID":"411a9b95-29e8-4e06-a2bf-771e3a6507d9","Type":"ContainerStarted","Data":"5ba1e23aea4904e62c82c648990f23f225a5cc438f03531c3b8eac3a6ec01a21"}
Jul 10 18:03:23.609574 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:23.609500    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dp4kp" podStartSLOduration=6.580631324 podStartE2EDuration="7.609476712s" totalImagesPullingTime="1.028845388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:23.608814214 +0000 UTC m=+8.767532040" watchObservedRunningTime="2026-07-10 18:03:23.609476712 +0000 UTC m=+8.768194538"
Jul 10 18:03:23.610132 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:23.610086    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" podStartSLOduration=6.6100693459999995 podStartE2EDuration="6.610069346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:20.605412144 +0000 UTC m=+5.764129975" watchObservedRunningTime="2026-07-10 18:03:23.610069346 +0000 UTC m=+8.768787172"
Jul 10 18:03:24.522917 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:24.522888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:24.523109 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:24.523027    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:24.523391 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:24.523228    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:24.523391 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:24.523338    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:24.597048 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:24.596740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hf2vs" event={"ID":"20a3a91d-5b91-4bcc-b886-7c08a966c8b1","Type":"ContainerStarted","Data":"fa3ffefdb9df0827a9f585ab56cea687bfd6c180f3da1ba317bb1cbc9c78c75e"}
Jul 10 18:03:24.615363 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:24.615294    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hf2vs" podStartSLOduration=6.093122826 podStartE2EDuration="8.615269551s" totalImagesPullingTime="2.522146725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:24.615007338 +0000 UTC m=+9.773725165" watchObservedRunningTime="2026-07-10 18:03:24.615269551 +0000 UTC m=+9.773987379"
Jul 10 18:03:25.163779 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:25.163734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:25.163974 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:25.163822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:25.164026 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.163975    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:25.164065 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.164042    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret podName:dc3cf1fc-a022-4cdc-8aba-146d23d84f5a nodeName:}" failed. No retries permitted until 2026-07-10 18:03:33.16402228 +0000 UTC m=+18.322740087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret") pod "global-pull-secret-syncer-lkmgq" (UID: "dc3cf1fc-a022-4cdc-8aba-146d23d84f5a") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:25.164291 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.164268    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:25.164396 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.164334    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs podName:9a47b623-fe71-4336-b9e7-a68d1e38a9db nodeName:}" failed. No retries permitted until 2026-07-10 18:03:33.164318954 +0000 UTC m=+18.323036760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs") pod "network-metrics-daemon-h67nc" (UID: "9a47b623-fe71-4336-b9e7-a68d1e38a9db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:25.265236 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:25.264871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:25.265236 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.265106    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:03:25.265236 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.265133    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:03:25.265236 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.265146    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hzdfq for pod openshift-network-diagnostics/network-check-target-hqksc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:25.265236 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.265214    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq podName:8547ac92-2602-4a73-8d2d-41acf5cc91d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:03:33.265191454 +0000 UTC m=+18.423909282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzdfq" (UniqueName: "kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq") pod "network-check-target-hqksc" (UID: "8547ac92-2602-4a73-8d2d-41acf5cc91d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:25.524661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:25.524521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:25.524845 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:25.524670    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:25.600676 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:25.600617    2565 generic.go:356] "Generic (PLEG): container finished" podID="14ea56247a743af792af701f2d2e5eef" containerID="bd3e78371fe8b43019c0c03b2ef68f8da6d12bc4ab3833f2c6b604c98e9842a7" exitCode=0
Jul 10 18:03:25.601148 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:25.600713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerDied","Data":"bd3e78371fe8b43019c0c03b2ef68f8da6d12bc4ab3833f2c6b604c98e9842a7"}
Jul 10 18:03:26.523345 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:26.523304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:26.523517 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:26.523315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:26.523517 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:26.523465    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:26.523517 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:26.523488    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:27.523582 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:27.523084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:27.523582 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:27.523224    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:28.523146 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:28.523104    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:28.523398 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:28.523244    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:28.523398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:28.523311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:28.523516 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:28.523440    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:29.523287 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:29.523097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:29.523287 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:29.523259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:30.523248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:30.523201    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:30.523456 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:30.523202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:30.523456 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:30.523347    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:30.523456 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:30.523426    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:31.523514 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:31.523435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:31.523947 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:31.523657    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:32.522938 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:32.522901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:32.523174 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:32.522902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:32.523174 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:32.523035    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:32.523174 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:32.523080    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:33.231538 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:33.231496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:33.232010 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:33.231570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:33.232010 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.231729    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:33.232010 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.231734    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:33.232010 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.231799    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret podName:dc3cf1fc-a022-4cdc-8aba-146d23d84f5a nodeName:}" failed. No retries permitted until 2026-07-10 18:03:49.231779304 +0000 UTC m=+34.390497130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret") pod "global-pull-secret-syncer-lkmgq" (UID: "dc3cf1fc-a022-4cdc-8aba-146d23d84f5a") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:33.232010 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.231816    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs podName:9a47b623-fe71-4336-b9e7-a68d1e38a9db nodeName:}" failed. No retries permitted until 2026-07-10 18:03:49.231808757 +0000 UTC m=+34.390526566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs") pod "network-metrics-daemon-h67nc" (UID: "9a47b623-fe71-4336-b9e7-a68d1e38a9db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:33.332884 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:33.332844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:33.333073 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.333038    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:03:33.333073 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.333064    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:03:33.333191 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.333080    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hzdfq for pod openshift-network-diagnostics/network-check-target-hqksc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:33.333191 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.333160    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq podName:8547ac92-2602-4a73-8d2d-41acf5cc91d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:03:49.333138403 +0000 UTC m=+34.491856223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzdfq" (UniqueName: "kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq") pod "network-check-target-hqksc" (UID: "8547ac92-2602-4a73-8d2d-41acf5cc91d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:33.524162 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:33.524073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:33.524324 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:33.524214    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:34.523719 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:34.523678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:34.524187 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:34.523690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:34.524187 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:34.523822    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:34.524187 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:34.523868    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:35.524470 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:35.524427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:35.524968 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:35.524537    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:36.523187 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:36.523151    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:36.523354 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:36.523292    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:36.523354 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:36.523334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:36.523446 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:36.523428    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:37.524220 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.523956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:37.525011 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:37.524342    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:37.627403 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.627310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-stfm9" event={"ID":"0ed971bc-c8c1-4ab0-930d-24fdb447dfa2","Type":"ContainerStarted","Data":"a36720a67f901af55d4de2da033b444a7cf1045d8176d0abd588562602e6eeb6"}
Jul 10 18:03:37.630664 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.630597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4" event={"ID":"a43a1088-70ad-4d14-80c7-ba929717e496","Type":"ContainerStarted","Data":"4c444e4b190ae325748a17ebd73a1e70ae2314dd38d02b9fbca28e0edf73fd7b"}
Jul 10 18:03:37.633262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.633227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:03:37.633717 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.633685    2565 generic.go:356] "Generic (PLEG): container finished" podID="37698526-7a93-4eb5-b448-eaf8bde7fd7e" containerID="ab94946c9c31dab381fa9ee87c00e62ffe69702e00011eff695cc3159882d593" exitCode=1
Jul 10 18:03:37.633865 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.633765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"2fcaf39d29053dfc288fd206fc77d8bfe88b9db5fa044766235e967e9fcab243"}
Jul 10 18:03:37.633932 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.633886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerDied","Data":"ab94946c9c31dab381fa9ee87c00e62ffe69702e00011eff695cc3159882d593"}
Jul 10 18:03:37.633972 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.633950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"dd623f5a26472a0bfbf7bb393544f65ec4f9f28f35aaa2e26f102cf22ab56bc4"}
Jul 10 18:03:37.635390 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.635355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xg288" event={"ID":"17966e87-b173-49bf-adcc-9f65e446ceed","Type":"ContainerStarted","Data":"b7841444291fbf48ca82f420e5212ddd23d134f527e16340bb9c6a796592cd22"}
Jul 10 18:03:37.637175 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.637142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-58vxb" event={"ID":"741e0c1d-a790-453a-8222-93dacf76c03c","Type":"ContainerStarted","Data":"5ba182942dfa3730b7e96f89654da40bc1582cac66e8b848d98282715e83c75f"}
Jul 10 18:03:37.639394 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.639368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerStarted","Data":"3eb1b33fef65710de40e33b5eb68c47ee204957a6f179daa4de64a314f325e49"}
Jul 10 18:03:37.641357 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.641327    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd67c2f8-794d-4d25-80a3-75acecb9e39e" containerID="d1674fb4939dc79d20d84598b6e340888e462690d98a1adbdfa1af60b9ba1bda" exitCode=0
Jul 10 18:03:37.641515 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.641419    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerDied","Data":"d1674fb4939dc79d20d84598b6e340888e462690d98a1adbdfa1af60b9ba1bda"}
Jul 10 18:03:37.643036 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.643010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-62552" event={"ID":"b75791fd-840a-4528-9f09-a2cff62bf90a","Type":"ContainerStarted","Data":"dbddf5e199b1dd123ec9a75df3e37676a165bdd89f6d3732d3b089ed4a36022e"}
Jul 10 18:03:37.646027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.645968    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-stfm9" podStartSLOduration=3.385479528 podStartE2EDuration="22.645922956s" totalImagesPullingTime="19.260443428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:37.645115695 +0000 UTC m=+22.803833559" watchObservedRunningTime="2026-07-10 18:03:37.645922956 +0000 UTC m=+22.804640780"
Jul 10 18:03:37.660903 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.660843    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" podStartSLOduration=20.660822531 podStartE2EDuration="20.660822531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:37.660541953 +0000 UTC m=+22.819259779" watchObservedRunningTime="2026-07-10 18:03:37.660822531 +0000 UTC m=+22.819540349"
Jul 10 18:03:37.677955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.677900    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-62552" podStartSLOduration=3.740853373 podStartE2EDuration="21.677883208s" totalImagesPullingTime="17.937029835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:37.677349183 +0000 UTC m=+22.836067008" watchObservedRunningTime="2026-07-10 18:03:37.677883208 +0000 UTC m=+22.836601045"
Jul 10 18:03:37.708983 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.708926    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xg288" podStartSLOduration=3.7369534189999998 podStartE2EDuration="21.708909555s" totalImagesPullingTime="17.971956136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:37.694322335 +0000 UTC m=+22.853040161" watchObservedRunningTime="2026-07-10 18:03:37.708909555 +0000 UTC m=+22.867627379"
Jul 10 18:03:37.709399 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.709372    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-58vxb" podStartSLOduration=3.721975001 podStartE2EDuration="21.70936481s" totalImagesPullingTime="17.987389809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:37.708625698 +0000 UTC m=+22.867343524" watchObservedRunningTime="2026-07-10 18:03:37.70936481 +0000 UTC m=+22.868082636"
Jul 10 18:03:37.819204 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.819162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:37.880426 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:37.880325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:38.118819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.118778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:38.178653 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.178600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:38.238446 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.238404    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:38.239375 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.239122    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:38.253001 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.252930    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 18:03:38.354539 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.354398    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:03:38.252949079Z","UUID":"dc839771-0d18-4dea-aecf-aeb639314a62","Handler":null,"Name":"","Endpoint":""}
Jul 10 18:03:38.356479 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.356457    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 18:03:38.356658 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.356504    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 18:03:38.461433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.461341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:38.523743 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.523703    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:38.523743 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.523725    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:38.523998 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:38.523818    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:38.523998 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:38.523959    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:38.561561 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.561518    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:38.647979 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.647943    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4" event={"ID":"a43a1088-70ad-4d14-80c7-ba929717e496","Type":"ContainerStarted","Data":"8916de51752c1acca6ea754f0aa5f39801b73bd3bde18313790715ee09e53b53"}
Jul 10 18:03:38.651396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.651367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:03:38.651976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.651938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"03b26106b2c5aa949d2ea31a7693b2e57eeb9cf3087746b35377e962f8bc7814"}
Jul 10 18:03:38.652137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.652039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"755e1a246b1d00acdd05e4dde454247c082bf37aa756ff87c88e972a97d4052f"}
Jul 10 18:03:38.652137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.652084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"bc3c32ff914e9de44ab46b56953dadd675a2a00a694698522a513259e3d2bff7"}
Jul 10 18:03:38.652685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.652663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:38.653188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.653170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-62552"
Jul 10 18:03:38.698766 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.698721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:38.762978 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:38.762892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:39.052404 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:39.052305    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dp4kp_411a9b95-29e8-4e06-a2bf-771e3a6507d9/dns-node-resolver/0.log"
Jul 10 18:03:39.183846 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:39.183797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:39.285897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:39.285857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:39.523160 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:39.523119    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:39.523507 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:39.523270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:40.052118 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.052083    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-58vxb_741e0c1d-a790-453a-8222-93dacf76c03c/node-ca/0.log"
Jul 10 18:03:40.224665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.224620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:40.329114 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.329017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:40.523582 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.523540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:40.523795 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.523542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:40.523795 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:40.523691    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:40.523795 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:40.523767    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:40.662331 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.662288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4" event={"ID":"a43a1088-70ad-4d14-80c7-ba929717e496","Type":"ContainerStarted","Data":"151a0d3b53a58aa5a268988511ba98d51877d78a5b7f90640c91542ebf0b2817"}
Jul 10 18:03:40.666091 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.666067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:03:40.666536 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.666494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"8271f773c7c50a817d9dd0f7f36f9ac3814349e8fb3665573dcc17df7843e064"}
Jul 10 18:03:40.880277 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.880242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:40.940064 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:40.939918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:41.523853 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:41.523815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:41.524369 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:41.523964    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:41.682877 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:41.682844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:42.140862 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.140830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:42.344595 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.344560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:42.493367 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.493182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:42.523335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.523304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:42.523501 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.523311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:42.523501 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:42.523465    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:42.523574 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:42.523498    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:42.596612 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.596573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:42.669238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.669129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:42.672679 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.672653    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd67c2f8-794d-4d25-80a3-75acecb9e39e" containerID="200e14cd207d64b701506c878822945b00d7fb2588570f077ff33c37502ee10c" exitCode=0
Jul 10 18:03:42.672823 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.672676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerDied","Data":"200e14cd207d64b701506c878822945b00d7fb2588570f077ff33c37502ee10c"}
Jul 10 18:03:42.676310 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.676275    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:03:42.676669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.676629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"8ae580b24016a1aa55ebcf19c15ca2979db8c33c1e4a1224f80124db2550cafb"}
Jul 10 18:03:42.676884 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.676870    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:42.676934 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.676912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:42.677080 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.677057    2565 scope.go:117] "RemoveContainer" containerID="ab94946c9c31dab381fa9ee87c00e62ffe69702e00011eff695cc3159882d593"
Jul 10 18:03:42.694414 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.694394    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:42.702123 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.699574    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7jp4" podStartSLOduration=6.470318452 podStartE2EDuration="27.699554444s" totalImagesPullingTime="21.229235992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:40.702840919 +0000 UTC m=+25.861558744" watchObservedRunningTime="2026-07-10 18:03:42.699554444 +0000 UTC m=+27.858272270"
Jul 10 18:03:42.870817 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.870777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:42.980512 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:42.980417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:43.527271 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:43.527240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:43.527442 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:43.527387    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:43.609296 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:43.609258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:43.681967 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:43.681942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:03:43.682318 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:43.682294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" event={"ID":"37698526-7a93-4eb5-b448-eaf8bde7fd7e","Type":"ContainerStarted","Data":"3027687d7f902b738ba1d33bbb0c1af78d0992ded678292d89a15e77dd793bb0"}
Jul 10 18:03:43.682539 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:43.682525    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:43.700363 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:43.700323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:03:43.716965 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:43.716901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd" podStartSLOduration=9.452214714 podStartE2EDuration="27.716884631s" totalImagesPullingTime="18.264669917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:43.715168371 +0000 UTC m=+28.873886196" watchObservedRunningTime="2026-07-10 18:03:43.716884631 +0000 UTC m=+28.875602455"
Jul 10 18:03:44.030371 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.030326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:44.419957 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.419926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:44.523293 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.523255    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:44.523293 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.523301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:44.523491 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:44.523378    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:44.523528 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:44.523505    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:44.687244 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.687150    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd67c2f8-794d-4d25-80a3-75acecb9e39e" containerID="39d6b2cf01144b93bc3230db090c79e7aa3a242d59549db5bc7aa11bfbf5b541" exitCode=0
Jul 10 18:03:44.687715 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.687236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerDied","Data":"39d6b2cf01144b93bc3230db090c79e7aa3a242d59549db5bc7aa11bfbf5b541"}
Jul 10 18:03:44.807068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.807028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:44.872769 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:44.872730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:45.031276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:45.031186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:45.526247 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:45.526220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:45.526420 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:45.526325    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:45.710527 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:45.710483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:45.810489 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:45.810403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:45.956264 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:45.956203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:46.227128 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.227092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:46.476730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.476687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:46.523822 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.523730    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:46.523971 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.523730    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:46.523971 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:46.523846    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:46.523971 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:46.523898    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:46.694988 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.694948    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd67c2f8-794d-4d25-80a3-75acecb9e39e" containerID="a27c83b6636d70ce32b28cc5879218e249ebaea81c659fe18a577bc37e186078" exitCode=0
Jul 10 18:03:46.695172 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.695020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerDied","Data":"a27c83b6636d70ce32b28cc5879218e249ebaea81c659fe18a577bc37e186078"}
Jul 10 18:03:46.798910 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.798810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:46.884962 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:46.884930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:47.015397 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:47.015353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:47.523188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:47.523152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:47.523388 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:47.523295    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:47.610672 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:47.610619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:47.813137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:47.813001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:48.207401 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:48.207368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:48.444987 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:48.444948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:48.523580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:48.523484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:48.523780 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:48.523485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:48.523780 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:48.523617    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:48.523780 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:48.523716    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:48.633268 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:48.633227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:49.262467 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:49.262429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:49.263043 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:49.262502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:49.263043 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.262622    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:49.263043 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.262738    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret podName:dc3cf1fc-a022-4cdc-8aba-146d23d84f5a nodeName:}" failed. No retries permitted until 2026-07-10 18:04:21.262713062 +0000 UTC m=+66.421430883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret") pod "global-pull-secret-syncer-lkmgq" (UID: "dc3cf1fc-a022-4cdc-8aba-146d23d84f5a") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:03:49.263043 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.262652    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:49.263043 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.262794    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs podName:9a47b623-fe71-4336-b9e7-a68d1e38a9db nodeName:}" failed. No retries permitted until 2026-07-10 18:04:21.2627807 +0000 UTC m=+66.421498523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs") pod "network-metrics-daemon-h67nc" (UID: "9a47b623-fe71-4336-b9e7-a68d1e38a9db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:03:49.363087 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:49.363053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:49.363278 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.363250    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:03:49.363366 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.363285    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:03:49.363366 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.363301    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hzdfq for pod openshift-network-diagnostics/network-check-target-hqksc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:49.363366 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.363363    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq podName:8547ac92-2602-4a73-8d2d-41acf5cc91d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:04:21.363343359 +0000 UTC m=+66.522061163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzdfq" (UniqueName: "kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq") pod "network-check-target-hqksc" (UID: "8547ac92-2602-4a73-8d2d-41acf5cc91d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:03:49.414096 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:49.414047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:49.523553 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:49.523430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:49.523783 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:49.523694    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:49.616082 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:49.616038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:50.010120 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:50.010082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:50.224701 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:50.224661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:50.523476 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:50.523436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:50.523953 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:50.523436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:50.523953 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:50.523567    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:50.523953 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:50.523614    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:50.628547 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:50.628509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:51.401760 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:51.401725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:51.523201 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:51.523161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:51.523340 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:51.523323    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:51.712036 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:51.711944    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd67c2f8-794d-4d25-80a3-75acecb9e39e" containerID="c3fe56551f17cff642d527f9e7290ca9982d44df1ca6746467b6974e49cfa1ce" exitCode=0
Jul 10 18:03:51.712036 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:51.712004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerDied","Data":"c3fe56551f17cff642d527f9e7290ca9982d44df1ca6746467b6974e49cfa1ce"}
Jul 10 18:03:51.807770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:51.807713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:51.982072 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:51.981973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:52.048583 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.048549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:52.218713 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.218681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:52.409235 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.409205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:52.523025 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.522985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:52.523188 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:52.523100    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:52.523188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.523160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:52.523327 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:52.523270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:52.716912 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.716822    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd67c2f8-794d-4d25-80a3-75acecb9e39e" containerID="e246392903f67b0ce833740506707d14c8dde3e6d4cd32673195ef2117ff95ac" exitCode=0
Jul 10 18:03:52.716912 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.716875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerDied","Data":"e246392903f67b0ce833740506707d14c8dde3e6d4cd32673195ef2117ff95ac"}
Jul 10 18:03:52.812341 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.812303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:52.889792 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:52.889745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:53.523171 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:53.523133    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:53.523350 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:53.523258    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:53.670752 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:53.670714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:53.722612 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:53.722574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" event={"ID":"dd67c2f8-794d-4d25-80a3-75acecb9e39e","Type":"ContainerStarted","Data":"98f09b487a8144f119e15005152b9ebcf462e5e5635a38c988b35bb2b1c9360d"}
Jul 10 18:03:53.753213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:53.753162    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f7cvb" podStartSLOduration=8.747670779 podStartE2EDuration="37.75314578s" totalImagesPullingTime="29.005475001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:03:53.751275287 +0000 UTC m=+38.909993111" watchObservedRunningTime="2026-07-10 18:03:53.75314578 +0000 UTC m=+38.911863602"
Jul 10 18:03:53.756452 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:53.756422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:53.817598 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:53.817505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:53.966233 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:53.966195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:54.142325 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:54.142292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:54.243129 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:54.243094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:54.523913 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:54.523818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:54.523913 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:54.523858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:54.524134 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:54.523930    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:54.524134 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:54.524082    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:54.544068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:54.544025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:54.739039 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:54.738988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:54.842387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:54.842298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:55.524246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:55.524213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:55.524425 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:55.524313    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:55.562330 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:55.562289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:55.756542 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:55.756503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:55.961958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:55.961929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:56.067238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:56.067205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:56.523027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:56.522984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:56.523214 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:56.523111    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:56.523214 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:56.523153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:56.523290 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:56.523255    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:57.523500 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:57.523461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:57.523902 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:57.523581    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:03:58.523777 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:58.523737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:03:58.523777 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:58.523769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:03:58.524281 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:58.523860    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:03:58.524281 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:58.523968    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:03:59.523349 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:03:59.523311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:03:59.523551 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:03:59.523451    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:04:00.523949 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:00.523909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:00.524426 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:00.523960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:00.524426 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:00.524027    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:04:00.524426 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:00.524118    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:04:01.523039 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:01.522999    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:01.523261 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:01.523157    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:04:01.800155 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:01.800067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:01.909605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:01.909571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.311075 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.311034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.384811 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.384782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.484865 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.484830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.523826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.523786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:02.523958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.523786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:02.523958 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:02.523908    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:04:02.524025 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:02.523959    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:04:02.586980 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.586885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.685693 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.685545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.958081 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:02.958036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:03.019615 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.019578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:03.524126 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.523944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:03.524293 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:03.524225    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:04:03.808036 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.807944    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkmgq"]
Jul 10 18:04:03.808205 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.808076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:03.808205 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:03.808188    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:04:03.811232 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.811154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h67nc"]
Jul 10 18:04:03.811404 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.811287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:03.811474 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:03.811447    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:04:03.812032 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.812003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hqksc"]
Jul 10 18:04:03.812150 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:03.812106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:03.812224 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:03.812201    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:04:04.994294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:04.994258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:05.086748 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:05.086713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:05.524835 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:05.524791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:05.525046 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:05.524940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:05.525046 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:05.524956    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:04:05.525046 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:05.524988    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:05.525213 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:05.525069    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:04:05.525213 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:05.525140    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:04:06.992761 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:06.992721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:07.107116 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.107079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:07.223629 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.223590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:07.320155 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.320064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:07.523384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.523348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:07.523653 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.523348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:07.523653 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:07.523468    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqksc" podUID="8547ac92-2602-4a73-8d2d-41acf5cc91d4"
Jul 10 18:04:07.523653 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.523354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:07.523653 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:07.523551    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h67nc" podUID="9a47b623-fe71-4336-b9e7-a68d1e38a9db"
Jul 10 18:04:07.523653 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:07.523604    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkmgq" podUID="dc3cf1fc-a022-4cdc-8aba-146d23d84f5a"
Jul 10 18:04:07.650996 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.650969    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeReady"
Jul 10 18:04:07.651170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.651109    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 18:04:07.700814 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.700776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:07.705056 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.705029    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g87kr"]
Jul 10 18:04:07.722859 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.722824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k2fzk"]
Jul 10 18:04:07.723013 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.722948    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.726045 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.726017    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 18:04:07.726198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.726157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 18:04:07.726255 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.726192    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4kztg\""
Jul 10 18:04:07.736996 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.736968    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g87kr"]
Jul 10 18:04:07.737161 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.737011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k2fzk"]
Jul 10 18:04:07.737161 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.737040    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zd95w"]
Jul 10 18:04:07.737161 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.737083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.740255 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.740223    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 18:04:07.740417 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.740223    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 18:04:07.740417 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.740308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 18:04:07.740417 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.740308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cpkz8\""
Jul 10 18:04:07.740417 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.740358    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 18:04:07.757948 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.757909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zd95w"]
Jul 10 18:04:07.758239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.758224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:07.761087 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.761065    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 18:04:07.761490 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.761475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 18:04:07.761568 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.761491    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-57cv4\""
Jul 10 18:04:07.761663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.761569    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 18:04:07.781784 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.781749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:07.791858 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.791824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/214bd43b-1407-4b79-b29a-946fc1ecd918-crio-socket\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.791858 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.791863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4a7b551-f99b-4a81-bbda-50f9dddbbec9-cert\") pod \"ingress-canary-zd95w\" (UID: \"f4a7b551-f99b-4a81-bbda-50f9dddbbec9\") " pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:07.792051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.791888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/214bd43b-1407-4b79-b29a-946fc1ecd918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.792051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.791914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/214bd43b-1407-4b79-b29a-946fc1ecd918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.792051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.791933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwpkt\" (UniqueName: \"kubernetes.io/projected/214bd43b-1407-4b79-b29a-946fc1ecd918-kube-api-access-hwpkt\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.792051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.791952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-metrics-tls\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.792051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.792033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-tmp-dir\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.792198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.792068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/214bd43b-1407-4b79-b29a-946fc1ecd918-data-volume\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.792198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.792088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grzl\" (UniqueName: \"kubernetes.io/projected/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-kube-api-access-8grzl\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.792198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.792146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvd4m\" (UniqueName: \"kubernetes.io/projected/f4a7b551-f99b-4a81-bbda-50f9dddbbec9-kube-api-access-cvd4m\") pod \"ingress-canary-zd95w\" (UID: \"f4a7b551-f99b-4a81-bbda-50f9dddbbec9\") " pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:07.792198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.792174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-config-volume\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.893168 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-tmp-dir\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.893168 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/214bd43b-1407-4b79-b29a-946fc1ecd918-data-volume\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.893369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8grzl\" (UniqueName: \"kubernetes.io/projected/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-kube-api-access-8grzl\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.893369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvd4m\" (UniqueName: \"kubernetes.io/projected/f4a7b551-f99b-4a81-bbda-50f9dddbbec9-kube-api-access-cvd4m\") pod \"ingress-canary-zd95w\" (UID: \"f4a7b551-f99b-4a81-bbda-50f9dddbbec9\") " pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:07.893369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-config-volume\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.893530 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/214bd43b-1407-4b79-b29a-946fc1ecd918-crio-socket\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.893586 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4a7b551-f99b-4a81-bbda-50f9dddbbec9-cert\") pod \"ingress-canary-zd95w\" (UID: \"f4a7b551-f99b-4a81-bbda-50f9dddbbec9\") " pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:07.893586 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/214bd43b-1407-4b79-b29a-946fc1ecd918-crio-socket\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.893716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/214bd43b-1407-4b79-b29a-946fc1ecd918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.893716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/214bd43b-1407-4b79-b29a-946fc1ecd918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.893716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwpkt\" (UniqueName: \"kubernetes.io/projected/214bd43b-1407-4b79-b29a-946fc1ecd918-kube-api-access-hwpkt\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.893716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/214bd43b-1407-4b79-b29a-946fc1ecd918-data-volume\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.893716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-metrics-tls\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.893963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.893732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-tmp-dir\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.894096 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.894072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-config-volume\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.894149 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.894089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/214bd43b-1407-4b79-b29a-946fc1ecd918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.897741 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.897709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-metrics-tls\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.897741 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.897726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/214bd43b-1407-4b79-b29a-946fc1ecd918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.897908 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.897777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4a7b551-f99b-4a81-bbda-50f9dddbbec9-cert\") pod \"ingress-canary-zd95w\" (UID: \"f4a7b551-f99b-4a81-bbda-50f9dddbbec9\") " pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:07.902855 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.902759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvd4m\" (UniqueName: \"kubernetes.io/projected/f4a7b551-f99b-4a81-bbda-50f9dddbbec9-kube-api-access-cvd4m\") pod \"ingress-canary-zd95w\" (UID: \"f4a7b551-f99b-4a81-bbda-50f9dddbbec9\") " pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:07.904089 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.904054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grzl\" (UniqueName: \"kubernetes.io/projected/4bf5794f-aab9-4f11-a2a5-4fca7a3becce-kube-api-access-8grzl\") pod \"dns-default-g87kr\" (UID: \"4bf5794f-aab9-4f11-a2a5-4fca7a3becce\") " pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:07.904259 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.904241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwpkt\" (UniqueName: \"kubernetes.io/projected/214bd43b-1407-4b79-b29a-946fc1ecd918-kube-api-access-hwpkt\") pod \"insights-runtime-extractor-k2fzk\" (UID: \"214bd43b-1407-4b79-b29a-946fc1ecd918\") " pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:07.935140 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:07.935095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:08.027077 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.027038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:08.033850 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.033815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:08.045979 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.045952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k2fzk"
Jul 10 18:04:08.067137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.067110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zd95w"
Jul 10 18:04:08.272035 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.271767    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zd95w"]
Jul 10 18:04:08.278361 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.278198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g87kr"]
Jul 10 18:04:08.281675 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:08.281629    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf5794f_aab9_4f11_a2a5_4fca7a3becce.slice/crio-ad2fe2326e07a2a71b9e9065fcc5bb1e4128831bf2c84490a18d577d5b30e12e WatchSource:0}: Error finding container ad2fe2326e07a2a71b9e9065fcc5bb1e4128831bf2c84490a18d577d5b30e12e: Status 404 returned error can't find the container with id ad2fe2326e07a2a71b9e9065fcc5bb1e4128831bf2c84490a18d577d5b30e12e
Jul 10 18:04:08.285505 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.285480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k2fzk"]
Jul 10 18:04:08.288904 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:08.288877    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214bd43b_1407_4b79_b29a_946fc1ecd918.slice/crio-53028c3b464461e834148ecad756c351a1163d64ab408a9210511342447aebc9 WatchSource:0}: Error finding container 53028c3b464461e834148ecad756c351a1163d64ab408a9210511342447aebc9: Status 404 returned error can't find the container with id 53028c3b464461e834148ecad756c351a1163d64ab408a9210511342447aebc9
Jul 10 18:04:08.763888 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.763841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2fzk" event={"ID":"214bd43b-1407-4b79-b29a-946fc1ecd918","Type":"ContainerStarted","Data":"53028c3b464461e834148ecad756c351a1163d64ab408a9210511342447aebc9"}
Jul 10 18:04:08.766599 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.766559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g87kr" event={"ID":"4bf5794f-aab9-4f11-a2a5-4fca7a3becce","Type":"ContainerStarted","Data":"ad2fe2326e07a2a71b9e9065fcc5bb1e4128831bf2c84490a18d577d5b30e12e"}
Jul 10 18:04:08.768766 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:08.768731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zd95w" event={"ID":"f4a7b551-f99b-4a81-bbda-50f9dddbbec9","Type":"ContainerStarted","Data":"907a1f9afc685b4f8072afe6b44c5b2726b4640ca8cc6e846a6a92a4305b3e4b"}
Jul 10 18:04:09.524938 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.524891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:09.525473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.524963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:09.525473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.524980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:09.530383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.529618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7bsz9\""
Jul 10 18:04:09.530383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.529946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:04:09.530383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.530057    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:04:09.530383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.530156    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:04:09.530383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.530223    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:04:09.530770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:09.530447    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fb6vc\""
Jul 10 18:04:10.674478 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:10.674424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:10.740968 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:10.740934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:11.593555 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:11.593515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:11.992521 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:11.992463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:12.092614 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.092576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:12.233289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.233227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:12.278071 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.277989    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-294vf"]
Jul 10 18:04:12.281280 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.281252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.283876 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.283843    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 18:04:12.284060 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.283914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 18:04:12.284060 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.283844    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 18:04:12.284202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.284133    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 18:04:12.284924 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.284903    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 18:04:12.285037 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.284955    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-52dx5\""
Jul 10 18:04:12.290126 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.289517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-294vf"]
Jul 10 18:04:12.310248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.310212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:12.332370 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.332331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16f272d5-3306-45b1-8e51-0b90129b26ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.332567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.332380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f272d5-3306-45b1-8e51-0b90129b26ff-metrics-client-ca\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.332567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.332490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqz77\" (UniqueName: \"kubernetes.io/projected/16f272d5-3306-45b1-8e51-0b90129b26ff-kube-api-access-zqz77\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.332567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.332522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16f272d5-3306-45b1-8e51-0b90129b26ff-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.374379 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.374343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:12.433845 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.433804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqz77\" (UniqueName: \"kubernetes.io/projected/16f272d5-3306-45b1-8e51-0b90129b26ff-kube-api-access-zqz77\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.433845 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.433857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16f272d5-3306-45b1-8e51-0b90129b26ff-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.434114 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.434088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16f272d5-3306-45b1-8e51-0b90129b26ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.434168 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.434134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f272d5-3306-45b1-8e51-0b90129b26ff-metrics-client-ca\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.434954 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.434920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f272d5-3306-45b1-8e51-0b90129b26ff-metrics-client-ca\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.438658 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.438609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16f272d5-3306-45b1-8e51-0b90129b26ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.438802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.438622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16f272d5-3306-45b1-8e51-0b90129b26ff-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.443463 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.443431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqz77\" (UniqueName: \"kubernetes.io/projected/16f272d5-3306-45b1-8e51-0b90129b26ff-kube-api-access-zqz77\") pod \"prometheus-operator-64785b6675-294vf\" (UID: \"16f272d5-3306-45b1-8e51-0b90129b26ff\") " pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:12.593108 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:12.593072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-294vf"
Jul 10 18:04:13.611040 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.610991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-294vf"]
Jul 10 18:04:13.617855 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:13.617818    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f272d5_3306_45b1_8e51_0b90129b26ff.slice/crio-8d8ddf9e22c92953f2ab0b8c20d3c4a1cf95835333cc7789da59a3b7170b6c28 WatchSource:0}: Error finding container 8d8ddf9e22c92953f2ab0b8c20d3c4a1cf95835333cc7789da59a3b7170b6c28: Status 404 returned error can't find the container with id 8d8ddf9e22c92953f2ab0b8c20d3c4a1cf95835333cc7789da59a3b7170b6c28
Jul 10 18:04:13.786019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.785923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-294vf" event={"ID":"16f272d5-3306-45b1-8e51-0b90129b26ff","Type":"ContainerStarted","Data":"8d8ddf9e22c92953f2ab0b8c20d3c4a1cf95835333cc7789da59a3b7170b6c28"}
Jul 10 18:04:13.787340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.787315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2fzk" event={"ID":"214bd43b-1407-4b79-b29a-946fc1ecd918","Type":"ContainerStarted","Data":"263246f827ce64dfadae9568a7ac4d654103318a52587f45d7a1e9b3347506f1"}
Jul 10 18:04:13.788705 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.788674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zd95w" event={"ID":"f4a7b551-f99b-4a81-bbda-50f9dddbbec9","Type":"ContainerStarted","Data":"92d444a8594495aa951be78b0a4bc240b8cdb70d6ab2ef65ad026d8a623c957d"}
Jul 10 18:04:13.790269 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.790246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g87kr" event={"ID":"4bf5794f-aab9-4f11-a2a5-4fca7a3becce","Type":"ContainerStarted","Data":"fd33d3c91d4c322efbde13cfee78fdc7005dcc2ac810a1daff1e0e19f96b2065"}
Jul 10 18:04:13.790380 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.790285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g87kr" event={"ID":"4bf5794f-aab9-4f11-a2a5-4fca7a3becce","Type":"ContainerStarted","Data":"677ec4c8a3b8cb94f23da834848a4296a574234b9f58aad3860ca494f7cfe9b3"}
Jul 10 18:04:13.790416 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.790386    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:13.805875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.805813    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zd95w" podStartSLOduration=1.6624383969999998 podStartE2EDuration="6.805792986s" totalImagesPullingTime="5.143354589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:13.80566504 +0000 UTC m=+58.964382861" watchObservedRunningTime="2026-07-10 18:04:13.805792986 +0000 UTC m=+58.964510812"
Jul 10 18:04:13.828068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:13.828009    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g87kr" podStartSLOduration=1.694015468 podStartE2EDuration="6.827991261s" totalImagesPullingTime="5.133975793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:13.827929934 +0000 UTC m=+58.986647771" watchObservedRunningTime="2026-07-10 18:04:13.827991261 +0000 UTC m=+58.986709065"
Jul 10 18:04:14.139285 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:14.139235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:14.245116 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:14.245078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:14.800011 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:14.799970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2fzk" event={"ID":"214bd43b-1407-4b79-b29a-946fc1ecd918","Type":"ContainerStarted","Data":"e4593f6800d3c6693352c4549f39aa81fe53cc3e6206c4fce97259800726932d"}
Jul 10 18:04:15.192609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:15.192530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:15.260986 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:15.260873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:15.704900 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:15.704870    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9tmd"
Jul 10 18:04:15.832515 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:15.832472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:15.899163 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:15.899115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:16.793630 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:16.793587    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:16.896086 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:16.896013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:17.130270 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:17.130166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:17.814115 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:17.814076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-294vf" event={"ID":"16f272d5-3306-45b1-8e51-0b90129b26ff","Type":"ContainerStarted","Data":"c9d70ec13a3d09eb1657737563c1bdb0132aa0661d14a3e1e41fe6bdbd946187"}
Jul 10 18:04:17.814322 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:17.814147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-294vf" event={"ID":"16f272d5-3306-45b1-8e51-0b90129b26ff","Type":"ContainerStarted","Data":"621ebb0d3ffcd80d96e24c1b31b81a383b0dce7a957b6929319d803dc5c98dd5"}
Jul 10 18:04:17.816202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:17.816172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2fzk" event={"ID":"214bd43b-1407-4b79-b29a-946fc1ecd918","Type":"ContainerStarted","Data":"5ad66977068dc95a8d0bc6e38330e880c4859bcadd336b172489b9cad4adf969"}
Jul 10 18:04:17.831889 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:17.831830    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-294vf" podStartSLOduration=2.639380149 podStartE2EDuration="5.831809637s" totalImagesPullingTime="3.192429488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:17.831526085 +0000 UTC m=+62.990243910" watchObservedRunningTime="2026-07-10 18:04:17.831809637 +0000 UTC m=+62.990527444"
Jul 10 18:04:17.853479 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:17.853424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k2fzk" podStartSLOduration=2.48370874 podStartE2EDuration="10.853405724s" totalImagesPullingTime="8.369696984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:04:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:17.852764757 +0000 UTC m=+63.011482579" watchObservedRunningTime="2026-07-10 18:04:17.853405724 +0000 UTC m=+63.012123568"
Jul 10 18:04:18.050131 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:18.050097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:18.110804 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:18.110704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:19.395891 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.395856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:19.620411 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.620378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:19.660839 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.660722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"]
Jul 10 18:04:19.663150 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.663122    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.665757 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.665722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 10 18:04:19.665920 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.665855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 10 18:04:19.665997 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.665950    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qw8dj\""
Jul 10 18:04:19.676224 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.676194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"]
Jul 10 18:04:19.678500 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.678470    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"]
Jul 10 18:04:19.680962 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.680940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.685269 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.685235    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 10 18:04:19.688616 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.685282    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 10 18:04:19.688616 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.685947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 10 18:04:19.690702 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.685456    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7wxdh\""
Jul 10 18:04:19.693494 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.693465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"]
Jul 10 18:04:19.696734 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.696697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.696857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.696753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.696857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.696781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lmn\" (UniqueName: \"kubernetes.io/projected/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-kube-api-access-p7lmn\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.696976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.696877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.713511 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.713465    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w2v2v"]
Jul 10 18:04:19.715833 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.715806    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.718567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.718536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 18:04:19.718567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.718561    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 18:04:19.718785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.718593    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwlhd\""
Jul 10 18:04:19.718785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.718608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 18:04:19.726828 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.726789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:19.797620 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-textfile\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.797620 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.797875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.797875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.797875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrzv\" (UniqueName: \"kubernetes.io/projected/fffe8938-1725-400c-ab0b-e26965c59124-kube-api-access-pdrzv\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.797875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.797875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1601948-4a01-4b75-a7fa-a01b68ef9845-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.798053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-wtmp\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.798053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1601948-4a01-4b75-a7fa-a01b68ef9845-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.798053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lmn\" (UniqueName: \"kubernetes.io/projected/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-kube-api-access-p7lmn\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.798053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.797989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fld5\" (UniqueName: \"kubernetes.io/projected/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-api-access-4fld5\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.798053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.798053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.798271 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.798271 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.798271 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-sys\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.798271 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fffe8938-1725-400c-ab0b-e26965c59124-metrics-client-ca\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.798271 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-root\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.798448 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.798796 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.798778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.800265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.800243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.800371 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.800323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.807025 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.806990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lmn\" (UniqueName: \"kubernetes.io/projected/b220ab3d-a66b-40ef-af2c-26c9b0e654a2-kube-api-access-p7lmn\") pod \"openshift-state-metrics-84bd68b896-ndrcs\" (UID: \"b220ab3d-a66b-40ef-af2c-26c9b0e654a2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.822286 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.822224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:19.898992 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.898945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-textfile\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrzv\" (UniqueName: \"kubernetes.io/projected/fffe8938-1725-400c-ab0b-e26965c59124-kube-api-access-pdrzv\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1601948-4a01-4b75-a7fa-a01b68ef9845-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-wtmp\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:19.899197    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 18:04:19.899207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1601948-4a01-4b75-a7fa-a01b68ef9845-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fld5\" (UniqueName: \"kubernetes.io/projected/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-api-access-4fld5\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:19.899269    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls podName:fffe8938-1725-400c-ab0b-e26965c59124 nodeName:}" failed. No retries permitted until 2026-07-10 18:04:20.399251467 +0000 UTC m=+65.557969274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls") pod "node-exporter-w2v2v" (UID: "fffe8938-1725-400c-ab0b-e26965c59124") : secret "node-exporter-tls" not found
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-sys\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fffe8938-1725-400c-ab0b-e26965c59124-metrics-client-ca\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-root\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-textfile\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-root\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-wtmp\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.899660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffe8938-1725-400c-ab0b-e26965c59124-sys\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.900080 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.899813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1601948-4a01-4b75-a7fa-a01b68ef9845-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.900320 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.900293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.900501 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.900476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.900586 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.900438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fffe8938-1725-400c-ab0b-e26965c59124-metrics-client-ca\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.900668 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.900414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1601948-4a01-4b75-a7fa-a01b68ef9845-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.901968 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.901945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.902149 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.902126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.902212 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.902196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.908703 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.908672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrzv\" (UniqueName: \"kubernetes.io/projected/fffe8938-1725-400c-ab0b-e26965c59124-kube-api-access-pdrzv\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:19.909507 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.909481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fld5\" (UniqueName: \"kubernetes.io/projected/f1601948-4a01-4b75-a7fa-a01b68ef9845-kube-api-access-4fld5\") pod \"kube-state-metrics-785778ff74-gbjpm\" (UID: \"f1601948-4a01-4b75-a7fa-a01b68ef9845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:19.925383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.925291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:19.972311 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.972271    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"
Jul 10 18:04:19.993135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:19.993098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"
Jul 10 18:04:20.026766 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.026728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:20.121855 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.121820    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs"]
Jul 10 18:04:20.124936 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:20.124898    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb220ab3d_a66b_40ef_af2c_26c9b0e654a2.slice/crio-294b9fa99dacbf1b864f9965e15a139936e588fbcb85ae991582a0b2d3d0eb82 WatchSource:0}: Error finding container 294b9fa99dacbf1b864f9965e15a139936e588fbcb85ae991582a0b2d3d0eb82: Status 404 returned error can't find the container with id 294b9fa99dacbf1b864f9965e15a139936e588fbcb85ae991582a0b2d3d0eb82
Jul 10 18:04:20.143066 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.143037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gbjpm"]
Jul 10 18:04:20.157916 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:20.157888    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1601948_4a01_4b75_a7fa_a01b68ef9845.slice/crio-9d591c20fa830c4f35a0cb18548236d1b1d2529fca8c8769bc58eff408bc6426 WatchSource:0}: Error finding container 9d591c20fa830c4f35a0cb18548236d1b1d2529fca8c8769bc58eff408bc6426: Status 404 returned error can't find the container with id 9d591c20fa830c4f35a0cb18548236d1b1d2529fca8c8769bc58eff408bc6426
Jul 10 18:04:20.403988 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.403951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:20.404389 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:20.404086    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 18:04:20.404389 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:20.404142    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls podName:fffe8938-1725-400c-ab0b-e26965c59124 nodeName:}" failed. No retries permitted until 2026-07-10 18:04:21.404127894 +0000 UTC m=+66.562845699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls") pod "node-exporter-w2v2v" (UID: "fffe8938-1725-400c-ab0b-e26965c59124") : secret "node-exporter-tls" not found
Jul 10 18:04:20.538726 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.538679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:20.675988 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.675956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:20.765244 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.765035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:20.765585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.765562    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:04:20.768718 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.768691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.771804 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.771778    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 18:04:20.771963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.771882    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bqzzx\""
Jul 10 18:04:20.772100 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.772079    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 18:04:20.773399 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.773372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 18:04:20.773539 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.773392    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 18:04:20.773539 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.773422    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 18:04:20.773680 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.773559    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 18:04:20.773680 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.773608    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 18:04:20.774124 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.774102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 18:04:20.774124 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.774112    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 18:04:20.787346 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.787280    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:04:20.808663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-config-volume\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-tls-assets\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-config-out\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-web-config\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.808955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.809300 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.809300 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.808989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.809300 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.809012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n76ql\" (UniqueName: \"kubernetes.io/projected/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-kube-api-access-n76ql\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.832139 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.832098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm" event={"ID":"f1601948-4a01-4b75-a7fa-a01b68ef9845","Type":"ContainerStarted","Data":"9d591c20fa830c4f35a0cb18548236d1b1d2529fca8c8769bc58eff408bc6426"}
Jul 10 18:04:20.835985 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.835937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs" event={"ID":"b220ab3d-a66b-40ef-af2c-26c9b0e654a2","Type":"ContainerStarted","Data":"5cf6dbf13e806691c55839fe873441025c375556b945b589bc2cdb5361e871da"}
Jul 10 18:04:20.836162 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.836043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs" event={"ID":"b220ab3d-a66b-40ef-af2c-26c9b0e654a2","Type":"ContainerStarted","Data":"dbe606c46b9d37db965580779189306431f76f3db560f9bed5d20a7c557a1b37"}
Jul 10 18:04:20.836162 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.836075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs" event={"ID":"b220ab3d-a66b-40ef-af2c-26c9b0e654a2","Type":"ContainerStarted","Data":"294b9fa99dacbf1b864f9965e15a139936e588fbcb85ae991582a0b2d3d0eb82"}
Jul 10 18:04:20.882757 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.882698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:20.910424 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910424 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n76ql\" (UniqueName: \"kubernetes.io/projected/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-kube-api-access-n76ql\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-config-volume\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-tls-assets\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-config-out\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.910697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-web-config\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.911071 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.911071 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.911071 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.910811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.911327 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.911300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.912339 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.912261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.912339 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.912330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.914306 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.914275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.914539 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.914488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-web-config\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.914751 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.914729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.915168 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.915128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.915673 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.915629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.916153 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.916107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-config-out\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.916333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.916307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-tls-assets\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.916699 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.916679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-config-volume\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.917129 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.917106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:20.919113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:20.919093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n76ql\" (UniqueName: \"kubernetes.io/projected/348abe3a-c2ba-4eb7-8a31-27b03e5b8425-kube-api-access-n76ql\") pod \"alertmanager-main-0\" (UID: \"348abe3a-c2ba-4eb7-8a31-27b03e5b8425\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:21.082497 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.082404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:04:21.314889 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.314849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:21.315065 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.314917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:21.317895 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.317858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:04:21.317895 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.317890    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:04:21.327885 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.327844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a47b623-fe71-4336-b9e7-a68d1e38a9db-metrics-certs\") pod \"network-metrics-daemon-h67nc\" (UID: \"9a47b623-fe71-4336-b9e7-a68d1e38a9db\") " pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:21.327885 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.327869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc3cf1fc-a022-4cdc-8aba-146d23d84f5a-original-pull-secret\") pod \"global-pull-secret-syncer-lkmgq\" (UID: \"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a\") " pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:21.410035 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.409886    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:04:21.415922 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.415886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:21.416050 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.415948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:21.416050 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:21.416013    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348abe3a_c2ba_4eb7_8a31_27b03e5b8425.slice/crio-1403107562e3dfe13b3b6cb6d641e67e25be638c40ecbb1769b5c153bf955040 WatchSource:0}: Error finding container 1403107562e3dfe13b3b6cb6d641e67e25be638c40ecbb1769b5c153bf955040: Status 404 returned error can't find the container with id 1403107562e3dfe13b3b6cb6d641e67e25be638c40ecbb1769b5c153bf955040
Jul 10 18:04:21.418385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.418361    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:04:21.418513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.418492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fffe8938-1725-400c-ab0b-e26965c59124-node-exporter-tls\") pod \"node-exporter-w2v2v\" (UID: \"fffe8938-1725-400c-ab0b-e26965c59124\") " pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:21.429466 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.429438    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:04:21.440192 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.440161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdfq\" (UniqueName: \"kubernetes.io/projected/8547ac92-2602-4a73-8d2d-41acf5cc91d4-kube-api-access-hzdfq\") pod \"network-check-target-hqksc\" (UID: \"8547ac92-2602-4a73-8d2d-41acf5cc91d4\") " pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:21.525758 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.525725    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w2v2v"
Jul 10 18:04:21.538149 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:21.538110    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffe8938_1725_400c_ab0b_e26965c59124.slice/crio-5b662e3344472425d960cd5e60d2170bb68ef95ccf5f6e80a48265a8a73365af WatchSource:0}: Error finding container 5b662e3344472425d960cd5e60d2170bb68ef95ccf5f6e80a48265a8a73365af: Status 404 returned error can't find the container with id 5b662e3344472425d960cd5e60d2170bb68ef95ccf5f6e80a48265a8a73365af
Jul 10 18:04:21.541397 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.541376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkmgq"
Jul 10 18:04:21.557800 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.557766    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fb6vc\""
Jul 10 18:04:21.565370 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.565344    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h67nc"
Jul 10 18:04:21.565821 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.565804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7bsz9\""
Jul 10 18:04:21.573520 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.573480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:21.678278 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.678208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:21.699357 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.699263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkmgq"]
Jul 10 18:04:21.704833 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:21.704782    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3cf1fc_a022_4cdc_8aba_146d23d84f5a.slice/crio-1b26dc21f658b0cfcc6649dea7c87b0244b25ce93d0cf52d68b5d35aac6e585b WatchSource:0}: Error finding container 1b26dc21f658b0cfcc6649dea7c87b0244b25ce93d0cf52d68b5d35aac6e585b: Status 404 returned error can't find the container with id 1b26dc21f658b0cfcc6649dea7c87b0244b25ce93d0cf52d68b5d35aac6e585b
Jul 10 18:04:21.724939 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.724906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h67nc"]
Jul 10 18:04:21.729030 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:21.728994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a47b623_fe71_4336_b9e7_a68d1e38a9db.slice/crio-6ad86b2b9276350caa8989f45134c41351474bd3da3027f3090bece56ef6ee02 WatchSource:0}: Error finding container 6ad86b2b9276350caa8989f45134c41351474bd3da3027f3090bece56ef6ee02: Status 404 returned error can't find the container with id 6ad86b2b9276350caa8989f45134c41351474bd3da3027f3090bece56ef6ee02
Jul 10 18:04:21.754009 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.753966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hqksc"]
Jul 10 18:04:21.757277 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:21.757241    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8547ac92_2602_4a73_8d2d_41acf5cc91d4.slice/crio-e396192cb2054529217192b3830bf353c05aa8183cf8e240a0635181c3fde547 WatchSource:0}: Error finding container e396192cb2054529217192b3830bf353c05aa8183cf8e240a0635181c3fde547: Status 404 returned error can't find the container with id e396192cb2054529217192b3830bf353c05aa8183cf8e240a0635181c3fde547
Jul 10 18:04:21.758860 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.758804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:21.818355 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.818313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:21.842669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.842557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkmgq" event={"ID":"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a","Type":"ContainerStarted","Data":"1b26dc21f658b0cfcc6649dea7c87b0244b25ce93d0cf52d68b5d35aac6e585b"}
Jul 10 18:04:21.844065 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.844028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h67nc" event={"ID":"9a47b623-fe71-4336-b9e7-a68d1e38a9db","Type":"ContainerStarted","Data":"6ad86b2b9276350caa8989f45134c41351474bd3da3027f3090bece56ef6ee02"}
Jul 10 18:04:21.846716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.846683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs" event={"ID":"b220ab3d-a66b-40ef-af2c-26c9b0e654a2","Type":"ContainerStarted","Data":"04e6448597d058f6c852b87519f9ba383c30c2d8a33cc6165291977a29a23f16"}
Jul 10 18:04:21.848329 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.847990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hqksc" event={"ID":"8547ac92-2602-4a73-8d2d-41acf5cc91d4","Type":"ContainerStarted","Data":"e396192cb2054529217192b3830bf353c05aa8183cf8e240a0635181c3fde547"}
Jul 10 18:04:21.851467 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.851432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerStarted","Data":"1403107562e3dfe13b3b6cb6d641e67e25be638c40ecbb1769b5c153bf955040"}
Jul 10 18:04:21.852811 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.852781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2v2v" event={"ID":"fffe8938-1725-400c-ab0b-e26965c59124","Type":"ContainerStarted","Data":"5b662e3344472425d960cd5e60d2170bb68ef95ccf5f6e80a48265a8a73365af"}
Jul 10 18:04:21.865786 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:21.865725    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ndrcs" podStartSLOduration=1.822780464 podStartE2EDuration="2.865699785s" totalImagesPullingTime="1.042919321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:21.864356729 +0000 UTC m=+67.023074555" watchObservedRunningTime="2026-07-10 18:04:21.865699785 +0000 UTC m=+67.024417615"
Jul 10 18:04:22.575628 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.575560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:22.682709 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.682584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:22.762491 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.762446    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"]
Jul 10 18:04:22.780908 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.780846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:22.790711 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.790356    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"]
Jul 10 18:04:22.790711 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.790548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.795913 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.795880    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 10 18:04:22.796183 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.796162    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 10 18:04:22.796386 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.796368    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w9t4z\""
Jul 10 18:04:22.796585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.796568    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 10 18:04:22.796846 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.796828    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-84f3vg1htem8c\""
Jul 10 18:04:22.797094 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.797077    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 10 18:04:22.799082 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.798836    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5915cba-321d-44aa-b74b-256b66fe4e78-metrics-client-ca\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-tls\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjd4\" (UniqueName: \"kubernetes.io/projected/a5915cba-321d-44aa-b74b-256b66fe4e78-kube-api-access-pjjd4\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.831759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.831595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-grpc-tls\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.867383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.867259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm" event={"ID":"f1601948-4a01-4b75-a7fa-a01b68ef9845","Type":"ContainerStarted","Data":"20fa4d943567631d835ac3763401c356520e395b1472d13e77d414807cd74213"}
Jul 10 18:04:22.867383 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.867318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm" event={"ID":"f1601948-4a01-4b75-a7fa-a01b68ef9845","Type":"ContainerStarted","Data":"108236bc0b08de0796291cab5750d5cd95ed783a9afd9f69411081ae3cdef869"}
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.932924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.932980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5915cba-321d-44aa-b74b-256b66fe4e78-metrics-client-ca\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.933074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-tls\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.933135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjd4\" (UniqueName: \"kubernetes.io/projected/a5915cba-321d-44aa-b74b-256b66fe4e78-kube-api-access-pjjd4\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.933168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.933219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.933253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.934685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.933284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-grpc-tls\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.938022 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.936206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5915cba-321d-44aa-b74b-256b66fe4e78-metrics-client-ca\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.939833 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.939756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.947293 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.947207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjd4\" (UniqueName: \"kubernetes.io/projected/a5915cba-321d-44aa-b74b-256b66fe4e78-kube-api-access-pjjd4\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.949420 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.949384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.949608 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.949566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.949773 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.949707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.953865 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.953654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-grpc-tls\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.956811 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.956777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5915cba-321d-44aa-b74b-256b66fe4e78-secret-thanos-querier-tls\") pod \"thanos-querier-5455b5f5f7-jdjgb\" (UID: \"a5915cba-321d-44aa-b74b-256b66fe4e78\") " pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:22.974828 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:22.974766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:23.110934 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:23.110849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:23.802684 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:23.802583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g87kr"
Jul 10 18:04:24.077039 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.076907    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"]
Jul 10 18:04:24.082509 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:24.082470    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5915cba_321d_44aa_b74b_256b66fe4e78.slice/crio-7799f336a51621cf02a484cdae49b8e8b990c76423920213685f354b0660f373 WatchSource:0}: Error finding container 7799f336a51621cf02a484cdae49b8e8b990c76423920213685f354b0660f373: Status 404 returned error can't find the container with id 7799f336a51621cf02a484cdae49b8e8b990c76423920213685f354b0660f373
Jul 10 18:04:24.427855 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.427784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:24.445096 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.445042    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"]
Jul 10 18:04:24.447867 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.447771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:24.451349 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.451255    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 10 18:04:24.451506 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.451371    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-c6mm2\""
Jul 10 18:04:24.456829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.456754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"]
Jul 10 18:04:24.514515 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.514478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:24.549957 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.549922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/682d87a2-ada2-426a-b89d-e8309b5b48b7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gr88t\" (UID: \"682d87a2-ada2-426a-b89d-e8309b5b48b7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:24.550134 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.549985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hjw\" (UniqueName: \"kubernetes.io/projected/682d87a2-ada2-426a-b89d-e8309b5b48b7-kube-api-access-n2hjw\") pod \"monitoring-plugin-5f68df7f58-gr88t\" (UID: \"682d87a2-ada2-426a-b89d-e8309b5b48b7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:24.651411 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.651373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hjw\" (UniqueName: \"kubernetes.io/projected/682d87a2-ada2-426a-b89d-e8309b5b48b7-kube-api-access-n2hjw\") pod \"monitoring-plugin-5f68df7f58-gr88t\" (UID: \"682d87a2-ada2-426a-b89d-e8309b5b48b7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:24.651607 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.651491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/682d87a2-ada2-426a-b89d-e8309b5b48b7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gr88t\" (UID: \"682d87a2-ada2-426a-b89d-e8309b5b48b7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:24.651692 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:24.651620    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 10 18:04:24.651729 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:04:24.651712    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682d87a2-ada2-426a-b89d-e8309b5b48b7-monitoring-plugin-cert podName:682d87a2-ada2-426a-b89d-e8309b5b48b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:04:25.151687125 +0000 UTC m=+70.310404943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/682d87a2-ada2-426a-b89d-e8309b5b48b7-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-gr88t" (UID: "682d87a2-ada2-426a-b89d-e8309b5b48b7") : secret "monitoring-plugin-cert" not found
Jul 10 18:04:24.664513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.664462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hjw\" (UniqueName: \"kubernetes.io/projected/682d87a2-ada2-426a-b89d-e8309b5b48b7-kube-api-access-n2hjw\") pod \"monitoring-plugin-5f68df7f58-gr88t\" (UID: \"682d87a2-ada2-426a-b89d-e8309b5b48b7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:24.888682 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.888601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm" event={"ID":"f1601948-4a01-4b75-a7fa-a01b68ef9845","Type":"ContainerStarted","Data":"a03d75efa2729ec9e0880f8b2459546ee8fa46c8d686efae34139567e974abbd"}
Jul 10 18:04:24.893344 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.893302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h67nc" event={"ID":"9a47b623-fe71-4336-b9e7-a68d1e38a9db","Type":"ContainerStarted","Data":"72117a0a36b09863cad8388dd69c49a28ea22be7d8d5ff0c343b0239935b30b0"}
Jul 10 18:04:24.893542 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.893384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h67nc" event={"ID":"9a47b623-fe71-4336-b9e7-a68d1e38a9db","Type":"ContainerStarted","Data":"152e295e3f04106698952538999f86d521717f448bd23dc4575eb7e8067e326a"}
Jul 10 18:04:24.898169 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.896841    2565 generic.go:356] "Generic (PLEG): container finished" podID="348abe3a-c2ba-4eb7-8a31-27b03e5b8425" containerID="b9747bb811d6728ff3f7a68f3a17042f2d9ff35b68816e92b5aa3bf7f9b0a6c7" exitCode=0
Jul 10 18:04:24.898169 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.896946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerDied","Data":"b9747bb811d6728ff3f7a68f3a17042f2d9ff35b68816e92b5aa3bf7f9b0a6c7"}
Jul 10 18:04:24.901682 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.901512    2565 generic.go:356] "Generic (PLEG): container finished" podID="fffe8938-1725-400c-ab0b-e26965c59124" containerID="8e30589ac041e28d780a5ee1b7ec67e81515fe3423971d8e4f526251441f4801" exitCode=0
Jul 10 18:04:24.901682 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.901659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2v2v" event={"ID":"fffe8938-1725-400c-ab0b-e26965c59124","Type":"ContainerDied","Data":"8e30589ac041e28d780a5ee1b7ec67e81515fe3423971d8e4f526251441f4801"}
Jul 10 18:04:24.904216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.904186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" event={"ID":"a5915cba-321d-44aa-b74b-256b66fe4e78","Type":"ContainerStarted","Data":"7799f336a51621cf02a484cdae49b8e8b990c76423920213685f354b0660f373"}
Jul 10 18:04:24.922672 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.920569    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-gbjpm" podStartSLOduration=3.545755716 podStartE2EDuration="5.92051529s" totalImagesPullingTime="2.374759574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:24.919359752 +0000 UTC m=+70.078077590" watchObservedRunningTime="2026-07-10 18:04:24.92051529 +0000 UTC m=+70.079233107"
Jul 10 18:04:24.940476 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.940357    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h67nc" podStartSLOduration=66.779836108 podStartE2EDuration="1m8.940330326s" totalImagesPullingTime="2.160494218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:24.939575993 +0000 UTC m=+70.098293855" watchObservedRunningTime="2026-07-10 18:04:24.940330326 +0000 UTC m=+70.099048167"
Jul 10 18:04:24.991910 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:24.991809    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:25.091688 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.091561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:25.155320 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.155228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:25.158414 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.158374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/682d87a2-ada2-426a-b89d-e8309b5b48b7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gr88t\" (UID: \"682d87a2-ada2-426a-b89d-e8309b5b48b7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:25.162217 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.162148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/682d87a2-ada2-426a-b89d-e8309b5b48b7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gr88t\" (UID: \"682d87a2-ada2-426a-b89d-e8309b5b48b7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:25.362823 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.362750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:25.636880 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.636832    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c75c8c6c5-gsvp6"]
Jul 10 18:04:25.639396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.639352    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.643967 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.643941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 18:04:25.645214 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.645017    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 18:04:25.645214 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.645176    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 18:04:25.645425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.645029    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 18:04:25.645747 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.645721    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 18:04:25.645989 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.645973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hdtxr\""
Jul 10 18:04:25.649216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.648955    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 18:04:25.649216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.648993    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 18:04:25.652613 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.652583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c75c8c6c5-gsvp6"]
Jul 10 18:04:25.653529 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.653501    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 18:04:25.769661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.768880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-oauth-serving-cert\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.769661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.768944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-serving-cert\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.769661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.768982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-console-config\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.769661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.769028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-oauth-config\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.769661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.769051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-service-ca\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.769661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.769113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-trusted-ca-bundle\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.769661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.769181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kf6m\" (UniqueName: \"kubernetes.io/projected/56d492c1-ec02-40a4-8062-cc7654badea5-kube-api-access-8kf6m\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.856674 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.856554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:25.870033 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.869993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-trusted-ca-bundle\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.870265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.870049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kf6m\" (UniqueName: \"kubernetes.io/projected/56d492c1-ec02-40a4-8062-cc7654badea5-kube-api-access-8kf6m\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.870265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.870097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-oauth-serving-cert\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.870265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.870141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-serving-cert\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.870265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.870187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-console-config\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.870265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.870236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-oauth-config\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.870265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.870259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-service-ca\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.871082 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.871017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-oauth-serving-cert\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.871082 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.871061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-service-ca\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.871257 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.871149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-console-config\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.871257 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.871157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-trusted-ca-bundle\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.873381 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.873353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-oauth-config\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.873546 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.873520    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-serving-cert\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.891302 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.891219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kf6m\" (UniqueName: \"kubernetes.io/projected/56d492c1-ec02-40a4-8062-cc7654badea5-kube-api-access-8kf6m\") pod \"console-7c75c8c6c5-gsvp6\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") " pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:25.923723 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.921600    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:04:25.927177 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.927140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:25.931136 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.930682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 18:04:25.931136 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.930934    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 18:04:25.933499 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.933119    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 18:04:25.933499 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.933287    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 18:04:25.933499 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.933296    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 18:04:25.933499 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.933119    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 18:04:25.933499 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.933414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6091tbbtlqgu6\""
Jul 10 18:04:25.934738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.934085    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 18:04:25.934738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.934101    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 18:04:25.934738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.934251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 18:04:25.934738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.934379    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 18:04:25.934738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.934589    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 18:04:25.934738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.934589    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 18:04:25.936452 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.936165    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 18:04:25.936452 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.936281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:25.936452 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.936335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2wbd2\""
Jul 10 18:04:25.948540 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.947987    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 18:04:25.950262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.949908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:04:25.952216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.952030    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 18:04:25.957053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:25.957026    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:26.072113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-config\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.072878 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.072882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5pl\" (UniqueName: \"kubernetes.io/projected/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-kube-api-access-dz5pl\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.173979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5pl\" (UniqueName: \"kubernetes.io/projected/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-kube-api-access-dz5pl\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-config\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.174857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.174551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.175341 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.175311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.179663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.178595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.179663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.179210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.179663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.179399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.181024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.180435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.181024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.180498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.181024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.180546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.181024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.180577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.181024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.180896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.181024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.180948    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.181525 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.181477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.182226 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.182203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.182453 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.182431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.182886 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.182867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.183213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.183168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.184843 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.184793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.186431 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.185415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.186431 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.185557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-config\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.186431 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.185910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.186431 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.186377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.187201 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.187154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.188793 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.188740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5pl\" (UniqueName: \"kubernetes.io/projected/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-kube-api-access-dz5pl\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.190429 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.190386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/df56efb6-c876-43d4-bbde-ab7b63dd3eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"df56efb6-c876-43d4-bbde-ab7b63dd3eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.255224 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.255180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:26.679235 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:26.679107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:27.154351 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:27.154255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:28.314576 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.314544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:04:28.520270 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:28.520230    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf56efb6_c876_43d4_bbde_ab7b63dd3eeb.slice/crio-1df63e6c528644bd2eadfb2df549a9eb27e930be292d8a7cf5689feb5690248e WatchSource:0}: Error finding container 1df63e6c528644bd2eadfb2df549a9eb27e930be292d8a7cf5689feb5690248e: Status 404 returned error can't find the container with id 1df63e6c528644bd2eadfb2df549a9eb27e930be292d8a7cf5689feb5690248e
Jul 10 18:04:28.706461 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.706427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c75c8c6c5-gsvp6"]
Jul 10 18:04:28.737743 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.737708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"]
Jul 10 18:04:28.762862 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:04:28.762789    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682d87a2_ada2_426a_b89d_e8309b5b48b7.slice/crio-f3f32b8063b110ab3dc66666406e263645993e0cdfa7bca48f66d177acb6a356 WatchSource:0}: Error finding container f3f32b8063b110ab3dc66666406e263645993e0cdfa7bca48f66d177acb6a356: Status 404 returned error can't find the container with id f3f32b8063b110ab3dc66666406e263645993e0cdfa7bca48f66d177acb6a356
Jul 10 18:04:28.925741 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.925701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkmgq" event={"ID":"dc3cf1fc-a022-4cdc-8aba-146d23d84f5a","Type":"ContainerStarted","Data":"eadbd8c83b07c98796cf3c73236f9e1222b1159ee9b5a2cfbd0843c1b9f0d6de"}
Jul 10 18:04:28.929663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.929606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" event={"ID":"a5915cba-321d-44aa-b74b-256b66fe4e78","Type":"ContainerStarted","Data":"1eed1e2aa94776ccd50d43b5d6771f080397bcd0a68bc3e517398215adbec3bb"}
Jul 10 18:04:28.929809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.929709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" event={"ID":"a5915cba-321d-44aa-b74b-256b66fe4e78","Type":"ContainerStarted","Data":"137b965df24bd429105bae330991999da91b79384a8fd3d029fc249b6a8f19e2"}
Jul 10 18:04:28.929809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.929754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" event={"ID":"a5915cba-321d-44aa-b74b-256b66fe4e78","Type":"ContainerStarted","Data":"c669f378be8ab153212c43de5de5fe8e1e4b57a6205888d11550fa2763fa497d"}
Jul 10 18:04:28.931517 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.931483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c75c8c6c5-gsvp6" event={"ID":"56d492c1-ec02-40a4-8062-cc7654badea5","Type":"ContainerStarted","Data":"8e3096acf0c9e74a5f47ae156cb56633fcdf1f950156c5a082deb9f135cd7aa9"}
Jul 10 18:04:28.934394 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.934225    2565 generic.go:356] "Generic (PLEG): container finished" podID="df56efb6-c876-43d4-bbde-ab7b63dd3eeb" containerID="2e846abdd1a56072cf4ec52d255afa2261a7ac31628443be651ddc7b609576d3" exitCode=0
Jul 10 18:04:28.934394 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.934259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerDied","Data":"2e846abdd1a56072cf4ec52d255afa2261a7ac31628443be651ddc7b609576d3"}
Jul 10 18:04:28.934394 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.934360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerStarted","Data":"1df63e6c528644bd2eadfb2df549a9eb27e930be292d8a7cf5689feb5690248e"}
Jul 10 18:04:28.936324 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.936295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hqksc" event={"ID":"8547ac92-2602-4a73-8d2d-41acf5cc91d4","Type":"ContainerStarted","Data":"d7f2dd9794cfd571a7955579d23c15e4724826e9ebe70b00d766dd5c41b0420f"}
Jul 10 18:04:28.936476 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.936411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:04:28.939331 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.939304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerStarted","Data":"b505c91ba5d7d119db7caaf79bda2d876bedc29d2f21a851185b8b7f3a6db61d"}
Jul 10 18:04:28.939463 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.939380    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerStarted","Data":"357bc4284098bfa460cdeac7d95b2e0b6363afff564e6fcd422bc36deef8c5fe"}
Jul 10 18:04:28.939463 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.939419    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerStarted","Data":"c89a7b6f85e1b0de29ffb411d2d41686c247ec4adb740dca6ee3995d13746791"}
Jul 10 18:04:28.942356 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.941744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2v2v" event={"ID":"fffe8938-1725-400c-ab0b-e26965c59124","Type":"ContainerStarted","Data":"cb5dea1fb8b223bd40066029ad4bf1f4d3817f40951d142d49c6e6e6d7cc1449"}
Jul 10 18:04:28.942356 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.941826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2v2v" event={"ID":"fffe8938-1725-400c-ab0b-e26965c59124","Type":"ContainerStarted","Data":"fecbcfdad346c96020f338956908dff44269d9a2ea3ea8ede898b38541af7e75"}
Jul 10 18:04:28.943297 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.943247    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkmgq" podStartSLOduration=66.128292675 podStartE2EDuration="1m12.943215298s" totalImagesPullingTime="6.814922623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:28.941958782 +0000 UTC m=+74.100676608" watchObservedRunningTime="2026-07-10 18:04:28.943215298 +0000 UTC m=+74.101933100"
Jul 10 18:04:28.943813 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.943750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t" event={"ID":"682d87a2-ada2-426a-b89d-e8309b5b48b7","Type":"ContainerStarted","Data":"f3f32b8063b110ab3dc66666406e263645993e0cdfa7bca48f66d177acb6a356"}
Jul 10 18:04:28.962701 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.962200    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hqksc" podStartSLOduration=66.579604449 podStartE2EDuration="1m12.962175548s" totalImagesPullingTime="6.382571099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:28.960293975 +0000 UTC m=+74.119011825" watchObservedRunningTime="2026-07-10 18:04:28.962175548 +0000 UTC m=+74.120893373"
Jul 10 18:04:28.983146 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:28.983084    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w2v2v" podStartSLOduration=7.5293925 podStartE2EDuration="9.983065516s" totalImagesPullingTime="2.353534454s" totalInitContainerRuntime="100.138562ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:28.982286053 +0000 UTC m=+74.141003894" watchObservedRunningTime="2026-07-10 18:04:28.983065516 +0000 UTC m=+74.141783342"
Jul 10 18:04:29.823902 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:29.823741    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c75c8c6c5-gsvp6"]
Jul 10 18:04:29.967670 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:29.967588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerStarted","Data":"981c6b53e36515a575e4ddd431e8f52ee9c72e51fd1fa2e043a270ce9380844b"}
Jul 10 18:04:29.967952 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:29.967881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerStarted","Data":"78242236b42c403b9fb32fd4c7e476988d6a369d9e7d5b778f203bbea3016fc3"}
Jul 10 18:04:30.243431 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.243390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:30.346435 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.346276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:30.443182 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.443084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:30.814068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.813997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:30.869497 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.869372    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:30.977113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.977073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"348abe3a-c2ba-4eb7-8a31-27b03e5b8425","Type":"ContainerStarted","Data":"059a97dabf1b2b96cfad6bb4da0cfd0669c385f1c8134ad662e24a5f185670af"}
Jul 10 18:04:30.979553 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.979265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t" event={"ID":"682d87a2-ada2-426a-b89d-e8309b5b48b7","Type":"ContainerStarted","Data":"bdd7062f589826442dca456b318766bb7be52fa166f044ffcbc033f5934e915c"}
Jul 10 18:04:30.979553 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.979430    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:30.984671 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.984495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" event={"ID":"a5915cba-321d-44aa-b74b-256b66fe4e78","Type":"ContainerStarted","Data":"7fcdf6bd39e479460f2166c77ca8f909ad083b89d82c1bfb413a09a130eef031"}
Jul 10 18:04:30.984671 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.984659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" event={"ID":"a5915cba-321d-44aa-b74b-256b66fe4e78","Type":"ContainerStarted","Data":"a76e2ebf7393cb67c345a039f259e1933f46a8cd139afb7a397bc11288572dfe"}
Jul 10 18:04:30.984923 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.984720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" event={"ID":"a5915cba-321d-44aa-b74b-256b66fe4e78","Type":"ContainerStarted","Data":"eb113b3e92e4145ab0e9b76a7fc338ca1cbdcd3b0779c2769c8bfca7e0e31cd3"}
Jul 10 18:04:30.984923 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.984865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:30.988809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:30.986179    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t"
Jul 10 18:04:31.008560 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:31.008487    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.957560503 podStartE2EDuration="11.008432951s" totalImagesPullingTime="7.024752386s" totalInitContainerRuntime="26.120062ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:31.00749776 +0000 UTC m=+76.166215619" watchObservedRunningTime="2026-07-10 18:04:31.008432951 +0000 UTC m=+76.167150777"
Jul 10 18:04:31.029674 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:31.029098    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gr88t" podStartSLOduration=5.152465926 podStartE2EDuration="7.029072939s" totalImagesPullingTime="1.876607013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:31.026766345 +0000 UTC m=+76.185484196" watchObservedRunningTime="2026-07-10 18:04:31.029072939 +0000 UTC m=+76.187790765"
Jul 10 18:04:31.054278 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:31.054217    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb" podStartSLOduration=3.646179427 podStartE2EDuration="9.054183219s" totalImagesPullingTime="5.408003792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:31.053860366 +0000 UTC m=+76.212578220" watchObservedRunningTime="2026-07-10 18:04:31.054183219 +0000 UTC m=+76.212901044"
Jul 10 18:04:31.804455 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:31.804360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:31.859811 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:31.859770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:32.134370 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:32.134327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:32.201981 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:32.201933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:34.001088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.001048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c75c8c6c5-gsvp6" event={"ID":"56d492c1-ec02-40a4-8062-cc7654badea5","Type":"ContainerStarted","Data":"68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585"}
Jul 10 18:04:34.004955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.004917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerStarted","Data":"ea10f691b2ad5de13979741d88739cff7d2f6f9961de5705b860fc17d2353a1b"}
Jul 10 18:04:34.005123 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.004990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerStarted","Data":"ca737cedfd0650d93c17e5efa041ef3ddb24019c93a2691fd6b6f929e4deed99"}
Jul 10 18:04:34.005123 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.005024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerStarted","Data":"1d796379e2b374cc3147b0c2173554cad7794fb95ba69a3b9ef0415382248301"}
Jul 10 18:04:34.005123 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.005062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerStarted","Data":"50f3bd4c3a423eba65f11029ad8c332a7ae600e6a212b69834d420cd63196d57"}
Jul 10 18:04:34.005123 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.005092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerStarted","Data":"5e06a05b9c17638019b6a47e1dc3adabe18e97fbbeb4c3e9eb11f01cec9d665b"}
Jul 10 18:04:34.005246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.005127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df56efb6-c876-43d4-bbde-ab7b63dd3eeb","Type":"ContainerStarted","Data":"a8b848ce8f44206c06d153d33789fa3451a4def10743e9ab812aa018410b81f0"}
Jul 10 18:04:34.066858 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.066795    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.860459034 podStartE2EDuration="9.066771696s" totalImagesPullingTime="4.183198792s" totalInitContainerRuntime="23.11387ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:34.065245446 +0000 UTC m=+79.223963271" watchObservedRunningTime="2026-07-10 18:04:34.066771696 +0000 UTC m=+79.225489522"
Jul 10 18:04:34.068338 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:34.068282    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c75c8c6c5-gsvp6" podStartSLOduration=4.66793792 podStartE2EDuration="9.068266965s" totalImagesPullingTime="4.400329045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:34.028059915 +0000 UTC m=+79.186777740" watchObservedRunningTime="2026-07-10 18:04:34.068266965 +0000 UTC m=+79.226984849"
Jul 10 18:04:35.698145 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:35.698102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:35.958109 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:35.958013    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:36.256339 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:36.256171    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:04:36.996024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:36.995991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5455b5f5f7-jdjgb"
Jul 10 18:04:39.443079 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:39.443042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:39.505532 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:39.505489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:41.378263 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:41.378229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:41.478167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:41.478136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:43.777195 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:43.777166    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zd95w_f4a7b551-f99b-4a81-bbda-50f9dddbbec9/serve-healthcheck-canary/0.log"
Jul 10 18:04:55.129985 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:55.129940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:55.230595 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:55.230552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:56.609542 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:56.609499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:56.711832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:56.711791    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:56.830688 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:56.830624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:59.022670 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.022608    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c75c8c6c5-gsvp6" podUID="56d492c1-ec02-40a4-8062-cc7654badea5" containerName="console" containerID="cri-o://68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585" gracePeriod=15
Jul 10 18:04:59.802788 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.802753    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:04:59.899811 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.899703    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-oauth-serving-cert\") pod \"56d492c1-ec02-40a4-8062-cc7654badea5\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") "
Jul 10 18:04:59.899811 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.899789    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-console-config\") pod \"56d492c1-ec02-40a4-8062-cc7654badea5\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") "
Jul 10 18:04:59.900045 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.899860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-serving-cert\") pod \"56d492c1-ec02-40a4-8062-cc7654badea5\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") "
Jul 10 18:04:59.900045 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.899887    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kf6m\" (UniqueName: \"kubernetes.io/projected/56d492c1-ec02-40a4-8062-cc7654badea5-kube-api-access-8kf6m\") pod \"56d492c1-ec02-40a4-8062-cc7654badea5\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") "
Jul 10 18:04:59.900045 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.899916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-trusted-ca-bundle\") pod \"56d492c1-ec02-40a4-8062-cc7654badea5\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") "
Jul 10 18:04:59.900045 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.899954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-oauth-config\") pod \"56d492c1-ec02-40a4-8062-cc7654badea5\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") "
Jul 10 18:04:59.900240 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.900132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-service-ca\") pod \"56d492c1-ec02-40a4-8062-cc7654badea5\" (UID: \"56d492c1-ec02-40a4-8062-cc7654badea5\") "
Jul 10 18:04:59.900521 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.900488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-console-config" (OuterVolumeSpecName: "console-config") pod "56d492c1-ec02-40a4-8062-cc7654badea5" (UID: "56d492c1-ec02-40a4-8062-cc7654badea5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:04:59.900755 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.900495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "56d492c1-ec02-40a4-8062-cc7654badea5" (UID: "56d492c1-ec02-40a4-8062-cc7654badea5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:04:59.900755 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.900503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "56d492c1-ec02-40a4-8062-cc7654badea5" (UID: "56d492c1-ec02-40a4-8062-cc7654badea5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:04:59.900959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.900763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-service-ca" (OuterVolumeSpecName: "service-ca") pod "56d492c1-ec02-40a4-8062-cc7654badea5" (UID: "56d492c1-ec02-40a4-8062-cc7654badea5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:04:59.902474 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.902436    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d492c1-ec02-40a4-8062-cc7654badea5-kube-api-access-8kf6m" (OuterVolumeSpecName: "kube-api-access-8kf6m") pod "56d492c1-ec02-40a4-8062-cc7654badea5" (UID: "56d492c1-ec02-40a4-8062-cc7654badea5"). InnerVolumeSpecName "kube-api-access-8kf6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:04:59.902585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.902439    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "56d492c1-ec02-40a4-8062-cc7654badea5" (UID: "56d492c1-ec02-40a4-8062-cc7654badea5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:04:59.902585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.902505    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "56d492c1-ec02-40a4-8062-cc7654badea5" (UID: "56d492c1-ec02-40a4-8062-cc7654badea5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:04:59.970998 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:04:59.970968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hqksc"
Jul 10 18:05:00.001718 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.001671    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-serving-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:05:00.001718 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.001707    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kf6m\" (UniqueName: \"kubernetes.io/projected/56d492c1-ec02-40a4-8062-cc7654badea5-kube-api-access-8kf6m\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:05:00.001718 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.001717    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-trusted-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:05:00.001718 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.001725    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56d492c1-ec02-40a4-8062-cc7654badea5-console-oauth-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:05:00.001964 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.001737    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:05:00.001964 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.001745    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-oauth-serving-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:05:00.001964 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.001754    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56d492c1-ec02-40a4-8062-cc7654badea5-console-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:05:00.125686 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.125623    2565 generic.go:356] "Generic (PLEG): container finished" podID="56d492c1-ec02-40a4-8062-cc7654badea5" containerID="68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585" exitCode=0
Jul 10 18:05:00.126135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.125691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c75c8c6c5-gsvp6" event={"ID":"56d492c1-ec02-40a4-8062-cc7654badea5","Type":"ContainerDied","Data":"68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585"}
Jul 10 18:05:00.126135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.125702    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c75c8c6c5-gsvp6"
Jul 10 18:05:00.126135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.125765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c75c8c6c5-gsvp6" event={"ID":"56d492c1-ec02-40a4-8062-cc7654badea5","Type":"ContainerDied","Data":"8e3096acf0c9e74a5f47ae156cb56633fcdf1f950156c5a082deb9f135cd7aa9"}
Jul 10 18:05:00.126135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.125817    2565 scope.go:117] "RemoveContainer" containerID="68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585"
Jul 10 18:05:00.148676 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.148626    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c75c8c6c5-gsvp6"]
Jul 10 18:05:00.151778 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.151755    2565 scope.go:117] "RemoveContainer" containerID="68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585"
Jul 10 18:05:00.152418 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:05:00.152310    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585\": container with ID starting with 68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585 not found: ID does not exist" containerID="68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585"
Jul 10 18:05:00.152418 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.152360    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585"} err="failed to get container status \"68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585\": rpc error: code = NotFound desc = could not find container \"68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585\": container with ID starting with 68130bf6fa62397bcc7754a048841e151de03aa55a94436aab1d7afb9d8c9585 not found: ID does not exist"
Jul 10 18:05:00.153897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:00.153877    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c75c8c6c5-gsvp6"]
Jul 10 18:05:01.528652 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:01.528601    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d492c1-ec02-40a4-8062-cc7654badea5" path="/var/lib/kubelet/pods/56d492c1-ec02-40a4-8062-cc7654badea5/volumes"
Jul 10 18:05:01.806737 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:01.806626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:01.873965 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:01.873930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:17.255278 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:17.255221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:26.256388 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:26.256341    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:05:26.278031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:26.278000    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:05:27.254384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:27.254353    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:05:35.810989 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:35.810953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:35.865062 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:35.865025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:47.637235 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:47.637183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:47.694347 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:47.694311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:53.932206 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:53.932154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:54.034167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:05:54.034128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:01.817019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:01.816958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:01.917453 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:01.917408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:01.976149 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:01.976101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:04.496552 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:04.496516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:04.597394 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:04.597345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:04.668048 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:04.667989    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:13.832359 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:13.832320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:13.888113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:13.888066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:18.493590 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:18.493548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:58.806726 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:58.806678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:58.933790 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:06:58.933750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:08.352877 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:08.352836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:15.307268 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:15.307230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:20.806274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:20.806236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:21.898591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:21.898557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:24.842277 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:24.842228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:24.944349 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:24.944312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:27.027912 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:27.027878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:27.186433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:27.186392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:27.339807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:27.339703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:29.211396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:29.211359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:29.606414 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:29.606298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:31.633826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:31.633770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:31.718040 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:31.718008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:35.453330 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:35.453290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:35.583070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:35.583028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:37.783434 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.783350    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v4whp"]
Jul 10 18:07:37.783825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.783711    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d492c1-ec02-40a4-8062-cc7654badea5" containerName="console"
Jul 10 18:07:37.783825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.783724    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d492c1-ec02-40a4-8062-cc7654badea5" containerName="console"
Jul 10 18:07:37.783825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.783777    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d492c1-ec02-40a4-8062-cc7654badea5" containerName="console"
Jul 10 18:07:37.785548 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.785530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:37.788372 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.788338    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mxpxv\""
Jul 10 18:07:37.789524 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.789504    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 18:07:37.789657 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.789504    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 18:07:37.802476 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.802446    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v4whp"]
Jul 10 18:07:37.810235 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.810201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:37.838339 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.838297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358-bound-sa-token\") pod \"cert-manager-55b4d954d5-v4whp\" (UID: \"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358\") " pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:37.838513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.838425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358-kube-api-access-nznxq\") pod \"cert-manager-55b4d954d5-v4whp\" (UID: \"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358\") " pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:37.939867 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.939824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358-bound-sa-token\") pod \"cert-manager-55b4d954d5-v4whp\" (UID: \"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358\") " pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:37.940004 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.939992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358-kube-api-access-nznxq\") pod \"cert-manager-55b4d954d5-v4whp\" (UID: \"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358\") " pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:37.951466 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.951430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358-bound-sa-token\") pod \"cert-manager-55b4d954d5-v4whp\" (UID: \"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358\") " pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:37.951609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:37.951584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358-kube-api-access-nznxq\") pod \"cert-manager-55b4d954d5-v4whp\" (UID: \"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358\") " pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:38.105468 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:38.105365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v4whp"
Jul 10 18:07:38.248176 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:38.248140    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v4whp"]
Jul 10 18:07:38.252173 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:07:38.252142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e14c3d4_9a61_4df5_bf5c_b9e2e0be3358.slice/crio-02598e53369b0b02c6b4cdac7bfeb9594640de5c6355beec16b0d4923ea687c6 WatchSource:0}: Error finding container 02598e53369b0b02c6b4cdac7bfeb9594640de5c6355beec16b0d4923ea687c6: Status 404 returned error can't find the container with id 02598e53369b0b02c6b4cdac7bfeb9594640de5c6355beec16b0d4923ea687c6
Jul 10 18:07:38.755423 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:38.755373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v4whp" event={"ID":"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358","Type":"ContainerStarted","Data":"02598e53369b0b02c6b4cdac7bfeb9594640de5c6355beec16b0d4923ea687c6"}
Jul 10 18:07:41.325415 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:41.325370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:41.424338 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:41.424308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:41.770991 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:41.770900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v4whp" event={"ID":"4e14c3d4-9a61-4df5-bf5c-b9e2e0be3358","Type":"ContainerStarted","Data":"1bda3a54a44e54e4422788c355e3a15bc0480cf51536449df01e5695f3577b34"}
Jul 10 18:07:41.793289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:41.793226    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-v4whp" podStartSLOduration=1.968275974 podStartE2EDuration="4.79320771s" totalImagesPullingTime="2.824931736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:07:41.792002668 +0000 UTC m=+266.950720494" watchObservedRunningTime="2026-07-10 18:07:41.79320771 +0000 UTC m=+266.951925535"
Jul 10 18:07:47.531737 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:47.531691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:47.637922 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:47.637878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:49.462139 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:07:49.462098    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:05.223229 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:05.223192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:06.027058 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.027018    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"]
Jul 10 18:08:06.030219 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.030187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.033110 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.033082    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gvddb\""
Jul 10 18:08:06.033110 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.033105    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 18:08:06.033389 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.033270    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 18:08:06.033389 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.033348    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 18:08:06.033532 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.033516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 18:08:06.055152 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.055120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"]
Jul 10 18:08:06.084517 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.084458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4630c23-e9df-4d23-92fc-eca942b42a5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.084906 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.084540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4630c23-e9df-4d23-92fc-eca942b42a5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.084906 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.084577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4630c23-e9df-4d23-92fc-eca942b42a5d-tmp\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.084906 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.084731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lch5\" (UniqueName: \"kubernetes.io/projected/d4630c23-e9df-4d23-92fc-eca942b42a5d-kube-api-access-2lch5\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.084906 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.084835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4630c23-e9df-4d23-92fc-eca942b42a5d-manifests\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.185292 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.185256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4630c23-e9df-4d23-92fc-eca942b42a5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.185486 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.185316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4630c23-e9df-4d23-92fc-eca942b42a5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.185486 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.185337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4630c23-e9df-4d23-92fc-eca942b42a5d-tmp\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.185486 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.185401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lch5\" (UniqueName: \"kubernetes.io/projected/d4630c23-e9df-4d23-92fc-eca942b42a5d-kube-api-access-2lch5\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.185486 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.185436    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4630c23-e9df-4d23-92fc-eca942b42a5d-manifests\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.185934 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.185910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4630c23-e9df-4d23-92fc-eca942b42a5d-manifests\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.187803 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.187775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4630c23-e9df-4d23-92fc-eca942b42a5d-tmp\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.188036 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.188017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4630c23-e9df-4d23-92fc-eca942b42a5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.188098 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.188036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4630c23-e9df-4d23-92fc-eca942b42a5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.197726 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.197682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lch5\" (UniqueName: \"kubernetes.io/projected/d4630c23-e9df-4d23-92fc-eca942b42a5d-kube-api-access-2lch5\") pod \"opendatahub-operator-controller-manager-795b486df7-vxv8n\" (UID: \"d4630c23-e9df-4d23-92fc-eca942b42a5d\") " pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.342514 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.342422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:06.488371 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.488330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"]
Jul 10 18:08:06.491606 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:08:06.491577    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4630c23_e9df_4d23_92fc_eca942b42a5d.slice/crio-3c369ec79b6b1adccc23b2042e3c882c049a451477f3d512ea14f4a7ca978b31 WatchSource:0}: Error finding container 3c369ec79b6b1adccc23b2042e3c882c049a451477f3d512ea14f4a7ca978b31: Status 404 returned error can't find the container with id 3c369ec79b6b1adccc23b2042e3c882c049a451477f3d512ea14f4a7ca978b31
Jul 10 18:08:06.668288 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.668247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:06.872207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:06.872176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n" event={"ID":"d4630c23-e9df-4d23-92fc-eca942b42a5d","Type":"ContainerStarted","Data":"3c369ec79b6b1adccc23b2042e3c882c049a451477f3d512ea14f4a7ca978b31"}
Jul 10 18:08:09.888436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:09.888400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n" event={"ID":"d4630c23-e9df-4d23-92fc-eca942b42a5d","Type":"ContainerStarted","Data":"e25d54988200a4a9ed67e987e851ad693401cdbc2d24b12f1fa3238c46eb2741"}
Jul 10 18:08:10.572395 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:10.572354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:10.695963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:10.695923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:10.894344 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:10.894308    2565 generic.go:356] "Generic (PLEG): container finished" podID="d4630c23-e9df-4d23-92fc-eca942b42a5d" containerID="e25d54988200a4a9ed67e987e851ad693401cdbc2d24b12f1fa3238c46eb2741" exitCode=0
Jul 10 18:08:10.894875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:10.894404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n" event={"ID":"d4630c23-e9df-4d23-92fc-eca942b42a5d","Type":"ContainerDied","Data":"e25d54988200a4a9ed67e987e851ad693401cdbc2d24b12f1fa3238c46eb2741"}
Jul 10 18:08:11.900106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:11.900065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n" event={"ID":"d4630c23-e9df-4d23-92fc-eca942b42a5d","Type":"ContainerStarted","Data":"27f02d8ed51e2781c032b7e008f3d26d920093b70359c7face46dea4ccae540d"}
Jul 10 18:08:11.900547 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:11.900131    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:12.007683 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:12.007610    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n" podStartSLOduration=2.178889655 podStartE2EDuration="7.007590543s" totalImagesPullingTime="3.732207438s" totalInitContainerRuntime="1.09649345s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:12.001174079 +0000 UTC m=+297.159891905" watchObservedRunningTime="2026-07-10 18:08:12.007590543 +0000 UTC m=+297.166308368"
Jul 10 18:08:15.290429 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:15.290394    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:08:15.291088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:15.291063    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:08:15.296373 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:15.296349    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 18:08:22.906595 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:22.906563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-795b486df7-vxv8n"
Jul 10 18:08:25.272260 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:25.272223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:25.407494 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:25.407458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:25.960169 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:25.960124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:26.061340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.061306    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"]
Jul 10 18:08:26.063677 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.063660    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.070706 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.070679    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 18:08:26.071244 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.071129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 18:08:26.071853 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.071833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 18:08:26.072057 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.072035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jjkl5\""
Jul 10 18:08:26.072312 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.072296    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 18:08:26.097731 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.097701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"]
Jul 10 18:08:26.161101 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.161058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86162152-be73-4d9d-b076-85d266e6a897-tmp\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.161288 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.161117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mvzk\" (UniqueName: \"kubernetes.io/projected/86162152-be73-4d9d-b076-85d266e6a897-kube-api-access-4mvzk\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.161288 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.161226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86162152-be73-4d9d-b076-85d266e6a897-tls-certs\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.192962 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.192923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:26.262397 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.262299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86162152-be73-4d9d-b076-85d266e6a897-tmp\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.262397 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.262348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mvzk\" (UniqueName: \"kubernetes.io/projected/86162152-be73-4d9d-b076-85d266e6a897-kube-api-access-4mvzk\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.262623 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.262483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86162152-be73-4d9d-b076-85d266e6a897-tls-certs\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.264620 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.264591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86162152-be73-4d9d-b076-85d266e6a897-tmp\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.264880 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.264860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86162152-be73-4d9d-b076-85d266e6a897-tls-certs\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.285763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.285722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mvzk\" (UniqueName: \"kubernetes.io/projected/86162152-be73-4d9d-b076-85d266e6a897-kube-api-access-4mvzk\") pod \"kube-auth-proxy-655946c88b-n8pm9\" (UID: \"86162152-be73-4d9d-b076-85d266e6a897\") " pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.358850 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.358792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:26.381543 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.381509    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"
Jul 10 18:08:26.450567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.450514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:26.520871 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.520812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655946c88b-n8pm9"]
Jul 10 18:08:26.523493 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:08:26.523459    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86162152_be73_4d9d_b076_85d266e6a897.slice/crio-d608af40f0d8956a375a81a70f4a3716fffe1d9e1ade725d1f678b9f4081a839 WatchSource:0}: Error finding container d608af40f0d8956a375a81a70f4a3716fffe1d9e1ade725d1f678b9f4081a839: Status 404 returned error can't find the container with id d608af40f0d8956a375a81a70f4a3716fffe1d9e1ade725d1f678b9f4081a839
Jul 10 18:08:26.525328 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.525314    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:08:26.962541 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.962493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9" event={"ID":"86162152-be73-4d9d-b076-85d266e6a897","Type":"ContainerStarted","Data":"d608af40f0d8956a375a81a70f4a3716fffe1d9e1ade725d1f678b9f4081a839"}
Jul 10 18:08:26.964194 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:26.964160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:27.106248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:27.106208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:27.223906 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:27.223811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:27.759477 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:27.759440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:27.858181 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:27.858146    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:29.144202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:29.144158    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:29.976828 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:29.976794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9" event={"ID":"86162152-be73-4d9d-b076-85d266e6a897","Type":"ContainerStarted","Data":"210bb6b53509483b3a4343c0bc9c5e46aa92f608cbfa9b399f977ab309e8a36e"}
Jul 10 18:08:29.997078 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:29.997025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-655946c88b-n8pm9" podStartSLOduration=2.094235743 podStartE2EDuration="4.997007219s" totalImagesPullingTime="2.902771476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:29.995448903 +0000 UTC m=+315.154166729" watchObservedRunningTime="2026-07-10 18:08:29.997007219 +0000 UTC m=+315.155725073"
Jul 10 18:08:33.464274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.464220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:33.566273 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.566232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:33.797218 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.797125    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"]
Jul 10 18:08:33.800358 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.800331    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.803443 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.803420    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 18:08:33.804578 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.804554    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k8pxk\""
Jul 10 18:08:33.836799 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.836759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"]
Jul 10 18:08:33.865154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.865122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:33.929032 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.928994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929032 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8ssx\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-kube-api-access-v8ssx\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.929427 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.929248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:33.977229 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.977189    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"]
Jul 10 18:08:33.980409 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:33.980390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.001103 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.001066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"]
Jul 10 18:08:34.030419 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8ssx\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-kube-api-access-v8ssx\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030606 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030606 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030606 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030606 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030874 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030874 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030874 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.030874 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.031052 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.031052 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.030980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.031187 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.031165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.031248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.031190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.031482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.031464    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.032927 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.032907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.033073 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.033055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.053461 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.053383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8ssx\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-kube-api-access-v8ssx\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.056831 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.056796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.111580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.111540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:34.131968 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.131934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.131980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.132033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.132051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75195547-5aa6-4923-9cd6-056a33f4098f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.132067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbd8b\" (UniqueName: \"kubernetes.io/projected/75195547-5aa6-4923-9cd6-056a33f4098f-kube-api-access-pbd8b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.132114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75195547-5aa6-4923-9cd6-056a33f4098f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132297 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.132154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132297 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.132169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75195547-5aa6-4923-9cd6-056a33f4098f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.132297 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.132191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.224434 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.224397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:34.233451 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233625 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233625 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75195547-5aa6-4923-9cd6-056a33f4098f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233625 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbd8b\" (UniqueName: \"kubernetes.io/projected/75195547-5aa6-4923-9cd6-056a33f4098f-kube-api-access-pbd8b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233625 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75195547-5aa6-4923-9cd6-056a33f4098f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233625 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233931 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75195547-5aa6-4923-9cd6-056a33f4098f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233931 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233931 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.233931 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.233884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.234163 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.234141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.234323 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.234302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.234400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.234377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.234566 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.234543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75195547-5aa6-4923-9cd6-056a33f4098f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.236060 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.236035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75195547-5aa6-4923-9cd6-056a33f4098f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.236358 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.236340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75195547-5aa6-4923-9cd6-056a33f4098f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.244910 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.244887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75195547-5aa6-4923-9cd6-056a33f4098f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.250267 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.250240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbd8b\" (UniqueName: \"kubernetes.io/projected/75195547-5aa6-4923-9cd6-056a33f4098f-kube-api-access-pbd8b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ql85g\" (UID: \"75195547-5aa6-4923-9cd6-056a33f4098f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.274941 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.274863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"]
Jul 10 18:08:34.276806 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:08:34.276778    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5564e1c4_8e7b_49e6_9ecd_0ad64298b287.slice/crio-4ca6592844dfc59238195f593308bee07f81f64f5bbd87b1220cc40afa2815ba WatchSource:0}: Error finding container 4ca6592844dfc59238195f593308bee07f81f64f5bbd87b1220cc40afa2815ba: Status 404 returned error can't find the container with id 4ca6592844dfc59238195f593308bee07f81f64f5bbd87b1220cc40afa2815ba
Jul 10 18:08:34.291354 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.291325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:34.335973 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.335858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:34.471788 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.471762    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"]
Jul 10 18:08:34.474307 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:08:34.474280    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75195547_5aa6_4923_9cd6_056a33f4098f.slice/crio-85b67167b5e6d858a428e461a5ce1377b341e1f6fef2cdb4bbd37df701c8a0f4 WatchSource:0}: Error finding container 85b67167b5e6d858a428e461a5ce1377b341e1f6fef2cdb4bbd37df701c8a0f4: Status 404 returned error can't find the container with id 85b67167b5e6d858a428e461a5ce1377b341e1f6fef2cdb4bbd37df701c8a0f4
Jul 10 18:08:34.925490 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.925455    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"]
Jul 10 18:08:34.930046 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.930019    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:34.934073 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.934043    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 18:08:34.934368 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.934346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bv6zc\""
Jul 10 18:08:34.934577 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.934561    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 18:08:34.937286 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:34.937259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 18:08:35.000114 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.000077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" event={"ID":"5564e1c4-8e7b-49e6-9ecd-0ad64298b287","Type":"ContainerStarted","Data":"4ca6592844dfc59238195f593308bee07f81f64f5bbd87b1220cc40afa2815ba"}
Jul 10 18:08:35.001187 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.001164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g" event={"ID":"75195547-5aa6-4923-9cd6-056a33f4098f","Type":"ContainerStarted","Data":"85b67167b5e6d858a428e461a5ce1377b341e1f6fef2cdb4bbd37df701c8a0f4"}
Jul 10 18:08:35.041728 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.041672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baef7210-f53b-482d-9aa2-19fe93feae90-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.041909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.041762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.041909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.041787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.041909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.041821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baef7210-f53b-482d-9aa2-19fe93feae90-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.041909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.041856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baef7210-f53b-482d-9aa2-19fe93feae90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.042095 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.041939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7fb\" (UniqueName: \"kubernetes.io/projected/baef7210-f53b-482d-9aa2-19fe93feae90-kube-api-access-gw7fb\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.042095 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.041995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.082605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.082564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"]
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.142946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7fb\" (UniqueName: \"kubernetes.io/projected/baef7210-f53b-482d-9aa2-19fe93feae90-kube-api-access-gw7fb\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.143145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.143193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baef7210-f53b-482d-9aa2-19fe93feae90-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.143268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.143297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.143347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baef7210-f53b-482d-9aa2-19fe93feae90-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.143384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baef7210-f53b-482d-9aa2-19fe93feae90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.144669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.144198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baef7210-f53b-482d-9aa2-19fe93feae90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.148592 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.148558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.149004 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.148976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.151198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.151146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baef7210-f53b-482d-9aa2-19fe93feae90-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.151297 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.151272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baef7210-f53b-482d-9aa2-19fe93feae90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.154567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.154519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baef7210-f53b-482d-9aa2-19fe93feae90-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.155178 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.155150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7fb\" (UniqueName: \"kubernetes.io/projected/baef7210-f53b-482d-9aa2-19fe93feae90-kube-api-access-gw7fb\") pod \"istiod-openshift-gateway-94bb8fbfd-nnrkq\" (UID: \"baef7210-f53b-482d-9aa2-19fe93feae90\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.242146 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.242057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:35.459582 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:35.459546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"]
Jul 10 18:08:35.575153 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:08:35.575017    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaef7210_f53b_482d_9aa2_19fe93feae90.slice/crio-a12d299ef87cd760025bc0fe5365451c0a69fe26ae4f59463314542d72266928 WatchSource:0}: Error finding container a12d299ef87cd760025bc0fe5365451c0a69fe26ae4f59463314542d72266928: Status 404 returned error can't find the container with id a12d299ef87cd760025bc0fe5365451c0a69fe26ae4f59463314542d72266928
Jul 10 18:08:36.010166 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:36.010127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq" event={"ID":"baef7210-f53b-482d-9aa2-19fe93feae90","Type":"ContainerStarted","Data":"a12d299ef87cd760025bc0fe5365451c0a69fe26ae4f59463314542d72266928"}
Jul 10 18:08:38.114907 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.114846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:38.226086 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.226047    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"]
Jul 10 18:08:38.233686 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.233653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:38.236750 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.236723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nwnxg\""
Jul 10 18:08:38.236891 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.236789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 10 18:08:38.243718 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.243623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"]
Jul 10 18:08:38.268729 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.268613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:38.386830 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.386794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wtls\" (UniqueName: \"kubernetes.io/projected/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-kube-api-access-5wtls\") pod \"llmisvc-controller-manager-777c6bd7d5-zfvsw\" (UID: \"59ee70ee-6236-4ac5-ad49-eafe4523ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:38.387039 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.386918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfvsw\" (UID: \"59ee70ee-6236-4ac5-ad49-eafe4523ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:38.487911 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.487876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfvsw\" (UID: \"59ee70ee-6236-4ac5-ad49-eafe4523ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:38.488065 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.487974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wtls\" (UniqueName: \"kubernetes.io/projected/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-kube-api-access-5wtls\") pod \"llmisvc-controller-manager-777c6bd7d5-zfvsw\" (UID: \"59ee70ee-6236-4ac5-ad49-eafe4523ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:38.488065 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:08:38.487992    2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 10 18:08:38.488171 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:08:38.488068    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-cert podName:59ee70ee-6236-4ac5-ad49-eafe4523ba0f nodeName:}" failed. No retries permitted until 2026-07-10 18:08:38.988042983 +0000 UTC m=+324.146760797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-cert") pod "llmisvc-controller-manager-777c6bd7d5-zfvsw" (UID: "59ee70ee-6236-4ac5-ad49-eafe4523ba0f") : secret "llmisvc-webhook-server-cert" not found
Jul 10 18:08:38.493487 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.493453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:38.494516 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.494469    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.494627 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.494542    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.494627 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.494611    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.494742 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.494556    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.494742 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.494682    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.501539 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.501515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wtls\" (UniqueName: \"kubernetes.io/projected/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-kube-api-access-5wtls\") pod \"llmisvc-controller-manager-777c6bd7d5-zfvsw\" (UID: \"59ee70ee-6236-4ac5-ad49-eafe4523ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:38.501787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.501754    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.501847 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.501823    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.501894 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.501857    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:08:38.823179 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.823082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:38.928850 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.928800    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:38.992916 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.992864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfvsw\" (UID: \"59ee70ee-6236-4ac5-ad49-eafe4523ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:38.995667 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:38.995625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59ee70ee-6236-4ac5-ad49-eafe4523ba0f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfvsw\" (UID: \"59ee70ee-6236-4ac5-ad49-eafe4523ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:39.028225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.028185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" event={"ID":"5564e1c4-8e7b-49e6-9ecd-0ad64298b287","Type":"ContainerStarted","Data":"9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5"}
Jul 10 18:08:39.029928 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.029902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g" event={"ID":"75195547-5aa6-4923-9cd6-056a33f4098f","Type":"ContainerStarted","Data":"565aabb5e57dd7cadc729c990fcc3fd451f6573946c8be6f7933e6fb1e4589ca"}
Jul 10 18:08:39.031504 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.031483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq" event={"ID":"baef7210-f53b-482d-9aa2-19fe93feae90","Type":"ContainerStarted","Data":"e7c483508835abe64525ebda4d4c644ee39cfbe7ce9926df826f5e3de9ccda39"}
Jul 10 18:08:39.031682 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.031664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:39.033542 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.033515    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-nnrkq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 18:08:39.033690 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.033564    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq" podUID="baef7210-f53b-482d-9aa2-19fe93feae90" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 18:08:39.053611 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.053532    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" podStartSLOduration=1.8380523 podStartE2EDuration="6.053511298s" totalImagesPullingTime="4.215458998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:39.052144103 +0000 UTC m=+324.210861939" watchObservedRunningTime="2026-07-10 18:08:39.053511298 +0000 UTC m=+324.212229123"
Jul 10 18:08:39.079473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.079348    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g" podStartSLOduration=2.054414286 podStartE2EDuration="6.079329097s" totalImagesPullingTime="4.024914811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:39.078994647 +0000 UTC m=+324.237712470" watchObservedRunningTime="2026-07-10 18:08:39.079329097 +0000 UTC m=+324.238046923"
Jul 10 18:08:39.101515 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.101425    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq" podStartSLOduration=2.18503936 podStartE2EDuration="5.101403145s" totalImagesPullingTime="2.916363785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:39.100069256 +0000 UTC m=+324.258787084" watchObservedRunningTime="2026-07-10 18:08:39.101403145 +0000 UTC m=+324.260120969"
Jul 10 18:08:39.112227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.112185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:39.113604 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.113577    2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Jul 10 18:08:39.113744 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.113625    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Jul 10 18:08:39.148601 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.148559    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:39.292180 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.292140    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:39.293757 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.293725    2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf4ql85g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 10 18:08:39.293913 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.293788    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g" podUID="75195547-5aa6-4923-9cd6-056a33f4098f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 10 18:08:39.319650 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:39.319601    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"]
Jul 10 18:08:39.321813 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:08:39.321764    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod59ee70ee_6236_4ac5_ad49_eafe4523ba0f.slice/crio-b38923847347c1c860fa54b926c85a5815794690f50f8b3fea3cef119cda0dd6 WatchSource:0}: Error finding container b38923847347c1c860fa54b926c85a5815794690f50f8b3fea3cef119cda0dd6: Status 404 returned error can't find the container with id b38923847347c1c860fa54b926c85a5815794690f50f8b3fea3cef119cda0dd6
Jul 10 18:08:40.038324 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:40.038285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw" event={"ID":"59ee70ee-6236-4ac5-ad49-eafe4523ba0f","Type":"ContainerStarted","Data":"b38923847347c1c860fa54b926c85a5815794690f50f8b3fea3cef119cda0dd6"}
Jul 10 18:08:40.039291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:40.039270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnrkq"
Jul 10 18:08:40.112509 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:40.112474    2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Jul 10 18:08:40.112715 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:40.112544    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Jul 10 18:08:40.296186 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:40.296112    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:41.045684 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:41.045482    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:41.046506 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:41.046481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ql85g"
Jul 10 18:08:41.112755 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:41.112719    2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body=
Jul 10 18:08:41.112951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:41.112784    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused"
Jul 10 18:08:41.180727 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:41.180692    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"]
Jul 10 18:08:42.049441 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:42.049404    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerName="istio-proxy" containerID="cri-o://9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5" gracePeriod=30
Jul 10 18:08:43.056103 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:43.055991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw" event={"ID":"59ee70ee-6236-4ac5-ad49-eafe4523ba0f","Type":"ContainerStarted","Data":"96aa235350fa202a09c3de1bb95b1ec73c459f0670b97a9912d0d0c9666ea646"}
Jul 10 18:08:43.056536 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:43.056223    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:08:43.096035 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:43.095979    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw" podStartSLOduration=1.640097723 podStartE2EDuration="5.095963394s" totalImagesPullingTime="3.455865671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:43.095515565 +0000 UTC m=+328.254233389" watchObservedRunningTime="2026-07-10 18:08:43.095963394 +0000 UTC m=+328.254681219"
Jul 10 18:08:47.311138 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.311069    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:47.370884 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.370847    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8ssx\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-kube-api-access-v8ssx\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371066 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.370918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istiod-ca-cert\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371066 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.370956    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-envoy\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371066 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.370998    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-token\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371066 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-socket\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-data\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-credential-socket\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-certs\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371203    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-podinfo\") pod \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\" (UID: \"5564e1c4-8e7b-49e6-9ecd-0ad64298b287\") "
Jul 10 18:08:47.371485 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:08:47.371800 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371472    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.371909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-data" (OuterVolumeSpecName: "istio-data") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:47.371909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:47.371909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371673    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:47.371909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.371765    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:47.373534 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.373506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-kube-api-access-v8ssx" (OuterVolumeSpecName: "kube-api-access-v8ssx") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "kube-api-access-v8ssx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:08:47.373670 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.373533    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-token" (OuterVolumeSpecName: "istio-token") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:08:47.373670 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.373621    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:08:47.373803 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.373766    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5564e1c4-8e7b-49e6-9ecd-0ad64298b287" (UID: "5564e1c4-8e7b-49e6-9ecd-0ad64298b287"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:47.472587 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472538    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.472587 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472587    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.472826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472602    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.472826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472617    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.472826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472631    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8ssx\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-kube-api-access-v8ssx\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.472826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472707    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.472826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472722    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:47.472826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:47.472735    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5564e1c4-8e7b-49e6-9ecd-0ad64298b287-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:08:48.083726 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.083687    2565 generic.go:356] "Generic (PLEG): container finished" podID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerID="9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5" exitCode=0
Jul 10 18:08:48.083898 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.083736    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"
Jul 10 18:08:48.083898 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.083737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" event={"ID":"5564e1c4-8e7b-49e6-9ecd-0ad64298b287","Type":"ContainerDied","Data":"9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5"}
Jul 10 18:08:48.083898 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.083852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc" event={"ID":"5564e1c4-8e7b-49e6-9ecd-0ad64298b287","Type":"ContainerDied","Data":"4ca6592844dfc59238195f593308bee07f81f64f5bbd87b1220cc40afa2815ba"}
Jul 10 18:08:48.083898 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.083880    2565 scope.go:117] "RemoveContainer" containerID="9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5"
Jul 10 18:08:48.092592 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.092569    2565 scope.go:117] "RemoveContainer" containerID="9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5"
Jul 10 18:08:48.092934 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:08:48.092901    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5\": container with ID starting with 9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5 not found: ID does not exist" containerID="9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5"
Jul 10 18:08:48.093044 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.092945    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5"} err="failed to get container status \"9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5\": rpc error: code = NotFound desc = could not find container \"9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5\": container with ID starting with 9eb266bd6debf1e1d755457a405a3c372249e74983cf532a62881e43ebb5a2d5 not found: ID does not exist"
Jul 10 18:08:48.104112 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.104082    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"]
Jul 10 18:08:48.108658 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:48.108617    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9q5pc"]
Jul 10 18:08:49.529199 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:08:49.529165    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" path="/var/lib/kubelet/pods/5564e1c4-8e7b-49e6-9ecd-0ad64298b287/volumes"
Jul 10 18:09:14.063420 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:14.063387    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfvsw"
Jul 10 18:09:26.566199 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.566162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:26.735191 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.735151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:26.785820 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.785786    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4k66q"]
Jul 10 18:09:26.786163 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.786151    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerName="istio-proxy"
Jul 10 18:09:26.786207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.786165    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerName="istio-proxy"
Jul 10 18:09:26.788613 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.786839    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5564e1c4-8e7b-49e6-9ecd-0ad64298b287" containerName="istio-proxy"
Jul 10 18:09:26.800535 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.800504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4k66q"
Jul 10 18:09:26.803877 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.803853    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 18:09:26.804690 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.804668    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-v66n7\""
Jul 10 18:09:26.805201 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.805182    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 18:09:26.818653 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.818556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4k66q"]
Jul 10 18:09:26.832345 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.832300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqwbt\" (UniqueName: \"kubernetes.io/projected/bee057b8-3a7d-4086-9fa8-c29d382072b9-kube-api-access-lqwbt\") pod \"kuadrant-operator-catalog-4k66q\" (UID: \"bee057b8-3a7d-4086-9fa8-c29d382072b9\") " pod="kuadrant-system/kuadrant-operator-catalog-4k66q"
Jul 10 18:09:26.890869 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.890816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:26.932994 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.932958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqwbt\" (UniqueName: \"kubernetes.io/projected/bee057b8-3a7d-4086-9fa8-c29d382072b9-kube-api-access-lqwbt\") pod \"kuadrant-operator-catalog-4k66q\" (UID: \"bee057b8-3a7d-4086-9fa8-c29d382072b9\") " pod="kuadrant-system/kuadrant-operator-catalog-4k66q"
Jul 10 18:09:26.943494 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:26.943462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqwbt\" (UniqueName: \"kubernetes.io/projected/bee057b8-3a7d-4086-9fa8-c29d382072b9-kube-api-access-lqwbt\") pod \"kuadrant-operator-catalog-4k66q\" (UID: \"bee057b8-3a7d-4086-9fa8-c29d382072b9\") " pod="kuadrant-system/kuadrant-operator-catalog-4k66q"
Jul 10 18:09:27.047583 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.047546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4k66q"]
Jul 10 18:09:27.047918 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.047901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4k66q"
Jul 10 18:09:27.184710 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.184577    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4k66q"]
Jul 10 18:09:27.186961 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:09:27.186935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee057b8_3a7d_4086_9fa8_c29d382072b9.slice/crio-fb4e5105522d997e5182c81b0be9982aae3aea4b6fe4cf11f471010dd36abf5a WatchSource:0}: Error finding container fb4e5105522d997e5182c81b0be9982aae3aea4b6fe4cf11f471010dd36abf5a: Status 404 returned error can't find the container with id fb4e5105522d997e5182c81b0be9982aae3aea4b6fe4cf11f471010dd36abf5a
Jul 10 18:09:27.255384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.255348    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k82qf"]
Jul 10 18:09:27.258738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.258713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:27.261008 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.260975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4k66q" event={"ID":"bee057b8-3a7d-4086-9fa8-c29d382072b9","Type":"ContainerStarted","Data":"fb4e5105522d997e5182c81b0be9982aae3aea4b6fe4cf11f471010dd36abf5a"}
Jul 10 18:09:27.268950 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.268922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k82qf"]
Jul 10 18:09:27.337301 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.337263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttq2\" (UniqueName: \"kubernetes.io/projected/446b3bba-2033-4681-b400-a6c923bbd769-kube-api-access-xttq2\") pod \"kuadrant-operator-catalog-k82qf\" (UID: \"446b3bba-2033-4681-b400-a6c923bbd769\") " pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:27.438286 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.438250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xttq2\" (UniqueName: \"kubernetes.io/projected/446b3bba-2033-4681-b400-a6c923bbd769-kube-api-access-xttq2\") pod \"kuadrant-operator-catalog-k82qf\" (UID: \"446b3bba-2033-4681-b400-a6c923bbd769\") " pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:27.447873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.447833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttq2\" (UniqueName: \"kubernetes.io/projected/446b3bba-2033-4681-b400-a6c923bbd769-kube-api-access-xttq2\") pod \"kuadrant-operator-catalog-k82qf\" (UID: \"446b3bba-2033-4681-b400-a6c923bbd769\") " pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:27.486470 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.486433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:27.570214 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.570172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:27.688444 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.688355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:27.713723 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:27.713690    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k82qf"]
Jul 10 18:09:27.715549 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:09:27.715519    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446b3bba_2033_4681_b400_a6c923bbd769.slice/crio-d2d336b42c693d6abeb3bfbdb7f83d1a6e9c9e6bda1ef89969904342473d107a WatchSource:0}: Error finding container d2d336b42c693d6abeb3bfbdb7f83d1a6e9c9e6bda1ef89969904342473d107a: Status 404 returned error can't find the container with id d2d336b42c693d6abeb3bfbdb7f83d1a6e9c9e6bda1ef89969904342473d107a
Jul 10 18:09:28.267598 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:28.267561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k82qf" event={"ID":"446b3bba-2033-4681-b400-a6c923bbd769","Type":"ContainerStarted","Data":"d2d336b42c693d6abeb3bfbdb7f83d1a6e9c9e6bda1ef89969904342473d107a"}
Jul 10 18:09:30.278988 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.278947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k82qf" event={"ID":"446b3bba-2033-4681-b400-a6c923bbd769","Type":"ContainerStarted","Data":"c521e102de48e593f67d560028ba7e45131189a810b2679d96c04fa06a3851dd"}
Jul 10 18:09:30.280509 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.280483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4k66q" event={"ID":"bee057b8-3a7d-4086-9fa8-c29d382072b9","Type":"ContainerStarted","Data":"9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de"}
Jul 10 18:09:30.280662 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.280554    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4k66q" podUID="bee057b8-3a7d-4086-9fa8-c29d382072b9" containerName="registry-server" containerID="cri-o://9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de" gracePeriod=2
Jul 10 18:09:30.299704 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.299626    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k82qf" podStartSLOduration=1.477332163 podStartE2EDuration="3.299606533s" totalImagesPullingTime="1.82227437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:30.297798076 +0000 UTC m=+375.456515901" watchObservedRunningTime="2026-07-10 18:09:30.299606533 +0000 UTC m=+375.458324358"
Jul 10 18:09:30.317220 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.317157    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4k66q" podStartSLOduration=1.969836383 podStartE2EDuration="4.317136708s" totalImagesPullingTime="2.347300325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:30.315322963 +0000 UTC m=+375.474040789" watchObservedRunningTime="2026-07-10 18:09:30.317136708 +0000 UTC m=+375.475854535"
Jul 10 18:09:30.530330 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.530256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4k66q"
Jul 10 18:09:30.565612 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.565569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqwbt\" (UniqueName: \"kubernetes.io/projected/bee057b8-3a7d-4086-9fa8-c29d382072b9-kube-api-access-lqwbt\") pod \"bee057b8-3a7d-4086-9fa8-c29d382072b9\" (UID: \"bee057b8-3a7d-4086-9fa8-c29d382072b9\") "
Jul 10 18:09:30.567840 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.567808    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee057b8-3a7d-4086-9fa8-c29d382072b9-kube-api-access-lqwbt" (OuterVolumeSpecName: "kube-api-access-lqwbt") pod "bee057b8-3a7d-4086-9fa8-c29d382072b9" (UID: "bee057b8-3a7d-4086-9fa8-c29d382072b9"). InnerVolumeSpecName "kube-api-access-lqwbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:09:30.666476 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:30.666438    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqwbt\" (UniqueName: \"kubernetes.io/projected/bee057b8-3a7d-4086-9fa8-c29d382072b9-kube-api-access-lqwbt\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:09:31.286722 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.286674    2565 generic.go:356] "Generic (PLEG): container finished" podID="bee057b8-3a7d-4086-9fa8-c29d382072b9" containerID="9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de" exitCode=0
Jul 10 18:09:31.286722 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.286724    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4k66q"
Jul 10 18:09:31.287210 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.286752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4k66q" event={"ID":"bee057b8-3a7d-4086-9fa8-c29d382072b9","Type":"ContainerDied","Data":"9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de"}
Jul 10 18:09:31.287210 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.286797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4k66q" event={"ID":"bee057b8-3a7d-4086-9fa8-c29d382072b9","Type":"ContainerDied","Data":"fb4e5105522d997e5182c81b0be9982aae3aea4b6fe4cf11f471010dd36abf5a"}
Jul 10 18:09:31.287210 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.286817    2565 scope.go:117] "RemoveContainer" containerID="9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de"
Jul 10 18:09:31.296614 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.296592    2565 scope.go:117] "RemoveContainer" containerID="9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de"
Jul 10 18:09:31.296950 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:09:31.296927    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de\": container with ID starting with 9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de not found: ID does not exist" containerID="9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de"
Jul 10 18:09:31.296995 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.296961    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de"} err="failed to get container status \"9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de\": rpc error: code = NotFound desc = could not find container \"9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de\": container with ID starting with 9a13eed75dabe443c0812a600d5128c4c792ac3eab956c2a2e64f501bba783de not found: ID does not exist"
Jul 10 18:09:31.310472 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.310442    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4k66q"]
Jul 10 18:09:31.312279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.312252    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4k66q"]
Jul 10 18:09:31.528710 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:31.528678    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bee057b8-3a7d-4086-9fa8-c29d382072b9" path="/var/lib/kubelet/pods/bee057b8-3a7d-4086-9fa8-c29d382072b9/volumes"
Jul 10 18:09:37.570959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:37.570908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:37.571413 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:37.570982    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:37.597345 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:37.597311    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:38.349186 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:38.349144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-k82qf"
Jul 10 18:09:44.929709 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.929656    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56776f75b5-9j9qc"]
Jul 10 18:09:44.930251 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.930228    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee057b8-3a7d-4086-9fa8-c29d382072b9" containerName="registry-server"
Jul 10 18:09:44.930326 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.930256    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee057b8-3a7d-4086-9fa8-c29d382072b9" containerName="registry-server"
Jul 10 18:09:44.930379 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.930359    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee057b8-3a7d-4086-9fa8-c29d382072b9" containerName="registry-server"
Jul 10 18:09:44.933724 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.933697    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:44.937008 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.936983    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 18:09:44.938089 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.938058    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 18:09:44.938226 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.938196    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 18:09:44.938226 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.938212    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 18:09:44.938344 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.938200    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hdtxr\""
Jul 10 18:09:44.938344 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.938311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 18:09:44.938567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.938552    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 18:09:44.938786 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.938771    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 18:09:44.947308 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.947278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 18:09:44.951433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.951405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56776f75b5-9j9qc"]
Jul 10 18:09:44.999378 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.999333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-serving-cert\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:44.999537 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.999399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pd2s\" (UniqueName: \"kubernetes.io/projected/1a3f15de-8759-4618-ab82-30df95cf6ee3-kube-api-access-9pd2s\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:44.999537 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.999422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-oauth-config\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:44.999537 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.999458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-oauth-serving-cert\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:44.999537 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.999513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-config\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:44.999723 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.999589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-trusted-ca-bundle\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:44.999723 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:44.999619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-service-ca\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.012809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.012752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:45.100136 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.100095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pd2s\" (UniqueName: \"kubernetes.io/projected/1a3f15de-8759-4618-ab82-30df95cf6ee3-kube-api-access-9pd2s\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.100136 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.100136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-oauth-config\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.100387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.100167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-oauth-serving-cert\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.100387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.100190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-config\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.100387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.100222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-trusted-ca-bundle\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.100387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.100338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-service-ca\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.100586 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.100390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-serving-cert\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.101030 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.101007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-config\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.101179 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.101044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-service-ca\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.101179 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.101044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-oauth-serving-cert\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.101314 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.101248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3f15de-8759-4618-ab82-30df95cf6ee3-trusted-ca-bundle\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.102738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.102720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-oauth-config\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.102907 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.102892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a3f15de-8759-4618-ab82-30df95cf6ee3-console-serving-cert\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.110053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.110029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pd2s\" (UniqueName: \"kubernetes.io/projected/1a3f15de-8759-4618-ab82-30df95cf6ee3-kube-api-access-9pd2s\") pod \"console-56776f75b5-9j9qc\" (UID: \"1a3f15de-8759-4618-ab82-30df95cf6ee3\") " pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.112307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.112267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:45.244692 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.244556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:45.334571 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.334428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:45.401391 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.401227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56776f75b5-9j9qc"]
Jul 10 18:09:45.404605 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:09:45.404575    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3f15de_8759_4618_ab82_30df95cf6ee3.slice/crio-d314fd58ebf0ba0da7d12374783ddc2058f6f040c64f9c293a181f776cbdac01 WatchSource:0}: Error finding container d314fd58ebf0ba0da7d12374783ddc2058f6f040c64f9c293a181f776cbdac01: Status 404 returned error can't find the container with id d314fd58ebf0ba0da7d12374783ddc2058f6f040c64f9c293a181f776cbdac01
Jul 10 18:09:45.438502 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:45.438466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:46.366338 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:46.366303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56776f75b5-9j9qc" event={"ID":"1a3f15de-8759-4618-ab82-30df95cf6ee3","Type":"ContainerStarted","Data":"d44b7692b1879294c72a4124304d13149d4a845b3c463f6d84dcca3da68c2e9c"}
Jul 10 18:09:46.366792 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:46.366354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56776f75b5-9j9qc" event={"ID":"1a3f15de-8759-4618-ab82-30df95cf6ee3","Type":"ContainerStarted","Data":"d314fd58ebf0ba0da7d12374783ddc2058f6f040c64f9c293a181f776cbdac01"}
Jul 10 18:09:46.389431 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:46.389367    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56776f75b5-9j9qc" podStartSLOduration=2.389346758 podStartE2EDuration="2.389346758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:46.386502826 +0000 UTC m=+391.545220653" watchObservedRunningTime="2026-07-10 18:09:46.389346758 +0000 UTC m=+391.548064582"
Jul 10 18:09:50.569164 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:50.569130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:51.158303 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:51.158252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:52.239778 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:52.239739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:54.303762 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.303728    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"]
Jul 10 18:09:54.307251 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.307225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"
Jul 10 18:09:54.315137 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.315113    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gwfxm\""
Jul 10 18:09:54.341276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.341243    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"]
Jul 10 18:09:54.388043 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.388000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4x5s\" (UniqueName: \"kubernetes.io/projected/250210b5-f504-4b2c-aeeb-1a78e5750f8b-kube-api-access-c4x5s\") pod \"authorino-operator-75cc8d5cb7-rrx52\" (UID: \"250210b5-f504-4b2c-aeeb-1a78e5750f8b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"
Jul 10 18:09:54.488561 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.488514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4x5s\" (UniqueName: \"kubernetes.io/projected/250210b5-f504-4b2c-aeeb-1a78e5750f8b-kube-api-access-c4x5s\") pod \"authorino-operator-75cc8d5cb7-rrx52\" (UID: \"250210b5-f504-4b2c-aeeb-1a78e5750f8b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"
Jul 10 18:09:54.502335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.502306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4x5s\" (UniqueName: \"kubernetes.io/projected/250210b5-f504-4b2c-aeeb-1a78e5750f8b-kube-api-access-c4x5s\") pod \"authorino-operator-75cc8d5cb7-rrx52\" (UID: \"250210b5-f504-4b2c-aeeb-1a78e5750f8b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"
Jul 10 18:09:54.618113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.618023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"
Jul 10 18:09:54.772685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:54.772497    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"]
Jul 10 18:09:54.776033 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:09:54.775996    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250210b5_f504_4b2c_aeeb_1a78e5750f8b.slice/crio-96f19f40824cce42d22ee897fece2f64aae41d4a94775ee9cf3915135f0a1d26 WatchSource:0}: Error finding container 96f19f40824cce42d22ee897fece2f64aae41d4a94775ee9cf3915135f0a1d26: Status 404 returned error can't find the container with id 96f19f40824cce42d22ee897fece2f64aae41d4a94775ee9cf3915135f0a1d26
Jul 10 18:09:55.245732 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.245689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:55.245928 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.245754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:55.250525 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.250498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:55.365024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.364984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:55.407973 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.407934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52" event={"ID":"250210b5-f504-4b2c-aeeb-1a78e5750f8b","Type":"ContainerStarted","Data":"96f19f40824cce42d22ee897fece2f64aae41d4a94775ee9cf3915135f0a1d26"}
Jul 10 18:09:55.411962 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.411936    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56776f75b5-9j9qc"
Jul 10 18:09:55.664235 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.664192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:55.800210 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:55.800105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:57.420391 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:57.420352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52" event={"ID":"250210b5-f504-4b2c-aeeb-1a78e5750f8b","Type":"ContainerStarted","Data":"52953d39caab94d86affd6b018e2f74dcbb8dce6ea59bc8f09850c9f59972d20"}
Jul 10 18:09:57.420919 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:57.420477    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"
Jul 10 18:09:57.448172 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:57.448115    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52" podStartSLOduration=0.98880269 podStartE2EDuration="3.44809652s" totalImagesPullingTime="2.45929383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:57.447718108 +0000 UTC m=+402.606435936" watchObservedRunningTime="2026-07-10 18:09:57.44809652 +0000 UTC m=+402.606814451"
Jul 10 18:09:58.649798 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:58.649755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:59.095848 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.095748    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"]
Jul 10 18:09:59.099342 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.099324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.102899 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.102881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9dwmg\""
Jul 10 18:09:59.112709 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.112682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"]
Jul 10 18:09:59.238394 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.238362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64593d3a-b4d6-478e-aa82-a1a41d6aec83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.238577 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.238455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n76d2\" (UniqueName: \"kubernetes.io/projected/64593d3a-b4d6-478e-aa82-a1a41d6aec83-kube-api-access-n76d2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.339570 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.339533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64593d3a-b4d6-478e-aa82-a1a41d6aec83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.339769 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.339666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n76d2\" (UniqueName: \"kubernetes.io/projected/64593d3a-b4d6-478e-aa82-a1a41d6aec83-kube-api-access-n76d2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.339977 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.339946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64593d3a-b4d6-478e-aa82-a1a41d6aec83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.352068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.352011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n76d2\" (UniqueName: \"kubernetes.io/projected/64593d3a-b4d6-478e-aa82-a1a41d6aec83-kube-api-access-n76d2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.409651 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.409615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:09:59.576583 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.576544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:59.579404 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:09:59.579377    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"]
Jul 10 18:09:59.580699 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:09:59.580671    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64593d3a_b4d6_478e_aa82_a1a41d6aec83.slice/crio-a35e0e75a3bb5b9530b4cf8e1792b027ccdb6bf6af5b3ec52a2b7cb681b3a924 WatchSource:0}: Error finding container a35e0e75a3bb5b9530b4cf8e1792b027ccdb6bf6af5b3ec52a2b7cb681b3a924: Status 404 returned error can't find the container with id a35e0e75a3bb5b9530b4cf8e1792b027ccdb6bf6af5b3ec52a2b7cb681b3a924
Jul 10 18:10:00.436227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:00.436190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7" event={"ID":"64593d3a-b4d6-478e-aa82-a1a41d6aec83","Type":"ContainerStarted","Data":"a35e0e75a3bb5b9530b4cf8e1792b027ccdb6bf6af5b3ec52a2b7cb681b3a924"}
Jul 10 18:10:01.507999 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:01.507962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:01.621596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:01.621536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:03.861975 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:03.861929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:05.426123 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:05.426090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:05.527133 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:05.527096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:05.803441 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:05.803344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:05.898531 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:05.898493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:07.470804 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:07.470767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7" event={"ID":"64593d3a-b4d6-478e-aa82-a1a41d6aec83","Type":"ContainerStarted","Data":"a3398805f2004d37c608ee80627b1774112b438ce1914124b33fbd0cd6ca5d04"}
Jul 10 18:10:07.471207 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:07.470908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:07.494566 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:07.494503    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7" podStartSLOduration=1.309858489 podStartE2EDuration="8.494485078s" totalImagesPullingTime="7.184626589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:07.492354805 +0000 UTC m=+412.651072629" watchObservedRunningTime="2026-07-10 18:10:07.494485078 +0000 UTC m=+412.653202902"
Jul 10 18:10:08.428388 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:08.428356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rrx52"
Jul 10 18:10:09.256030 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:09.255993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:09.360648 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:09.360593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:09.732202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:09.732165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:09.830291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:09.830248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:16.049722 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:16.049682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:16.150353 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:16.150302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:18.480392 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:18.480353    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:19.720082 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.720047    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"]
Jul 10 18:10:19.724350 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.724321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:19.739886 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.739850    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"]
Jul 10 18:10:19.825513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.825474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9817f15-8282-45b9-a861-f3bf5dda4193-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:19.825769 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.825520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5cns\" (UniqueName: \"kubernetes.io/projected/a9817f15-8282-45b9-a861-f3bf5dda4193-kube-api-access-w5cns\") pod \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:19.926604 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.926560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9817f15-8282-45b9-a861-f3bf5dda4193-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:19.926829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.926615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5cns\" (UniqueName: \"kubernetes.io/projected/a9817f15-8282-45b9-a861-f3bf5dda4193-kube-api-access-w5cns\") pod \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:19.927065 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.927045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9817f15-8282-45b9-a861-f3bf5dda4193-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:19.936230 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:19.936196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5cns\" (UniqueName: \"kubernetes.io/projected/a9817f15-8282-45b9-a861-f3bf5dda4193-kube-api-access-w5cns\") pod \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:20.034820 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.034713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:20.200736 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.200701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"]
Jul 10 18:10:20.203681 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:10:20.203632    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9817f15_8282_45b9_a861_f3bf5dda4193.slice/crio-52b76875d0d6c93cbb05ca3435c1a141efb6c9f10829f1e757b3a631e9623974 WatchSource:0}: Error finding container 52b76875d0d6c93cbb05ca3435c1a141efb6c9f10829f1e757b3a631e9623974: Status 404 returned error can't find the container with id 52b76875d0d6c93cbb05ca3435c1a141efb6c9f10829f1e757b3a631e9623974
Jul 10 18:10:20.296151 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.296063    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"]
Jul 10 18:10:20.313209 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.313170    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"]
Jul 10 18:10:20.321924 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.321891    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"]
Jul 10 18:10:20.322124 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.322079    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" containerName="manager" containerID="cri-o://a3398805f2004d37c608ee80627b1774112b438ce1914124b33fbd0cd6ca5d04" gracePeriod=2
Jul 10 18:10:20.341959 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.341921    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"]
Jul 10 18:10:20.343807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.343744    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"]
Jul 10 18:10:20.344214 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.344198    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" containerName="manager"
Jul 10 18:10:20.344291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.344218    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" containerName="manager"
Jul 10 18:10:20.344291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.344235    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" containerName="manager"
Jul 10 18:10:20.344291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.344241    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" containerName="manager"
Jul 10 18:10:20.344291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.344290    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" containerName="manager"
Jul 10 18:10:20.344459 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.344300    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" containerName="manager"
Jul 10 18:10:20.346918 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.346901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.347398 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.347369    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"64593d3a-b4d6-478e-aa82-a1a41d6aec83\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-w42v7\": pods \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:20.349888 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.349857    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:20.359523 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.359490    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"]
Jul 10 18:10:20.363313 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.363291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.382122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.382090    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"]
Jul 10 18:10:20.395041 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.394971    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"]
Jul 10 18:10:20.402164 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.402126    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:20.431785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.431747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghkm\" (UniqueName: \"kubernetes.io/projected/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-kube-api-access-vghkm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vkwpk\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.431966 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.431806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e84d94-78d1-4e66-8853-c278ef80495d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-grvwn\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.431966 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.431834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vkwpk\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.431966 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.431865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7x5k\" (UniqueName: \"kubernetes.io/projected/05e84d94-78d1-4e66-8853-c278ef80495d-kube-api-access-s7x5k\") pod \"kuadrant-operator-controller-manager-55467d9f7-grvwn\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.532778 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.532745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghkm\" (UniqueName: \"kubernetes.io/projected/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-kube-api-access-vghkm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vkwpk\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.532969 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.532797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e84d94-78d1-4e66-8853-c278ef80495d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-grvwn\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.532969 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.532913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vkwpk\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.532969 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.532957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7x5k\" (UniqueName: \"kubernetes.io/projected/05e84d94-78d1-4e66-8853-c278ef80495d-kube-api-access-s7x5k\") pod \"kuadrant-operator-controller-manager-55467d9f7-grvwn\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.533220 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.533196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e84d94-78d1-4e66-8853-c278ef80495d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-grvwn\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.533283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.533272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vkwpk\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.537858 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.537831    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g" container="manager"
Jul 10 18:10:20.539544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.539517    2565 generic.go:356] "Generic (PLEG): container finished" podID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" containerID="a3398805f2004d37c608ee80627b1774112b438ce1914124b33fbd0cd6ca5d04" exitCode=0
Jul 10 18:10:20.540050 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.540025    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:20.542199 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.542164    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:20.550468 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.550411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghkm\" (UniqueName: \"kubernetes.io/projected/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-kube-api-access-vghkm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vkwpk\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.558611 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.558584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7x5k\" (UniqueName: \"kubernetes.io/projected/05e84d94-78d1-4e66-8853-c278ef80495d-kube-api-access-s7x5k\") pod \"kuadrant-operator-controller-manager-55467d9f7-grvwn\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.565997 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.565971    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:20.568541 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.568510    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w42v7\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:20.570840 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:20.570817    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:20.634021 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.633982    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n76d2\" (UniqueName: \"kubernetes.io/projected/64593d3a-b4d6-478e-aa82-a1a41d6aec83-kube-api-access-n76d2\") pod \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") "
Jul 10 18:10:20.634188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.634033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64593d3a-b4d6-478e-aa82-a1a41d6aec83-extensions-socket-volume\") pod \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\" (UID: \"64593d3a-b4d6-478e-aa82-a1a41d6aec83\") "
Jul 10 18:10:20.635458 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.634842    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64593d3a-b4d6-478e-aa82-a1a41d6aec83-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "64593d3a-b4d6-478e-aa82-a1a41d6aec83" (UID: "64593d3a-b4d6-478e-aa82-a1a41d6aec83"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:10:20.637735 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.637012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64593d3a-b4d6-478e-aa82-a1a41d6aec83-kube-api-access-n76d2" (OuterVolumeSpecName: "kube-api-access-n76d2") pod "64593d3a-b4d6-478e-aa82-a1a41d6aec83" (UID: "64593d3a-b4d6-478e-aa82-a1a41d6aec83"). InnerVolumeSpecName "kube-api-access-n76d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:10:20.709192 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.709140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:20.716218 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.716191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:20.736176 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.736142    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n76d2\" (UniqueName: \"kubernetes.io/projected/64593d3a-b4d6-478e-aa82-a1a41d6aec83-kube-api-access-n76d2\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:20.736176 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.736174    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64593d3a-b4d6-478e-aa82-a1a41d6aec83-extensions-socket-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:20.831506 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.831415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:20.871376 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.871342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"]
Jul 10 18:10:20.873769 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:10:20.873734    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e84d94_78d1_4e66_8853_c278ef80495d.slice/crio-f4125fb4af1ac10692683ce0d18e403f8f6fe6699a6977ba1446c13a4751b778 WatchSource:0}: Error finding container f4125fb4af1ac10692683ce0d18e403f8f6fe6699a6977ba1446c13a4751b778: Status 404 returned error can't find the container with id f4125fb4af1ac10692683ce0d18e403f8f6fe6699a6977ba1446c13a4751b778
Jul 10 18:10:20.892957 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.892930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"]
Jul 10 18:10:20.896284 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:10:20.896224    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa052bb4_1e7e_4ca5_af0e_39921db71a4a.slice/crio-a378b6fdb17ebfd6f89c097f84fbb18d3ce037d4087f74039ea18a7ff2e5eb8a WatchSource:0}: Error finding container a378b6fdb17ebfd6f89c097f84fbb18d3ce037d4087f74039ea18a7ff2e5eb8a: Status 404 returned error can't find the container with id a378b6fdb17ebfd6f89c097f84fbb18d3ce037d4087f74039ea18a7ff2e5eb8a
Jul 10 18:10:20.940975 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:20.940921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:21.532121 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.532087    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64593d3a-b4d6-478e-aa82-a1a41d6aec83" path="/var/lib/kubelet/pods/64593d3a-b4d6-478e-aa82-a1a41d6aec83/volumes"
Jul 10 18:10:21.545649 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.545594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk" event={"ID":"fa052bb4-1e7e-4ca5-af0e-39921db71a4a","Type":"ContainerStarted","Data":"78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c"}
Jul 10 18:10:21.545856 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.545685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk" event={"ID":"fa052bb4-1e7e-4ca5-af0e-39921db71a4a","Type":"ContainerStarted","Data":"a378b6fdb17ebfd6f89c097f84fbb18d3ce037d4087f74039ea18a7ff2e5eb8a"}
Jul 10 18:10:21.545856 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.545825    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:21.547405 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.547348    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" containerName="manager" containerID="cri-o://ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43" gracePeriod=2
Jul 10 18:10:21.548756 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.548734    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w42v7"
Jul 10 18:10:21.548857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.548765    2565 scope.go:117] "RemoveContainer" containerID="a3398805f2004d37c608ee80627b1774112b438ce1914124b33fbd0cd6ca5d04"
Jul 10 18:10:21.550590 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.550498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn" event={"ID":"05e84d94-78d1-4e66-8853-c278ef80495d","Type":"ContainerStarted","Data":"c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18"}
Jul 10 18:10:21.550590 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.550554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn" event={"ID":"05e84d94-78d1-4e66-8853-c278ef80495d","Type":"ContainerStarted","Data":"f4125fb4af1ac10692683ce0d18e403f8f6fe6699a6977ba1446c13a4751b778"}
Jul 10 18:10:21.550764 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.550698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:21.571170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.571114    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk" podStartSLOduration=1.5710940199999999 podStartE2EDuration="1.57109402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:21.568819841 +0000 UTC m=+426.727537666" watchObservedRunningTime="2026-07-10 18:10:21.57109402 +0000 UTC m=+426.729811822"
Jul 10 18:10:21.598045 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.597981    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn" podStartSLOduration=1.5979610480000002 podStartE2EDuration="1.597961048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:21.596705728 +0000 UTC m=+426.755423554" watchObservedRunningTime="2026-07-10 18:10:21.597961048 +0000 UTC m=+426.756678872"
Jul 10 18:10:21.798181 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.798108    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:21.800817 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:21.800788    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:21.846313 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.846271    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9817f15-8282-45b9-a861-f3bf5dda4193-extensions-socket-volume\") pod \"a9817f15-8282-45b9-a861-f3bf5dda4193\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") "
Jul 10 18:10:21.846489 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.846367    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5cns\" (UniqueName: \"kubernetes.io/projected/a9817f15-8282-45b9-a861-f3bf5dda4193-kube-api-access-w5cns\") pod \"a9817f15-8282-45b9-a861-f3bf5dda4193\" (UID: \"a9817f15-8282-45b9-a861-f3bf5dda4193\") "
Jul 10 18:10:21.846533 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.846517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9817f15-8282-45b9-a861-f3bf5dda4193-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a9817f15-8282-45b9-a861-f3bf5dda4193" (UID: "a9817f15-8282-45b9-a861-f3bf5dda4193"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:10:21.846609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.846595    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9817f15-8282-45b9-a861-f3bf5dda4193-extensions-socket-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:21.848480 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.848441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9817f15-8282-45b9-a861-f3bf5dda4193-kube-api-access-w5cns" (OuterVolumeSpecName: "kube-api-access-w5cns") pod "a9817f15-8282-45b9-a861-f3bf5dda4193" (UID: "a9817f15-8282-45b9-a861-f3bf5dda4193"). InnerVolumeSpecName "kube-api-access-w5cns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:10:21.947716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:21.947674    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5cns\" (UniqueName: \"kubernetes.io/projected/a9817f15-8282-45b9-a861-f3bf5dda4193-kube-api-access-w5cns\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:22.556361 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:22.556325    2565 generic.go:356] "Generic (PLEG): container finished" podID="a9817f15-8282-45b9-a861-f3bf5dda4193" containerID="ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43" exitCode=2
Jul 10 18:10:22.556568 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:22.556370    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:22.556568 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:22.556420    2565 scope.go:117] "RemoveContainer" containerID="ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43"
Jul 10 18:10:22.559214 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:22.559186    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:22.565286 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:22.565265    2565 scope.go:117] "RemoveContainer" containerID="ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43"
Jul 10 18:10:22.565592 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:22.565573    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43\": container with ID starting with ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43 not found: ID does not exist" containerID="ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43"
Jul 10 18:10:22.565661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:22.565602    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43"} err="failed to get container status \"ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43\": rpc error: code = NotFound desc = could not find container \"ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43\": container with ID starting with ece5056af2b006a22f3b7788141d4980f8bb1d10f62f8ee4741fd7a587306f43 not found: ID does not exist"
Jul 10 18:10:22.567209 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:22.567187    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xbp2g\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xbp2g"
Jul 10 18:10:23.529687 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:23.529625    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9817f15-8282-45b9-a861-f3bf5dda4193" path="/var/lib/kubelet/pods/a9817f15-8282-45b9-a861-f3bf5dda4193/volumes"
Jul 10 18:10:24.788225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:24.788184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:24.856226 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:24.856188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:25.395600 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:25.395562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:25.542831 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:25.542778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:28.985002 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:28.984964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:29.066961 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:29.066921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:32.560608 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.560578    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:32.561006 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.560675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:32.659180 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.659144    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"]
Jul 10 18:10:32.659400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.659373    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk" podUID="fa052bb4-1e7e-4ca5-af0e-39921db71a4a" containerName="manager" containerID="cri-o://78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c" gracePeriod=10
Jul 10 18:10:32.911401 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.911375    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:32.920135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.920104    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"]
Jul 10 18:10:32.920613 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.920598    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa052bb4-1e7e-4ca5-af0e-39921db71a4a" containerName="manager"
Jul 10 18:10:32.920670 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.920616    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa052bb4-1e7e-4ca5-af0e-39921db71a4a" containerName="manager"
Jul 10 18:10:32.920705 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.920698    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa052bb4-1e7e-4ca5-af0e-39921db71a4a" containerName="manager"
Jul 10 18:10:32.922821 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.922798    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:32.948576 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:32.948541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"]
Jul 10 18:10:33.047141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.047101    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-extensions-socket-volume\") pod \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") "
Jul 10 18:10:33.047340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.047176    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vghkm\" (UniqueName: \"kubernetes.io/projected/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-kube-api-access-vghkm\") pod \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\" (UID: \"fa052bb4-1e7e-4ca5-af0e-39921db71a4a\") "
Jul 10 18:10:33.047489 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.047464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lb9gh\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.047565 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.047516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9sgs\" (UniqueName: \"kubernetes.io/projected/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-kube-api-access-j9sgs\") pod \"kuadrant-operator-controller-manager-86878c769f-lb9gh\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.047565 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.047544    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fa052bb4-1e7e-4ca5-af0e-39921db71a4a" (UID: "fa052bb4-1e7e-4ca5-af0e-39921db71a4a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:10:33.047686 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.047672    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-extensions-socket-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:33.049280 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.049260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-kube-api-access-vghkm" (OuterVolumeSpecName: "kube-api-access-vghkm") pod "fa052bb4-1e7e-4ca5-af0e-39921db71a4a" (UID: "fa052bb4-1e7e-4ca5-af0e-39921db71a4a"). InnerVolumeSpecName "kube-api-access-vghkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:10:33.148294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.148259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lb9gh\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.148466 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.148311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9sgs\" (UniqueName: \"kubernetes.io/projected/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-kube-api-access-j9sgs\") pod \"kuadrant-operator-controller-manager-86878c769f-lb9gh\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.148466 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.148385    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vghkm\" (UniqueName: \"kubernetes.io/projected/fa052bb4-1e7e-4ca5-af0e-39921db71a4a-kube-api-access-vghkm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:33.148690 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.148672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lb9gh\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.169108 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.169076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9sgs\" (UniqueName: \"kubernetes.io/projected/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-kube-api-access-j9sgs\") pod \"kuadrant-operator-controller-manager-86878c769f-lb9gh\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.233034 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.232992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.386214 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.386179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"]
Jul 10 18:10:33.389559 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:10:33.389531    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3c2c78_e47f_4eb5_b981_15e8dfd2f116.slice/crio-987a88323b0cd63a41ac3f3f88c4bd2773650fd65a52965813e1b1fd8980c275 WatchSource:0}: Error finding container 987a88323b0cd63a41ac3f3f88c4bd2773650fd65a52965813e1b1fd8980c275: Status 404 returned error can't find the container with id 987a88323b0cd63a41ac3f3f88c4bd2773650fd65a52965813e1b1fd8980c275
Jul 10 18:10:33.614349 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.614316    2565 generic.go:356] "Generic (PLEG): container finished" podID="fa052bb4-1e7e-4ca5-af0e-39921db71a4a" containerID="78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c" exitCode=0
Jul 10 18:10:33.614863 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.614367    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"
Jul 10 18:10:33.614863 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.614408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk" event={"ID":"fa052bb4-1e7e-4ca5-af0e-39921db71a4a","Type":"ContainerDied","Data":"78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c"}
Jul 10 18:10:33.614863 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.614475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk" event={"ID":"fa052bb4-1e7e-4ca5-af0e-39921db71a4a","Type":"ContainerDied","Data":"a378b6fdb17ebfd6f89c097f84fbb18d3ce037d4087f74039ea18a7ff2e5eb8a"}
Jul 10 18:10:33.614863 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.614508    2565 scope.go:117] "RemoveContainer" containerID="78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c"
Jul 10 18:10:33.616229 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.616206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh" event={"ID":"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116","Type":"ContainerStarted","Data":"7e559822deae5dcfa24b27a46ccbede23e501fca4615907dae20f19d6da0c2e9"}
Jul 10 18:10:33.616362 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.616253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh" event={"ID":"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116","Type":"ContainerStarted","Data":"987a88323b0cd63a41ac3f3f88c4bd2773650fd65a52965813e1b1fd8980c275"}
Jul 10 18:10:33.616362 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.616352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:33.623538 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.623514    2565 scope.go:117] "RemoveContainer" containerID="78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c"
Jul 10 18:10:33.623917 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:33.623887    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c\": container with ID starting with 78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c not found: ID does not exist" containerID="78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c"
Jul 10 18:10:33.624017 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.623929    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c"} err="failed to get container status \"78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c\": rpc error: code = NotFound desc = could not find container \"78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c\": container with ID starting with 78d3866ee129ff43adab29cdd6a2555fc1aeddd0eb55e82a68de72e62bd2893c not found: ID does not exist"
Jul 10 18:10:33.638848 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.638679    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh" podStartSLOduration=1.6386271890000002 podStartE2EDuration="1.638627189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:33.638348899 +0000 UTC m=+438.797066725" watchObservedRunningTime="2026-07-10 18:10:33.638627189 +0000 UTC m=+438.797345016"
Jul 10 18:10:33.654896 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.654804    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"]
Jul 10 18:10:33.660788 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:33.660753    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vkwpk"]
Jul 10 18:10:35.528961 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:35.528928    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa052bb4-1e7e-4ca5-af0e-39921db71a4a" path="/var/lib/kubelet/pods/fa052bb4-1e7e-4ca5-af0e-39921db71a4a/volumes"
Jul 10 18:10:36.783309 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:36.783213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:36.850200 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:36.850161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:40.630953 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:40.630906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:40.752109 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:40.752071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:44.625227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:44.625193    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:10:44.688537 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:44.688486    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"]
Jul 10 18:10:44.688938 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:44.688766    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn" podUID="05e84d94-78d1-4e66-8853-c278ef80495d" containerName="manager" containerID="cri-o://c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18" gracePeriod=10
Jul 10 18:10:44.940617 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:44.940586    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:45.057949 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.057914    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7x5k\" (UniqueName: \"kubernetes.io/projected/05e84d94-78d1-4e66-8853-c278ef80495d-kube-api-access-s7x5k\") pod \"05e84d94-78d1-4e66-8853-c278ef80495d\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") "
Jul 10 18:10:45.058120 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.057993    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e84d94-78d1-4e66-8853-c278ef80495d-extensions-socket-volume\") pod \"05e84d94-78d1-4e66-8853-c278ef80495d\" (UID: \"05e84d94-78d1-4e66-8853-c278ef80495d\") "
Jul 10 18:10:45.058378 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.058354    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e84d94-78d1-4e66-8853-c278ef80495d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05e84d94-78d1-4e66-8853-c278ef80495d" (UID: "05e84d94-78d1-4e66-8853-c278ef80495d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:10:45.060100 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.060074    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e84d94-78d1-4e66-8853-c278ef80495d-kube-api-access-s7x5k" (OuterVolumeSpecName: "kube-api-access-s7x5k") pod "05e84d94-78d1-4e66-8853-c278ef80495d" (UID: "05e84d94-78d1-4e66-8853-c278ef80495d"). InnerVolumeSpecName "kube-api-access-s7x5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:10:45.159289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.159254    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7x5k\" (UniqueName: \"kubernetes.io/projected/05e84d94-78d1-4e66-8853-c278ef80495d-kube-api-access-s7x5k\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:45.159289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.159282    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e84d94-78d1-4e66-8853-c278ef80495d-extensions-socket-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:10:45.679896 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.679860    2565 generic.go:356] "Generic (PLEG): container finished" podID="05e84d94-78d1-4e66-8853-c278ef80495d" containerID="c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18" exitCode=0
Jul 10 18:10:45.680374 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.679908    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"
Jul 10 18:10:45.680374 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.679945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn" event={"ID":"05e84d94-78d1-4e66-8853-c278ef80495d","Type":"ContainerDied","Data":"c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18"}
Jul 10 18:10:45.680374 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.680013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn" event={"ID":"05e84d94-78d1-4e66-8853-c278ef80495d","Type":"ContainerDied","Data":"f4125fb4af1ac10692683ce0d18e403f8f6fe6699a6977ba1446c13a4751b778"}
Jul 10 18:10:45.680374 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.680052    2565 scope.go:117] "RemoveContainer" containerID="c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18"
Jul 10 18:10:45.688994 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.688966    2565 scope.go:117] "RemoveContainer" containerID="c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18"
Jul 10 18:10:45.689293 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:10:45.689273    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18\": container with ID starting with c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18 not found: ID does not exist" containerID="c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18"
Jul 10 18:10:45.689363 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.689306    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18"} err="failed to get container status \"c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18\": rpc error: code = NotFound desc = could not find container \"c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18\": container with ID starting with c1c4af755f9c08e9c6ba3a16bac3e63538ec7170d45b3e8b99f8e59875fb1e18 not found: ID does not exist"
Jul 10 18:10:45.703306 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.703274    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"]
Jul 10 18:10:45.707359 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:45.707324    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grvwn"]
Jul 10 18:10:47.528890 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:47.528851    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e84d94-78d1-4e66-8853-c278ef80495d" path="/var/lib/kubelet/pods/05e84d94-78d1-4e66-8853-c278ef80495d/volumes"
Jul 10 18:10:49.064172 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.064141    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"]
Jul 10 18:10:49.064550 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.064515    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e84d94-78d1-4e66-8853-c278ef80495d" containerName="manager"
Jul 10 18:10:49.064550 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.064527    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e84d94-78d1-4e66-8853-c278ef80495d" containerName="manager"
Jul 10 18:10:49.064618 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.064586    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e84d94-78d1-4e66-8853-c278ef80495d" containerName="manager"
Jul 10 18:10:49.069814 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.068531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.072253 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.072227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-56qd5\""
Jul 10 18:10:49.083548 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.083517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"]
Jul 10 18:10:49.091461 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.091420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:49.196612 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqkv5\" (UniqueName: \"kubernetes.io/projected/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-kube-api-access-nqkv5\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.196612 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.196897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.196897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.196897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.196897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.196897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.196897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.197171 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.196928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.297980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqkv5\" (UniqueName: \"kubernetes.io/projected/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-kube-api-access-nqkv5\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298681    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.298938 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.298904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.300744 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.300719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.300896 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.300875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.307662 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.307598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.307819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.307719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqkv5\" (UniqueName: \"kubernetes.io/projected/c015c4b8-69cd-499b-90fb-4d1e8a8d9594-kube-api-access-nqkv5\") pod \"maas-default-gateway-openshift-default-56654dcf7-xg4wc\" (UID: \"c015c4b8-69cd-499b-90fb-4d1e8a8d9594\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.382326 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.382292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:49.439662 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.439603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:49.533208 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.533123    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"]
Jul 10 18:10:49.537137 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:10:49.537102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc015c4b8_69cd_499b_90fb_4d1e8a8d9594.slice/crio-79129f505c07ac5c5c87a804e607b8e6f5c3662d447a94e3c143d980ce1e0d4e WatchSource:0}: Error finding container 79129f505c07ac5c5c87a804e607b8e6f5c3662d447a94e3c143d980ce1e0d4e: Status 404 returned error can't find the container with id 79129f505c07ac5c5c87a804e607b8e6f5c3662d447a94e3c143d980ce1e0d4e
Jul 10 18:10:49.539393 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.539359    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:10:49.539455 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.539429    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:10:49.539489 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.539460    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:10:49.703232 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.703136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" event={"ID":"c015c4b8-69cd-499b-90fb-4d1e8a8d9594","Type":"ContainerStarted","Data":"a2e3644d9fed7947ccbccc21151732a791466d48cd69759d3c263d6c6547c191"}
Jul 10 18:10:49.703232 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.703200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" event={"ID":"c015c4b8-69cd-499b-90fb-4d1e8a8d9594","Type":"ContainerStarted","Data":"79129f505c07ac5c5c87a804e607b8e6f5c3662d447a94e3c143d980ce1e0d4e"}
Jul 10 18:10:49.724484 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:49.724426    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" podStartSLOduration=0.724404852 podStartE2EDuration="724.404852ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:49.723108531 +0000 UTC m=+454.881826357" watchObservedRunningTime="2026-07-10 18:10:49.724404852 +0000 UTC m=+454.883122677"
Jul 10 18:10:50.382837 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:50.382799    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:50.387782 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:50.387751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:50.708270 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:50.708185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:50.709315 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:50.709293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:10:53.677595 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:53.677557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:53.745218 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:10:53.745179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:00.955783 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:00.955746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:00.964623 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:00.964589    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fblht"]
Jul 10 18:11:00.967264 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:00.967243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:00.971572 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:00.971549    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kdj45\""
Jul 10 18:11:00.971870 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:00.971853    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 18:11:00.981500 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:00.981466    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fblht"]
Jul 10 18:11:01.014251 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.014210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bfgk\" (UniqueName: \"kubernetes.io/projected/4a90196b-27e9-4ce0-97d8-de18267b57ad-kube-api-access-5bfgk\") pod \"limitador-limitador-64c94fd64f-fblht\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:01.014430 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.014362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a90196b-27e9-4ce0-97d8-de18267b57ad-config-file\") pod \"limitador-limitador-64c94fd64f-fblht\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:01.057968 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.057935    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fblht"]
Jul 10 18:11:01.085223 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.085184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:01.115493 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.115456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bfgk\" (UniqueName: \"kubernetes.io/projected/4a90196b-27e9-4ce0-97d8-de18267b57ad-kube-api-access-5bfgk\") pod \"limitador-limitador-64c94fd64f-fblht\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:01.115714 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.115527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a90196b-27e9-4ce0-97d8-de18267b57ad-config-file\") pod \"limitador-limitador-64c94fd64f-fblht\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:01.116177 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.116157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a90196b-27e9-4ce0-97d8-de18267b57ad-config-file\") pod \"limitador-limitador-64c94fd64f-fblht\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:01.125507 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.125475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bfgk\" (UniqueName: \"kubernetes.io/projected/4a90196b-27e9-4ce0-97d8-de18267b57ad-kube-api-access-5bfgk\") pod \"limitador-limitador-64c94fd64f-fblht\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:01.187006 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.186963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:01.278368 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.278272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:01.427538 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.427510    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fblht"]
Jul 10 18:11:01.429747 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:11:01.429718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a90196b_27e9_4ce0_97d8_de18267b57ad.slice/crio-8147bb9d0eefdd0f4130786216cd56dbc7b2e8d085e18a492095db7b147a916d WatchSource:0}: Error finding container 8147bb9d0eefdd0f4130786216cd56dbc7b2e8d085e18a492095db7b147a916d: Status 404 returned error can't find the container with id 8147bb9d0eefdd0f4130786216cd56dbc7b2e8d085e18a492095db7b147a916d
Jul 10 18:11:01.771843 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.771801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht" event={"ID":"4a90196b-27e9-4ce0-97d8-de18267b57ad","Type":"ContainerStarted","Data":"8147bb9d0eefdd0f4130786216cd56dbc7b2e8d085e18a492095db7b147a916d"}
Jul 10 18:11:01.836900 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.836868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:01.934596 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:01.934562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:04.796457 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:04.796418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht" event={"ID":"4a90196b-27e9-4ce0-97d8-de18267b57ad","Type":"ContainerStarted","Data":"44df740bc5b5406b9b6cfb9921bf24ab5729ba9f825e6a9ab6d9314ee7649464"}
Jul 10 18:11:04.796974 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:04.796546    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:04.821932 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:04.821871    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht" podStartSLOduration=2.100527201 podStartE2EDuration="4.821853412s" totalImagesPullingTime="2.721326211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:11:04.820469841 +0000 UTC m=+469.979187668" watchObservedRunningTime="2026-07-10 18:11:04.821853412 +0000 UTC m=+469.980571281"
Jul 10 18:11:15.413498 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:15.413462    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fblht"]
Jul 10 18:11:15.413976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:15.413711    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht" podUID="4a90196b-27e9-4ce0-97d8-de18267b57ad" containerName="limitador" containerID="cri-o://44df740bc5b5406b9b6cfb9921bf24ab5729ba9f825e6a9ab6d9314ee7649464" gracePeriod=30
Jul 10 18:11:15.414407 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:15.414387    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:15.853323 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:15.853288    2565 generic.go:356] "Generic (PLEG): container finished" podID="4a90196b-27e9-4ce0-97d8-de18267b57ad" containerID="44df740bc5b5406b9b6cfb9921bf24ab5729ba9f825e6a9ab6d9314ee7649464" exitCode=0
Jul 10 18:11:15.853491 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:15.853361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht" event={"ID":"4a90196b-27e9-4ce0-97d8-de18267b57ad","Type":"ContainerDied","Data":"44df740bc5b5406b9b6cfb9921bf24ab5729ba9f825e6a9ab6d9314ee7649464"}
Jul 10 18:11:16.371953 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.371926    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:16.467458 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.467417    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bfgk\" (UniqueName: \"kubernetes.io/projected/4a90196b-27e9-4ce0-97d8-de18267b57ad-kube-api-access-5bfgk\") pod \"4a90196b-27e9-4ce0-97d8-de18267b57ad\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") "
Jul 10 18:11:16.467882 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.467494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a90196b-27e9-4ce0-97d8-de18267b57ad-config-file\") pod \"4a90196b-27e9-4ce0-97d8-de18267b57ad\" (UID: \"4a90196b-27e9-4ce0-97d8-de18267b57ad\") "
Jul 10 18:11:16.467927 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.467884    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a90196b-27e9-4ce0-97d8-de18267b57ad-config-file" (OuterVolumeSpecName: "config-file") pod "4a90196b-27e9-4ce0-97d8-de18267b57ad" (UID: "4a90196b-27e9-4ce0-97d8-de18267b57ad"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:11:16.469609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.469585    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a90196b-27e9-4ce0-97d8-de18267b57ad-kube-api-access-5bfgk" (OuterVolumeSpecName: "kube-api-access-5bfgk") pod "4a90196b-27e9-4ce0-97d8-de18267b57ad" (UID: "4a90196b-27e9-4ce0-97d8-de18267b57ad"). InnerVolumeSpecName "kube-api-access-5bfgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:11:16.568575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.568482    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bfgk\" (UniqueName: \"kubernetes.io/projected/4a90196b-27e9-4ce0-97d8-de18267b57ad-kube-api-access-5bfgk\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:11:16.568575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.568517    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a90196b-27e9-4ce0-97d8-de18267b57ad-config-file\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:11:16.860281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.860198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht" event={"ID":"4a90196b-27e9-4ce0-97d8-de18267b57ad","Type":"ContainerDied","Data":"8147bb9d0eefdd0f4130786216cd56dbc7b2e8d085e18a492095db7b147a916d"}
Jul 10 18:11:16.860281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.860218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fblht"
Jul 10 18:11:16.860281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.860256    2565 scope.go:117] "RemoveContainer" containerID="44df740bc5b5406b9b6cfb9921bf24ab5729ba9f825e6a9ab6d9314ee7649464"
Jul 10 18:11:16.884442 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.884409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fblht"]
Jul 10 18:11:16.890934 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:16.890906    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fblht"]
Jul 10 18:11:17.011460 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.011428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:17.112399 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.112255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:17.486884 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.486833    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"]
Jul 10 18:11:17.487740 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.487713    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a90196b-27e9-4ce0-97d8-de18267b57ad" containerName="limitador"
Jul 10 18:11:17.487740 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.487743    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a90196b-27e9-4ce0-97d8-de18267b57ad" containerName="limitador"
Jul 10 18:11:17.487964 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.487951    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a90196b-27e9-4ce0-97d8-de18267b57ad" containerName="limitador"
Jul 10 18:11:17.492922 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.492888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.495854 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.495826    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 18:11:17.496115 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.496090    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-49fcg\""
Jul 10 18:11:17.496115 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.496099    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 18:11:17.496355 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.496337    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 18:11:17.497328 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.497293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"]
Jul 10 18:11:17.517194 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.517152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:17.528973 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.528938    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a90196b-27e9-4ce0-97d8-de18267b57ad" path="/var/lib/kubelet/pods/4a90196b-27e9-4ce0-97d8-de18267b57ad/volumes"
Jul 10 18:11:17.577942 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.577908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5b32b82c-6be9-46e1-b847-29647a488d9f-data\") pod \"postgres-69fb4594cf-p2fs6\" (UID: \"5b32b82c-6be9-46e1-b847-29647a488d9f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.578133 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.577966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj62j\" (UniqueName: \"kubernetes.io/projected/5b32b82c-6be9-46e1-b847-29647a488d9f-kube-api-access-qj62j\") pod \"postgres-69fb4594cf-p2fs6\" (UID: \"5b32b82c-6be9-46e1-b847-29647a488d9f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.678502 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.678461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5b32b82c-6be9-46e1-b847-29647a488d9f-data\") pod \"postgres-69fb4594cf-p2fs6\" (UID: \"5b32b82c-6be9-46e1-b847-29647a488d9f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.678502 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.678506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj62j\" (UniqueName: \"kubernetes.io/projected/5b32b82c-6be9-46e1-b847-29647a488d9f-kube-api-access-qj62j\") pod \"postgres-69fb4594cf-p2fs6\" (UID: \"5b32b82c-6be9-46e1-b847-29647a488d9f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.679006 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.678985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5b32b82c-6be9-46e1-b847-29647a488d9f-data\") pod \"postgres-69fb4594cf-p2fs6\" (UID: \"5b32b82c-6be9-46e1-b847-29647a488d9f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.687868 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.687841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj62j\" (UniqueName: \"kubernetes.io/projected/5b32b82c-6be9-46e1-b847-29647a488d9f-kube-api-access-qj62j\") pod \"postgres-69fb4594cf-p2fs6\" (UID: \"5b32b82c-6be9-46e1-b847-29647a488d9f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.807126 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.807028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:17.954364 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:17.954332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"]
Jul 10 18:11:17.956760 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:11:17.956721    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b32b82c_6be9_46e1_b847_29647a488d9f.slice/crio-4961b04d9eb7b75a764136e3e11c3e89c6ac978db96151053560c9bdf8a127d6 WatchSource:0}: Error finding container 4961b04d9eb7b75a764136e3e11c3e89c6ac978db96151053560c9bdf8a127d6: Status 404 returned error can't find the container with id 4961b04d9eb7b75a764136e3e11c3e89c6ac978db96151053560c9bdf8a127d6
Jul 10 18:11:18.879314 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:18.879224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6" event={"ID":"5b32b82c-6be9-46e1-b847-29647a488d9f","Type":"ContainerStarted","Data":"4961b04d9eb7b75a764136e3e11c3e89c6ac978db96151053560c9bdf8a127d6"}
Jul 10 18:11:22.903566 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:22.903530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6" event={"ID":"5b32b82c-6be9-46e1-b847-29647a488d9f","Type":"ContainerStarted","Data":"3ef2973f2e3cf4e322e8e69f85b7e11255a9091a73ccd06b425f34373053cfb8"}
Jul 10 18:11:22.904002 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:22.903655    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:22.921495 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:22.921439    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6" podStartSLOduration=1.156781694 podStartE2EDuration="5.921421969s" totalImagesPullingTime="4.764640275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:11:22.92066596 +0000 UTC m=+488.079383787" watchObservedRunningTime="2026-07-10 18:11:22.921421969 +0000 UTC m=+488.080139793"
Jul 10 18:11:28.942785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:28.942756    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p2fs6"
Jul 10 18:11:29.311236 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:29.311148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:29.457450 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:29.457410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:35.791952 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:35.791918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:35.873969 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:35.873936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:35.936274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:35.936228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:36.039717 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.039683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:36.261968 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.261924    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-zccl7"]
Jul 10 18:11:36.284846 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.284808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-zccl7"]
Jul 10 18:11:36.284846 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.284838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.290385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.290278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:11:36.290385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.290278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:11:36.290385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.290278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vzgps\""
Jul 10 18:11:36.354133 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.354086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44ea4561-a9f2-432a-bbb0-6673a3ef5411-webhook-cert\") pod \"maas-controller-7dcb6c7c86-zccl7\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") " pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.354332 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.354156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q76c8\" (UniqueName: \"kubernetes.io/projected/44ea4561-a9f2-432a-bbb0-6673a3ef5411-kube-api-access-q76c8\") pod \"maas-controller-7dcb6c7c86-zccl7\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") " pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.454825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.454782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44ea4561-a9f2-432a-bbb0-6673a3ef5411-webhook-cert\") pod \"maas-controller-7dcb6c7c86-zccl7\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") " pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.455001 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.454842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q76c8\" (UniqueName: \"kubernetes.io/projected/44ea4561-a9f2-432a-bbb0-6673a3ef5411-kube-api-access-q76c8\") pod \"maas-controller-7dcb6c7c86-zccl7\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") " pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.457309 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.457283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44ea4561-a9f2-432a-bbb0-6673a3ef5411-webhook-cert\") pod \"maas-controller-7dcb6c7c86-zccl7\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") " pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.464327 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.464295    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q76c8\" (UniqueName: \"kubernetes.io/projected/44ea4561-a9f2-432a-bbb0-6673a3ef5411-kube-api-access-q76c8\") pod \"maas-controller-7dcb6c7c86-zccl7\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") " pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.596015 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.595921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:36.742840 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.742812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-zccl7"]
Jul 10 18:11:36.744486 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:11:36.744461    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ea4561_a9f2_432a_bbb0_6673a3ef5411.slice/crio-23cd231546f5ad5839c97976893eed081e2bbed300059980bd8e824ef6d7627e WatchSource:0}: Error finding container 23cd231546f5ad5839c97976893eed081e2bbed300059980bd8e824ef6d7627e: Status 404 returned error can't find the container with id 23cd231546f5ad5839c97976893eed081e2bbed300059980bd8e824ef6d7627e
Jul 10 18:11:36.976056 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:36.976020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7" event={"ID":"44ea4561-a9f2-432a-bbb0-6673a3ef5411","Type":"ContainerStarted","Data":"23cd231546f5ad5839c97976893eed081e2bbed300059980bd8e824ef6d7627e"}
Jul 10 18:11:38.581826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:38.581773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:38.694381 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:38.694344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:38.987555 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:38.987463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7" event={"ID":"44ea4561-a9f2-432a-bbb0-6673a3ef5411","Type":"ContainerStarted","Data":"5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35"}
Jul 10 18:11:38.987555 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:38.987545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:11:39.016200 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:39.016146    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7" podStartSLOduration=1.381526745 podStartE2EDuration="3.016128347s" totalImagesPullingTime="1.634601602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:11:39.014936119 +0000 UTC m=+504.173653944" watchObservedRunningTime="2026-07-10 18:11:39.016128347 +0000 UTC m=+504.174846172"
Jul 10 18:11:43.388163 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:43.388125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:50.001759 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:11:50.001730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:12:07.362134 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:07.362037    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:13.626077 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:13.625994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:14.149172 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.149130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:14.206120 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.206087    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"]
Jul 10 18:12:14.210972 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.210951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.217674 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.214895    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bnn28\""
Jul 10 18:12:14.217674 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.214935    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 18:12:14.220015 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.219975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghzk\" (UniqueName: \"kubernetes.io/projected/88b15721-8090-4063-8019-1b3c7522f466-kube-api-access-gghzk\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.220205 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.220061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b15721-8090-4063-8019-1b3c7522f466-openshift-service-ca\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.220205 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.220127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b15721-8090-4063-8019-1b3c7522f466-maas-api-tls\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.226487 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.226457    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"]
Jul 10 18:12:14.321331 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.321293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b15721-8090-4063-8019-1b3c7522f466-maas-api-tls\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.321536 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.321374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghzk\" (UniqueName: \"kubernetes.io/projected/88b15721-8090-4063-8019-1b3c7522f466-kube-api-access-gghzk\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.321536 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.321409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b15721-8090-4063-8019-1b3c7522f466-openshift-service-ca\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.321536 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:12:14.321462    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 10 18:12:14.321747 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:12:14.321540    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b15721-8090-4063-8019-1b3c7522f466-maas-api-tls podName:88b15721-8090-4063-8019-1b3c7522f466 nodeName:}" failed. No retries permitted until 2026-07-10 18:12:14.821519981 +0000 UTC m=+539.980237783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88b15721-8090-4063-8019-1b3c7522f466-maas-api-tls") pod "maas-api-6c76b6b79f-4cf5h" (UID: "88b15721-8090-4063-8019-1b3c7522f466") : secret "maas-api-serving-cert" not found
Jul 10 18:12:14.322250 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.322223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b15721-8090-4063-8019-1b3c7522f466-openshift-service-ca\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.332864 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.332833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghzk\" (UniqueName: \"kubernetes.io/projected/88b15721-8090-4063-8019-1b3c7522f466-kube-api-access-gghzk\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.419291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.419198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:14.642995 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.642940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:14.741819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.741719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:14.826069 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.826036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b15721-8090-4063-8019-1b3c7522f466-maas-api-tls\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.828700 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.828670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b15721-8090-4063-8019-1b3c7522f466-maas-api-tls\") pod \"maas-api-6c76b6b79f-4cf5h\" (UID: \"88b15721-8090-4063-8019-1b3c7522f466\") " pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:14.980982 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.980936    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-knqwm"]
Jul 10 18:12:14.984948 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.984926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:14.998494 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.998461    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 18:12:14.998906 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:14.998889    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-knrcw\""
Jul 10 18:12:15.005351 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.005316    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-knqwm"]
Jul 10 18:12:15.028715 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.028677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w58sh\" (UniqueName: \"kubernetes.io/projected/503a3de8-6621-482f-bb2e-a99ca8a69cbf-kube-api-access-w58sh\") pod \"payload-processing-58f86c7798-knqwm\" (UID: \"503a3de8-6621-482f-bb2e-a99ca8a69cbf\") " pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:15.028900 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.028770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/503a3de8-6621-482f-bb2e-a99ca8a69cbf-plugins-config-volume\") pod \"payload-processing-58f86c7798-knqwm\" (UID: \"503a3de8-6621-482f-bb2e-a99ca8a69cbf\") " pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:15.128349 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.128312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:15.129622 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.129599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w58sh\" (UniqueName: \"kubernetes.io/projected/503a3de8-6621-482f-bb2e-a99ca8a69cbf-kube-api-access-w58sh\") pod \"payload-processing-58f86c7798-knqwm\" (UID: \"503a3de8-6621-482f-bb2e-a99ca8a69cbf\") " pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:15.129705 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.129695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/503a3de8-6621-482f-bb2e-a99ca8a69cbf-plugins-config-volume\") pod \"payload-processing-58f86c7798-knqwm\" (UID: \"503a3de8-6621-482f-bb2e-a99ca8a69cbf\") " pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:15.130352 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.130334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/503a3de8-6621-482f-bb2e-a99ca8a69cbf-plugins-config-volume\") pod \"payload-processing-58f86c7798-knqwm\" (UID: \"503a3de8-6621-482f-bb2e-a99ca8a69cbf\") " pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:15.147919 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.147887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w58sh\" (UniqueName: \"kubernetes.io/projected/503a3de8-6621-482f-bb2e-a99ca8a69cbf-kube-api-access-w58sh\") pod \"payload-processing-58f86c7798-knqwm\" (UID: \"503a3de8-6621-482f-bb2e-a99ca8a69cbf\") " pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:15.289903 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.289856    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"]
Jul 10 18:12:15.293418 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:12:15.293375    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b15721_8090_4063_8019_1b3c7522f466.slice/crio-12b4111f37b389069a572228b7f8aa33e0705acbf2792c42158e56308a9a28a4 WatchSource:0}: Error finding container 12b4111f37b389069a572228b7f8aa33e0705acbf2792c42158e56308a9a28a4: Status 404 returned error can't find the container with id 12b4111f37b389069a572228b7f8aa33e0705acbf2792c42158e56308a9a28a4
Jul 10 18:12:15.298648 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.298612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-knrcw\""
Jul 10 18:12:15.307053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.307020    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:15.500776 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:15.500523    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-knqwm"]
Jul 10 18:12:15.503854 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:12:15.503824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503a3de8_6621_482f_bb2e_a99ca8a69cbf.slice/crio-9164dd6edfc89f53e2ab19f0576ec922dae78d7f695ced5bffb10cc176e80a00 WatchSource:0}: Error finding container 9164dd6edfc89f53e2ab19f0576ec922dae78d7f695ced5bffb10cc176e80a00: Status 404 returned error can't find the container with id 9164dd6edfc89f53e2ab19f0576ec922dae78d7f695ced5bffb10cc176e80a00
Jul 10 18:12:16.182870 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:16.182829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h" event={"ID":"88b15721-8090-4063-8019-1b3c7522f466","Type":"ContainerStarted","Data":"12b4111f37b389069a572228b7f8aa33e0705acbf2792c42158e56308a9a28a4"}
Jul 10 18:12:16.184626 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:16.184554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-knqwm" event={"ID":"503a3de8-6621-482f-bb2e-a99ca8a69cbf","Type":"ContainerStarted","Data":"9164dd6edfc89f53e2ab19f0576ec922dae78d7f695ced5bffb10cc176e80a00"}
Jul 10 18:12:17.192732 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:17.192619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-knqwm" event={"ID":"503a3de8-6621-482f-bb2e-a99ca8a69cbf","Type":"ContainerStarted","Data":"bd2f63ec4f186112c4c12f987a73cea9a1689a8086a476cdcaba1bb5bd494aea"}
Jul 10 18:12:17.193176 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:17.192768    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:17.212891 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:17.212837    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-knqwm" podStartSLOduration=1.834429359 podStartE2EDuration="3.21281636s" totalImagesPullingTime="1.378387001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:12:17.21207481 +0000 UTC m=+542.370792638" watchObservedRunningTime="2026-07-10 18:12:17.21281636 +0000 UTC m=+542.371534163"
Jul 10 18:12:18.199560 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:18.199522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h" event={"ID":"88b15721-8090-4063-8019-1b3c7522f466","Type":"ContainerStarted","Data":"85a98c147ff34056a2624d87acfac646d0b8fe6f666b1842310ae46e9c3092ae"}
Jul 10 18:12:18.219543 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:18.219486    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h" podStartSLOduration=1.871602532 podStartE2EDuration="4.21947088s" totalImagesPullingTime="2.347868348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:12:18.218328489 +0000 UTC m=+543.377046328" watchObservedRunningTime="2026-07-10 18:12:18.21947088 +0000 UTC m=+543.378188705"
Jul 10 18:12:19.204946 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:19.204913    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:21.749866 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:21.749817    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xg4wc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 18:12:21.750322 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:21.749878    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" podUID="c015c4b8-69cd-499b-90fb-4d1e8a8d9594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 18:12:23.227379 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:23.227348    2565 generic.go:356] "Generic (PLEG): container finished" podID="c015c4b8-69cd-499b-90fb-4d1e8a8d9594" containerID="a2e3644d9fed7947ccbccc21151732a791466d48cd69759d3c263d6c6547c191" exitCode=0
Jul 10 18:12:23.227843 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:23.227423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" event={"ID":"c015c4b8-69cd-499b-90fb-4d1e8a8d9594","Type":"ContainerDied","Data":"a2e3644d9fed7947ccbccc21151732a791466d48cd69759d3c263d6c6547c191"}
Jul 10 18:12:23.227888 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:23.227863    2565 scope.go:117] "RemoveContainer" containerID="a2e3644d9fed7947ccbccc21151732a791466d48cd69759d3c263d6c6547c191"
Jul 10 18:12:23.228873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:23.228845    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:12:23.228934 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:23.228925    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:12:23.228979 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:23.228967    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:12:24.238604 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:24.238555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" event={"ID":"c015c4b8-69cd-499b-90fb-4d1e8a8d9594","Type":"ContainerStarted","Data":"c75c6539d33ac991c50ec9af56c5e35891dcb4dc8a28bd7ab09a4816293b0f5e"}
Jul 10 18:12:24.383098 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:24.383054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:12:24.383338 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:24.383311    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xg4wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 10 18:12:24.383430 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:24.383377    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" podUID="c015c4b8-69cd-499b-90fb-4d1e8a8d9594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 10 18:12:25.216443 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:25.216415    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c76b6b79f-4cf5h"
Jul 10 18:12:25.382876 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:25.382834    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xg4wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 10 18:12:25.383272 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:25.382897    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" podUID="c015c4b8-69cd-499b-90fb-4d1e8a8d9594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 10 18:12:26.231542 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:26.231493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:26.329682 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:26.329617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:26.382926 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:26.382894    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xg4wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 10 18:12:26.383323 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:26.382968    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" podUID="c015c4b8-69cd-499b-90fb-4d1e8a8d9594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 10 18:12:27.382882 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:27.382839    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xg4wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 10 18:12:27.383064 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:27.382910    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc" podUID="c015c4b8-69cd-499b-90fb-4d1e8a8d9594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 10 18:12:28.201876 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:28.201826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-knqwm"
Jul 10 18:12:28.387238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:28.387206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:12:28.387647 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:28.387512    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:12:28.388279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:28.388263    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xg4wc"
Jul 10 18:12:42.193197 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:42.193161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:48.907305 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:48.907237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:59.093629 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.093582    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"]
Jul 10 18:12:59.097106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.097084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.099909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.099878    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 18:12:59.101118 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.101090    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t2lwp\""
Jul 10 18:12:59.101302 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.101287    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 18:12:59.101370 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.101304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 10 18:12:59.107825 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.107795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"]
Jul 10 18:12:59.121172 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.121126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:59.176600 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.176558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.176848 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.176622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.176848 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.176692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl5sp\" (UniqueName: \"kubernetes.io/projected/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-kube-api-access-wl5sp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.176848 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.176751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.176848 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.176782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.177099 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.176911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl5sp\" (UniqueName: \"kubernetes.io/projected/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-kube-api-access-wl5sp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278487 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278696 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278696 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.278870 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.278840    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.280473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.280454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.280880 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.280861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.286894 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.286864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl5sp\" (UniqueName: \"kubernetes.io/projected/fadcfd91-617e-40ab-a76a-d66cdf2f8db1-kube-api-access-wl5sp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ghxwv\" (UID: \"fadcfd91-617e-40ab-a76a-d66cdf2f8db1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.409260 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.409209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:12:59.575908 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:12:59.575871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"]
Jul 10 18:12:59.579328 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:12:59.579298    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfadcfd91_617e_40ab_a76a_d66cdf2f8db1.slice/crio-740fbb5947255222ca529ecb8fd126bff120e12f98b6f40abf488a79b1a17fcf WatchSource:0}: Error finding container 740fbb5947255222ca529ecb8fd126bff120e12f98b6f40abf488a79b1a17fcf: Status 404 returned error can't find the container with id 740fbb5947255222ca529ecb8fd126bff120e12f98b6f40abf488a79b1a17fcf
Jul 10 18:13:00.432322 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:00.432272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv" event={"ID":"fadcfd91-617e-40ab-a76a-d66cdf2f8db1","Type":"ContainerStarted","Data":"740fbb5947255222ca529ecb8fd126bff120e12f98b6f40abf488a79b1a17fcf"}
Jul 10 18:13:01.440588 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:01.440542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv" event={"ID":"fadcfd91-617e-40ab-a76a-d66cdf2f8db1","Type":"ContainerStarted","Data":"f80c08c970658dcde637538c47da09a2519bace3dc492fa08207b0e05eaf1184"}
Jul 10 18:13:01.462141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:01.462082    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv" podStartSLOduration=1.4258662389999999 podStartE2EDuration="2.462060544s" totalImagesPullingTime="1.036194305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:13:01.460142691 +0000 UTC m=+586.618860516" watchObservedRunningTime="2026-07-10 18:13:01.462060544 +0000 UTC m=+586.620778368"
Jul 10 18:13:04.104155 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.104119    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"]
Jul 10 18:13:04.107559 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.107538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.110418 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.110394    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 18:13:04.121019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.120986    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"]
Jul 10 18:13:04.131747 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.131707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz2kb\" (UniqueName: \"kubernetes.io/projected/6e105ef5-9493-4786-8505-81ab8ea8715a-kube-api-access-gz2kb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.131911 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.131787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.131911 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.131826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.131911 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.131873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e105ef5-9493-4786-8505-81ab8ea8715a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.131911 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.131899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.132060 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.132038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.209351 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.209312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:13:04.233551 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.233510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.233802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.233596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz2kb\" (UniqueName: \"kubernetes.io/projected/6e105ef5-9493-4786-8505-81ab8ea8715a-kube-api-access-gz2kb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.233802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.233677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.233802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.233717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.233802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.233747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e105ef5-9493-4786-8505-81ab8ea8715a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.233802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.233776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.234088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.234053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.234147 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.234085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.234201 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.234138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.236237 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.236209    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e105ef5-9493-4786-8505-81ab8ea8715a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.236450 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.236429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e105ef5-9493-4786-8505-81ab8ea8715a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.243775 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.243747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz2kb\" (UniqueName: \"kubernetes.io/projected/6e105ef5-9493-4786-8505-81ab8ea8715a-kube-api-access-gz2kb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7txkq\" (UID: \"6e105ef5-9493-4786-8505-81ab8ea8715a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.418525 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.418489    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:04.570305 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:04.570271    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"]
Jul 10 18:13:04.572120 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:13:04.572089    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e105ef5_9493_4786_8505_81ab8ea8715a.slice/crio-59c964cd90bfea045bdc69648d71d57eb1fc936b49fa86a51b56c1f44ed82b6b WatchSource:0}: Error finding container 59c964cd90bfea045bdc69648d71d57eb1fc936b49fa86a51b56c1f44ed82b6b: Status 404 returned error can't find the container with id 59c964cd90bfea045bdc69648d71d57eb1fc936b49fa86a51b56c1f44ed82b6b
Jul 10 18:13:05.462287 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:05.462246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq" event={"ID":"6e105ef5-9493-4786-8505-81ab8ea8715a","Type":"ContainerStarted","Data":"e4893261463d2f6f5b51afc422c8263589d60ed431fb5c2f03847462f3ddedcb"}
Jul 10 18:13:05.462701 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:05.462354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq" event={"ID":"6e105ef5-9493-4786-8505-81ab8ea8715a","Type":"ContainerStarted","Data":"59c964cd90bfea045bdc69648d71d57eb1fc936b49fa86a51b56c1f44ed82b6b"}
Jul 10 18:13:05.484746 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:05.484683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq" podStartSLOduration=1.266023838 podStartE2EDuration="1.484665289s" totalImagesPullingTime="218.641451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:13:05.482217392 +0000 UTC m=+590.640935217" watchObservedRunningTime="2026-07-10 18:13:05.484665289 +0000 UTC m=+590.643383198"
Jul 10 18:13:09.410053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:09.410003    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:13:09.410568 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:09.410084    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:13:09.422812 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:09.422783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:13:09.494785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:09.494756    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ghxwv"
Jul 10 18:13:14.419377 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:14.419317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:14.419980 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:14.419409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:14.432630 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:14.432596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:14.521264 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:14.521236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7txkq"
Jul 10 18:13:15.325973 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:15.325942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:13:15.326828 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:15.326803    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:13:16.104819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:16.104746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:13:23.698660 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:23.698596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:13:23.765246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:23.765190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:13:25.627111 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:25.627074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:13:31.936427 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:31.936376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:13:57.450993 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:13:57.450906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:30.687019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:14:30.686966    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:30.842162 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:14:30.842123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:31.846217 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:14:31.846177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:31.942250 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:14:31.942212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:15:42.769157 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:42.769098    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:15:42.868509 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:42.868468    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-zccl7"]
Jul 10 18:15:42.868770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:42.868724    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7" podUID="44ea4561-a9f2-432a-bbb0-6673a3ef5411" containerName="manager" containerID="cri-o://5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35" gracePeriod=30
Jul 10 18:15:43.125136 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.125105    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:15:43.238705 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.238669    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44ea4561-a9f2-432a-bbb0-6673a3ef5411-webhook-cert\") pod \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") "
Jul 10 18:15:43.238902 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.238739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q76c8\" (UniqueName: \"kubernetes.io/projected/44ea4561-a9f2-432a-bbb0-6673a3ef5411-kube-api-access-q76c8\") pod \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\" (UID: \"44ea4561-a9f2-432a-bbb0-6673a3ef5411\") "
Jul 10 18:15:43.247484 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.247438    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44ea4561-a9f2-432a-bbb0-6673a3ef5411-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "44ea4561-a9f2-432a-bbb0-6673a3ef5411" (UID: "44ea4561-a9f2-432a-bbb0-6673a3ef5411"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:15:43.247720 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.247488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44ea4561-a9f2-432a-bbb0-6673a3ef5411-kube-api-access-q76c8" (OuterVolumeSpecName: "kube-api-access-q76c8") pod "44ea4561-a9f2-432a-bbb0-6673a3ef5411" (UID: "44ea4561-a9f2-432a-bbb0-6673a3ef5411"). InnerVolumeSpecName "kube-api-access-q76c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:15:43.280023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.279982    2565 generic.go:356] "Generic (PLEG): container finished" podID="44ea4561-a9f2-432a-bbb0-6673a3ef5411" containerID="5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35" exitCode=0
Jul 10 18:15:43.280227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.280056    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7"
Jul 10 18:15:43.280227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.280072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7" event={"ID":"44ea4561-a9f2-432a-bbb0-6673a3ef5411","Type":"ContainerDied","Data":"5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35"}
Jul 10 18:15:43.280227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.280162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcb6c7c86-zccl7" event={"ID":"44ea4561-a9f2-432a-bbb0-6673a3ef5411","Type":"ContainerDied","Data":"23cd231546f5ad5839c97976893eed081e2bbed300059980bd8e824ef6d7627e"}
Jul 10 18:15:43.280227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.280192    2565 scope.go:117] "RemoveContainer" containerID="5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35"
Jul 10 18:15:43.289947 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.289922    2565 scope.go:117] "RemoveContainer" containerID="5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35"
Jul 10 18:15:43.290285 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:15:43.290264    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35\": container with ID starting with 5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35 not found: ID does not exist" containerID="5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35"
Jul 10 18:15:43.290340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.290295    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35"} err="failed to get container status \"5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35\": rpc error: code = NotFound desc = could not find container \"5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35\": container with ID starting with 5ce94a0b64b61f025f1f84e670b0b55b4075209623e3f647ff23171af43faa35 not found: ID does not exist"
Jul 10 18:15:43.329253 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.329162    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-zccl7"]
Jul 10 18:15:43.333615 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.333585    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-zccl7"]
Jul 10 18:15:43.339609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.339579    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44ea4561-a9f2-432a-bbb0-6673a3ef5411-webhook-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:15:43.339609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.339609    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q76c8\" (UniqueName: \"kubernetes.io/projected/44ea4561-a9f2-432a-bbb0-6673a3ef5411-kube-api-access-q76c8\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:15:43.531003 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.530968    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44ea4561-a9f2-432a-bbb0-6673a3ef5411" path="/var/lib/kubelet/pods/44ea4561-a9f2-432a-bbb0-6673a3ef5411/volumes"
Jul 10 18:15:43.987589 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:43.987554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:15:44.100016 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.099984    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-b58xw"]
Jul 10 18:15:44.100417 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.100403    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44ea4561-a9f2-432a-bbb0-6673a3ef5411" containerName="manager"
Jul 10 18:15:44.100467 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.100418    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44ea4561-a9f2-432a-bbb0-6673a3ef5411" containerName="manager"
Jul 10 18:15:44.100507 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.100489    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44ea4561-a9f2-432a-bbb0-6673a3ef5411" containerName="manager"
Jul 10 18:15:44.103305 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.103287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.107805 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.107780    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:15:44.107805 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.107781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vzgps\""
Jul 10 18:15:44.108085 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.107837    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:15:44.117525 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.117493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-b58xw"]
Jul 10 18:15:44.248423 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.248317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrv9g\" (UniqueName: \"kubernetes.io/projected/a9d7cd76-a3c5-4917-922a-99f8f437fbd1-kube-api-access-mrv9g\") pod \"maas-controller-7dcb6c7c86-b58xw\" (UID: \"a9d7cd76-a3c5-4917-922a-99f8f437fbd1\") " pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.248584 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.248475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9d7cd76-a3c5-4917-922a-99f8f437fbd1-webhook-cert\") pod \"maas-controller-7dcb6c7c86-b58xw\" (UID: \"a9d7cd76-a3c5-4917-922a-99f8f437fbd1\") " pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.349801 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.349754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9d7cd76-a3c5-4917-922a-99f8f437fbd1-webhook-cert\") pod \"maas-controller-7dcb6c7c86-b58xw\" (UID: \"a9d7cd76-a3c5-4917-922a-99f8f437fbd1\") " pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.350036 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.349874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrv9g\" (UniqueName: \"kubernetes.io/projected/a9d7cd76-a3c5-4917-922a-99f8f437fbd1-kube-api-access-mrv9g\") pod \"maas-controller-7dcb6c7c86-b58xw\" (UID: \"a9d7cd76-a3c5-4917-922a-99f8f437fbd1\") " pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.352809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.352775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9d7cd76-a3c5-4917-922a-99f8f437fbd1-webhook-cert\") pod \"maas-controller-7dcb6c7c86-b58xw\" (UID: \"a9d7cd76-a3c5-4917-922a-99f8f437fbd1\") " pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.359958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.359926    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrv9g\" (UniqueName: \"kubernetes.io/projected/a9d7cd76-a3c5-4917-922a-99f8f437fbd1-kube-api-access-mrv9g\") pod \"maas-controller-7dcb6c7c86-b58xw\" (UID: \"a9d7cd76-a3c5-4917-922a-99f8f437fbd1\") " pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.413981 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.413938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:44.564279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.564235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcb6c7c86-b58xw"]
Jul 10 18:15:44.567345 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:15:44.567314    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d7cd76_a3c5_4917_922a_99f8f437fbd1.slice/crio-b54d0a1949c94cf2e9c2ab491a377a9e2b78b62bf13dd6355b383572476b5dc6 WatchSource:0}: Error finding container b54d0a1949c94cf2e9c2ab491a377a9e2b78b62bf13dd6355b383572476b5dc6: Status 404 returned error can't find the container with id b54d0a1949c94cf2e9c2ab491a377a9e2b78b62bf13dd6355b383572476b5dc6
Jul 10 18:15:44.568881 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:44.568860    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:15:45.293211 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:45.293168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcb6c7c86-b58xw" event={"ID":"a9d7cd76-a3c5-4917-922a-99f8f437fbd1","Type":"ContainerStarted","Data":"71cbc9d9bf1d9235e21d2f0ccb1fb0102134c58b6876a6d24770453186faf60f"}
Jul 10 18:15:45.293211 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:45.293217    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcb6c7c86-b58xw" event={"ID":"a9d7cd76-a3c5-4917-922a-99f8f437fbd1","Type":"ContainerStarted","Data":"b54d0a1949c94cf2e9c2ab491a377a9e2b78b62bf13dd6355b383572476b5dc6"}
Jul 10 18:15:45.293799 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:45.293297    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:15:45.314228 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:45.314170    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dcb6c7c86-b58xw" podStartSLOduration=0.791065056 podStartE2EDuration="1.314149502s" totalImagesPullingTime="523.084446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:15:45.31210544 +0000 UTC m=+750.470823265" watchObservedRunningTime="2026-07-10 18:15:45.314149502 +0000 UTC m=+750.472867326"
Jul 10 18:15:56.305869 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:15:56.305835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dcb6c7c86-b58xw"
Jul 10 18:16:17.881288 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:17.881248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:26.729394 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:26.729343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:26.828493 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:26.828446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:27.029299 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:27.029196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:29.806997 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:29.806961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:32.931794 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:32.931754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:33.062182 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:33.062147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:33.168746 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:33.168713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:33.305469 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:33.305378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:39.515473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:39.515380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:39.616904 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:16:39.616864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:17:00.612089 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:17:00.612055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:17:55.032295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:17:55.032250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:18:15.367188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:18:15.366263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:18:15.369305 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:18:15.369277    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:20:36.586983 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:36.586944    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"]
Jul 10 18:20:36.587567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:36.587208    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh" podUID="1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" containerName="manager" containerID="cri-o://7e559822deae5dcfa24b27a46ccbede23e501fca4615907dae20f19d6da0c2e9" gracePeriod=10
Jul 10 18:20:38.591738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:38.591703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:20:38.875852 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:38.875756    2565 generic.go:356] "Generic (PLEG): container finished" podID="1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" containerID="7e559822deae5dcfa24b27a46ccbede23e501fca4615907dae20f19d6da0c2e9" exitCode=0
Jul 10 18:20:38.875852 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:38.875815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh" event={"ID":"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116","Type":"ContainerDied","Data":"7e559822deae5dcfa24b27a46ccbede23e501fca4615907dae20f19d6da0c2e9"}
Jul 10 18:20:39.442630 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.442601    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:20:39.498043 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.497996    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-extensions-socket-volume\") pod \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") "
Jul 10 18:20:39.498222 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.498142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9sgs\" (UniqueName: \"kubernetes.io/projected/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-kube-api-access-j9sgs\") pod \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\" (UID: \"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116\") "
Jul 10 18:20:39.498405 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.498378    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" (UID: "1c3c2c78-e47f-4eb5-b981-15e8dfd2f116"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:20:39.500356 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.500327    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-kube-api-access-j9sgs" (OuterVolumeSpecName: "kube-api-access-j9sgs") pod "1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" (UID: "1c3c2c78-e47f-4eb5-b981-15e8dfd2f116"). InnerVolumeSpecName "kube-api-access-j9sgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:20:39.599301 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.599202    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-extensions-socket-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:20:39.599301 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.599239    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9sgs\" (UniqueName: \"kubernetes.io/projected/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116-kube-api-access-j9sgs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:20:39.883605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.883565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh" event={"ID":"1c3c2c78-e47f-4eb5-b981-15e8dfd2f116","Type":"ContainerDied","Data":"987a88323b0cd63a41ac3f3f88c4bd2773650fd65a52965813e1b1fd8980c275"}
Jul 10 18:20:39.883605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.883600    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"
Jul 10 18:20:39.883883 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.883680    2565 scope.go:117] "RemoveContainer" containerID="7e559822deae5dcfa24b27a46ccbede23e501fca4615907dae20f19d6da0c2e9"
Jul 10 18:20:39.903267 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.902819    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"]
Jul 10 18:20:39.905401 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:39.905361    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb9gh"]
Jul 10 18:20:41.529464 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:20:41.529419    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" path="/var/lib/kubelet/pods/1c3c2c78-e47f-4eb5-b981-15e8dfd2f116/volumes"
Jul 10 18:21:37.764675 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.764615    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"]
Jul 10 18:21:37.765149 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.765090    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" containerName="manager"
Jul 10 18:21:37.765149 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.765103    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" containerName="manager"
Jul 10 18:21:37.765225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.765181    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3c2c78-e47f-4eb5-b981-15e8dfd2f116" containerName="manager"
Jul 10 18:21:37.768286 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.768254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:37.772171 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.772136    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9dwmg\""
Jul 10 18:21:37.780894 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.780868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"]
Jul 10 18:21:37.890402 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.890351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spp9g\" (UniqueName: \"kubernetes.io/projected/07f50502-ea7e-47cc-8c53-dd118b223041-kube-api-access-spp9g\") pod \"kuadrant-operator-controller-manager-86878c769f-dxbqq\" (UID: \"07f50502-ea7e-47cc-8c53-dd118b223041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:37.890607 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.890418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07f50502-ea7e-47cc-8c53-dd118b223041-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dxbqq\" (UID: \"07f50502-ea7e-47cc-8c53-dd118b223041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:37.992043 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.992000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp9g\" (UniqueName: \"kubernetes.io/projected/07f50502-ea7e-47cc-8c53-dd118b223041-kube-api-access-spp9g\") pod \"kuadrant-operator-controller-manager-86878c769f-dxbqq\" (UID: \"07f50502-ea7e-47cc-8c53-dd118b223041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:37.992231 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.992053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07f50502-ea7e-47cc-8c53-dd118b223041-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dxbqq\" (UID: \"07f50502-ea7e-47cc-8c53-dd118b223041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:37.992450 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:37.992428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07f50502-ea7e-47cc-8c53-dd118b223041-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dxbqq\" (UID: \"07f50502-ea7e-47cc-8c53-dd118b223041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:38.012788 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:38.012753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spp9g\" (UniqueName: \"kubernetes.io/projected/07f50502-ea7e-47cc-8c53-dd118b223041-kube-api-access-spp9g\") pod \"kuadrant-operator-controller-manager-86878c769f-dxbqq\" (UID: \"07f50502-ea7e-47cc-8c53-dd118b223041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:38.080212 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:38.080119    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:38.231224 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:38.231195    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"]
Jul 10 18:21:38.233731 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:21:38.233699    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f50502_ea7e_47cc_8c53_dd118b223041.slice/crio-ab253705dd360af9a6f57d41b225641ed21da092f27313763d490e029ed14ee9 WatchSource:0}: Error finding container ab253705dd360af9a6f57d41b225641ed21da092f27313763d490e029ed14ee9: Status 404 returned error can't find the container with id ab253705dd360af9a6f57d41b225641ed21da092f27313763d490e029ed14ee9
Jul 10 18:21:39.212451 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:39.212415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq" event={"ID":"07f50502-ea7e-47cc-8c53-dd118b223041","Type":"ContainerStarted","Data":"00c96c69f59a96743dbcc6809122ef0f3d0ed23325e1379409fb87f3b78353c8"}
Jul 10 18:21:39.212976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:39.212475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq" event={"ID":"07f50502-ea7e-47cc-8c53-dd118b223041","Type":"ContainerStarted","Data":"ab253705dd360af9a6f57d41b225641ed21da092f27313763d490e029ed14ee9"}
Jul 10 18:21:39.212976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:39.212502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:21:39.235268 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:39.235210    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq" podStartSLOduration=2.235188958 podStartE2EDuration="2.235188958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:21:39.233209214 +0000 UTC m=+1104.391927041" watchObservedRunningTime="2026-07-10 18:21:39.235188958 +0000 UTC m=+1104.393906785"
Jul 10 18:21:50.220239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:21:50.220207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dxbqq"
Jul 10 18:23:15.401092 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:23:15.401056    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:23:15.406107 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:23:15.406081    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:24:15.284743 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:24:15.284656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:25:14.045750 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:25:14.045700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:22.209065 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:26:22.209026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:29.841117 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:27:29.841012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:39.354406 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:27:39.354369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:49.017219 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:27:49.017185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:52.679425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:27:52.679360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:55.470753 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:27:55.470711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:55.530517 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:27:55.530488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:55.887315 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:27:55.887278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:01.480216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.480173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:01.584518 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.584480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:01.663771 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.663734    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"]
Jul 10 18:28:01.667845 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.667561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.670381 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.670349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9f1a3239-openshift-default-dockercfg-5nkjk\""
Jul 10 18:28:01.691063 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.691027    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"]
Jul 10 18:28:01.694447 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.694402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:01.757829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.757712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-podinfo\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.757829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.757772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvc6r\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-kube-api-access-dvc6r\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.758075 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.757846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-socket\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.758075 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.757973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-credential-socket\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.758075 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.758010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-certs\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.758075 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.758044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfc4263-648f-4ffc-9d19-81f3b5d49875-istiod-ca-cert\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.758321 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.758081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-data\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.758321 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.758123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-envoy\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.758321 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.758229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-token\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.759088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.759058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:01.859089 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-token\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-podinfo\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvc6r\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-kube-api-access-dvc6r\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-socket\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-credential-socket\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-certs\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfc4263-648f-4ffc-9d19-81f3b5d49875-istiod-ca-cert\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859289 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-data\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859673 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-envoy\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859756 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-socket\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-credential-socket\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.859956 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-certs\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.860026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.859942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-data\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.860138 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.860118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfc4263-648f-4ffc-9d19-81f3b5d49875-istiod-ca-cert\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.861924 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.861894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-envoy\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.862070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.862052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-podinfo\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.868126 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.868087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-token\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.868248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.868170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvc6r\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-kube-api-access-dvc6r\") pod \"e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") " pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:01.979006 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:01.978963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:02.131676 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.131627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"]
Jul 10 18:28:02.132968 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:28:02.132939    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfc4263_648f_4ffc_9d19_81f3b5d49875.slice/crio-bdc752a7dd93a02ffc563637b3a3ad97821578afbae8bbb1e17f492ceb5faa6f WatchSource:0}: Error finding container bdc752a7dd93a02ffc563637b3a3ad97821578afbae8bbb1e17f492ceb5faa6f: Status 404 returned error can't find the container with id bdc752a7dd93a02ffc563637b3a3ad97821578afbae8bbb1e17f492ceb5faa6f
Jul 10 18:28:02.135123 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.135088    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:02.135230 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.135156    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:02.135230 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.135187    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:02.209983 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.209942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f" event={"ID":"acfc4263-648f-4ffc-9d19-81f3b5d49875","Type":"ContainerStarted","Data":"640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349"}
Jul 10 18:28:02.210167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.210017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f" event={"ID":"acfc4263-648f-4ffc-9d19-81f3b5d49875","Type":"ContainerStarted","Data":"bdc752a7dd93a02ffc563637b3a3ad97821578afbae8bbb1e17f492ceb5faa6f"}
Jul 10 18:28:02.230154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.230087    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f" podStartSLOduration=1.230065408 podStartE2EDuration="1.230065408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:02.229131831 +0000 UTC m=+1487.387849695" watchObservedRunningTime="2026-07-10 18:28:02.230065408 +0000 UTC m=+1487.388783234"
Jul 10 18:28:02.860180 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.860135    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:02.933350 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.933307    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"]
Jul 10 18:28:02.937222 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.937192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:02.938038 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.938012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:02.940982 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.940962    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9f1a3239-serving-cert\""
Jul 10 18:28:02.947591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.947565    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"]
Jul 10 18:28:02.968796 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.968755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvq99\" (UniqueName: \"kubernetes.io/projected/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-kube-api-access-vvq99\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:02.969005 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.968879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-openshift-service-ca\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:02.969005 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.968915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:02.979492 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:02.979455    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:03.003564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.003514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:03.069516 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.069466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-openshift-service-ca\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.069516 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.069521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.069859 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.069599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvq99\" (UniqueName: \"kubernetes.io/projected/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-kube-api-access-vvq99\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.069859 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:03.069722    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-serving-cert: secret "maas-api-e2e-ait-9f1a3239-serving-cert" not found
Jul 10 18:28:03.069859 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:03.069803    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls podName:93b91eb1-189f-47ad-a1ce-9e740f5d5c9d nodeName:}" failed. No retries permitted until 2026-07-10 18:28:03.569776028 +0000 UTC m=+1488.728493832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls") pod "maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq" (UID: "93b91eb1-189f-47ad-a1ce-9e740f5d5c9d") : secret "maas-api-e2e-ait-9f1a3239-serving-cert" not found
Jul 10 18:28:03.070294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.070273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-openshift-service-ca\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.079535 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.079508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvq99\" (UniqueName: \"kubernetes.io/projected/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-kube-api-access-vvq99\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.216686 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.216653    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:03.556223 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.556136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:03.573552 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.573513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.576266 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.576234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls\") pod \"maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.659731 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.659696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:03.852093 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.851986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:03.985669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:03.985622    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:04.002769 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:04.002742    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"]
Jul 10 18:28:04.005283 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:28:04.005243    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b91eb1_189f_47ad_a1ce_9e740f5d5c9d.slice/crio-537695a50b4c508b15723850f6476b1057beb4123c007c194f3b9a71eed43a17 WatchSource:0}: Error finding container 537695a50b4c508b15723850f6476b1057beb4123c007c194f3b9a71eed43a17: Status 404 returned error can't find the container with id 537695a50b4c508b15723850f6476b1057beb4123c007c194f3b9a71eed43a17
Jul 10 18:28:04.007082 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:04.007064    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:28:04.221578 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:04.221538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq" event={"ID":"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d","Type":"ContainerStarted","Data":"537695a50b4c508b15723850f6476b1057beb4123c007c194f3b9a71eed43a17"}
Jul 10 18:28:04.221862 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:04.221845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:04.223255 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:04.223225    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:05.228651 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:05.228527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq" event={"ID":"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d","Type":"ContainerStarted","Data":"808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35"}
Jul 10 18:28:05.246485 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:05.246422    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq" podStartSLOduration=2.344317739 podStartE2EDuration="3.246401787s" totalImagesPullingTime="902.084048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:05.245843919 +0000 UTC m=+1490.404561745" watchObservedRunningTime="2026-07-10 18:28:05.246401787 +0000 UTC m=+1490.405119609"
Jul 10 18:28:05.371226 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:05.371180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:06.234654 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:06.234609    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:07.856223 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:07.856184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:08.016433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.016400    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"]
Jul 10 18:28:08.016614 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.016584    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f" podUID="acfc4263-648f-4ffc-9d19-81f3b5d49875" containerName="istio-proxy" containerID="cri-o://640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349" gracePeriod=30
Jul 10 18:28:08.043813 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.043773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:08.143934 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.143896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:08.191703 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.191665    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"]
Jul 10 18:28:08.242944 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.242904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:08.246092 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.246054    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq" podUID="93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" containerName="maas-api" containerID="cri-o://808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35" gracePeriod=30
Jul 10 18:28:08.498275 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.498254    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:08.523995 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.523966    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-openshift-service-ca\") pod \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") "
Jul 10 18:28:08.524121 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.524055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls\") pod \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") "
Jul 10 18:28:08.524121 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.524089    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvq99\" (UniqueName: \"kubernetes.io/projected/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-kube-api-access-vvq99\") pod \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\" (UID: \"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d\") "
Jul 10 18:28:08.524309 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.524284    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" (UID: "93b91eb1-189f-47ad-a1ce-9e740f5d5c9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:28:08.524478 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.524455    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:08.526266 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.526245    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" (UID: "93b91eb1-189f-47ad-a1ce-9e740f5d5c9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:28:08.526353 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.526327    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-kube-api-access-vvq99" (OuterVolumeSpecName: "kube-api-access-vvq99") pod "93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" (UID: "93b91eb1-189f-47ad-a1ce-9e740f5d5c9d"). InnerVolumeSpecName "kube-api-access-vvq99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:08.625226 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.625190    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:08.625226 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:08.625224    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvq99\" (UniqueName: \"kubernetes.io/projected/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d-kube-api-access-vvq99\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:09.252107 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.252071    2565 generic.go:356] "Generic (PLEG): container finished" podID="93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" containerID="808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35" exitCode=0
Jul 10 18:28:09.252665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.252122    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"
Jul 10 18:28:09.252665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.252131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq" event={"ID":"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d","Type":"ContainerDied","Data":"808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35"}
Jul 10 18:28:09.252665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.252171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq" event={"ID":"93b91eb1-189f-47ad-a1ce-9e740f5d5c9d","Type":"ContainerDied","Data":"537695a50b4c508b15723850f6476b1057beb4123c007c194f3b9a71eed43a17"}
Jul 10 18:28:09.252665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.252192    2565 scope.go:117] "RemoveContainer" containerID="808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35"
Jul 10 18:28:09.261502 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.261481    2565 scope.go:117] "RemoveContainer" containerID="808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35"
Jul 10 18:28:09.261800 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:09.261771    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35\": container with ID starting with 808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35 not found: ID does not exist" containerID="808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35"
Jul 10 18:28:09.261865 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.261808    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35"} err="failed to get container status \"808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35\": rpc error: code = NotFound desc = could not find container \"808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35\": container with ID starting with 808268ac70b319da6dc2a1122169c3ca6fad8989bc6ce4ffc21a19731c04ad35 not found: ID does not exist"
Jul 10 18:28:09.275489 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.275458    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"]
Jul 10 18:28:09.277380 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.277359    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f1a3239-6bbfcf8f74-4vrmq"]
Jul 10 18:28:09.539728 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:09.539614    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" path="/var/lib/kubelet/pods/93b91eb1-189f-47ad-a1ce-9e740f5d5c9d/volumes"
Jul 10 18:28:11.833496 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:11.833460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:13.271398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.271369    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:13.275551 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.275484    2565 generic.go:356] "Generic (PLEG): container finished" podID="acfc4263-648f-4ffc-9d19-81f3b5d49875" containerID="640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349" exitCode=0
Jul 10 18:28:13.275551 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.275529    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"
Jul 10 18:28:13.275758 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.275561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f" event={"ID":"acfc4263-648f-4ffc-9d19-81f3b5d49875","Type":"ContainerDied","Data":"640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349"}
Jul 10 18:28:13.275758 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.275611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f" event={"ID":"acfc4263-648f-4ffc-9d19-81f3b5d49875","Type":"ContainerDied","Data":"bdc752a7dd93a02ffc563637b3a3ad97821578afbae8bbb1e17f492ceb5faa6f"}
Jul 10 18:28:13.275758 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.275647    2565 scope.go:117] "RemoveContainer" containerID="640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349"
Jul 10 18:28:13.285025 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.285002    2565 scope.go:117] "RemoveContainer" containerID="640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349"
Jul 10 18:28:13.285320 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:13.285301    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349\": container with ID starting with 640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349 not found: ID does not exist" containerID="640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349"
Jul 10 18:28:13.285387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.285338    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349"} err="failed to get container status \"640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349\": rpc error: code = NotFound desc = could not find container \"640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349\": container with ID starting with 640457779f6f6b94b90f0ad3700ffeaf896ac294bd7ef0e50c48bcf367d93349 not found: ID does not exist"
Jul 10 18:28:13.369980 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.369942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-credential-socket\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.369991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-token\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvc6r\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-kube-api-access-dvc6r\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-data\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-socket\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370109    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-envoy\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-podinfo\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370192    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-certs\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfc4263-648f-4ffc-9d19-81f3b5d49875-istiod-ca-cert\") pod \"acfc4263-648f-4ffc-9d19-81f3b5d49875\" (UID: \"acfc4263-648f-4ffc-9d19-81f3b5d49875\") "
Jul 10 18:28:13.370400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370276    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:13.370400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370368    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-data" (OuterVolumeSpecName: "istio-data") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:13.370694 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:13.370694 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:13.370809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370765    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.370809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370785    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.370809 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370791    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acfc4263-648f-4ffc-9d19-81f3b5d49875-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:28:13.370933 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370800    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.370933 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.370836    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.372341 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.372318    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-token" (OuterVolumeSpecName: "istio-token") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:13.372494 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.372479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:13.372726 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.372698    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-kube-api-access-dvc6r" (OuterVolumeSpecName: "kube-api-access-dvc6r") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "kube-api-access-dvc6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:13.372726 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.372714    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acfc4263-648f-4ffc-9d19-81f3b5d49875" (UID: "acfc4263-648f-4ffc-9d19-81f3b5d49875"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:28:13.471729 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.471695    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.471729 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.471723    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvc6r\" (UniqueName: \"kubernetes.io/projected/acfc4263-648f-4ffc-9d19-81f3b5d49875-kube-api-access-dvc6r\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.471729 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.471734    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.471729 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.471742    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfc4263-648f-4ffc-9d19-81f3b5d49875-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.471998 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.471750    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfc4263-648f-4ffc-9d19-81f3b5d49875-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:13.595351 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.595311    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"]
Jul 10 18:28:13.600924 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:13.600888    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9f1a3239-openshift-default-66866fdc99-xmw6f"]
Jul 10 18:28:14.095790 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.095750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:14.194415 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.194379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:14.262439 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.262401    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"]
Jul 10 18:28:14.263109 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.263079    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfc4263-648f-4ffc-9d19-81f3b5d49875" containerName="istio-proxy"
Jul 10 18:28:14.263295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.263277    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfc4263-648f-4ffc-9d19-81f3b5d49875" containerName="istio-proxy"
Jul 10 18:28:14.263457 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.263434    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" containerName="maas-api"
Jul 10 18:28:14.263546 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.263459    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" containerName="maas-api"
Jul 10 18:28:14.263663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.263622    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b91eb1-189f-47ad-a1ce-9e740f5d5c9d" containerName="maas-api"
Jul 10 18:28:14.263751 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.263680    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfc4263-648f-4ffc-9d19-81f3b5d49875" containerName="istio-proxy"
Jul 10 18:28:14.269056 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.269018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.272823 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.272783    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e40e89b9-openshift-default-dockercfg-rkd74\""
Jul 10 18:28:14.286178 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.286138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"]
Jul 10 18:28:14.316460 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.316427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:14.384801 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.384690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istiod-ca-cert\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.384801 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.384792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-podinfo\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.384832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-socket\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.384951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-token\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.385042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-certs\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.385095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-credential-socket\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.385135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-data\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.385164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tk9m\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-kube-api-access-5tk9m\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.385218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-envoy\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.385726 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.384697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:14.486117 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-token\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-certs\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-credential-socket\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-data\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tk9m\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-kube-api-access-5tk9m\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-envoy\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486590 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istiod-ca-cert\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486590 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-podinfo\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486590 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-socket\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-certs\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-data\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-credential-socket\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.486906 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.486884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-socket\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.487201 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.487176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istiod-ca-cert\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.488702 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.488674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-envoy\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.488898 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.488879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-podinfo\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.494890 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.494866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-token\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.495252 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.495229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tk9m\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-kube-api-access-5tk9m\") pod \"e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") " pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.589430 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.589385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:14.742348 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.742317    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"]
Jul 10 18:28:14.743666 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:28:14.743619    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d64edf3_023f_4e64_8023_ffad9e0c53a1.slice/crio-c92d4c882b626cefdeb9496b82e0649b4aa39f564862c08e0cfc28ba6adbeca6 WatchSource:0}: Error finding container c92d4c882b626cefdeb9496b82e0649b4aa39f564862c08e0cfc28ba6adbeca6: Status 404 returned error can't find the container with id c92d4c882b626cefdeb9496b82e0649b4aa39f564862c08e0cfc28ba6adbeca6
Jul 10 18:28:14.745895 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.745855    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:14.746002 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.745948    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:14.746002 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:14.745993    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:15.295617 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.295581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2" event={"ID":"5d64edf3-023f-4e64-8023-ffad9e0c53a1","Type":"ContainerStarted","Data":"e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926"}
Jul 10 18:28:15.296057 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.295658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2" event={"ID":"5d64edf3-023f-4e64-8023-ffad9e0c53a1","Type":"ContainerStarted","Data":"c92d4c882b626cefdeb9496b82e0649b4aa39f564862c08e0cfc28ba6adbeca6"}
Jul 10 18:28:15.321280 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.321223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2" podStartSLOduration=1.321206748 podStartE2EDuration="1.321206748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:15.317899978 +0000 UTC m=+1500.476617804" watchObservedRunningTime="2026-07-10 18:28:15.321206748 +0000 UTC m=+1500.479924572"
Jul 10 18:28:15.462516 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.462491    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:28:15.468609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.468585    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:28:15.471020 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.470973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:15.531329 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.531299    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfc4263-648f-4ffc-9d19-81f3b5d49875" path="/var/lib/kubelet/pods/acfc4263-648f-4ffc-9d19-81f3b5d49875/volumes"
Jul 10 18:28:15.587516 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.587428    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"]
Jul 10 18:28:15.592834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.592806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:15.593012 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.592967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.595655 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.595617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:15.597086 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.597068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e40e89b9-serving-cert\""
Jul 10 18:28:15.602701 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.602678    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"]
Jul 10 18:28:15.624589 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.624555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:15.697890 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.697852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6220b-4fcd-4314-90ab-9c88f9166481-openshift-service-ca\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.698081 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.697908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.698081 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.698019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6qr4\" (UniqueName: \"kubernetes.io/projected/6fe6220b-4fcd-4314-90ab-9c88f9166481-kube-api-access-n6qr4\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.723038 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.723006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:15.798558 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.798517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6220b-4fcd-4314-90ab-9c88f9166481-openshift-service-ca\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.798777 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.798573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.798777 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.798691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6qr4\" (UniqueName: \"kubernetes.io/projected/6fe6220b-4fcd-4314-90ab-9c88f9166481-kube-api-access-n6qr4\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.798777 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:15.798751    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-serving-cert: secret "maas-api-e2e-ait-e40e89b9-serving-cert" not found
Jul 10 18:28:15.798927 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:15.798813    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls podName:6fe6220b-4fcd-4314-90ab-9c88f9166481 nodeName:}" failed. No retries permitted until 2026-07-10 18:28:16.298791834 +0000 UTC m=+1501.457509646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls") pod "maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh" (UID: "6fe6220b-4fcd-4314-90ab-9c88f9166481") : secret "maas-api-e2e-ait-e40e89b9-serving-cert" not found
Jul 10 18:28:15.799283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.799257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6220b-4fcd-4314-90ab-9c88f9166481-openshift-service-ca\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.807800 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.807771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6qr4\" (UniqueName: \"kubernetes.io/projected/6fe6220b-4fcd-4314-90ab-9c88f9166481-kube-api-access-n6qr4\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:15.957199 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:15.957163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:16.123491 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.123463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:16.227666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.227556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:16.301274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.301237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:16.302118 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.302098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:16.304180 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.304156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:16.306580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.306557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls\") pod \"maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:16.506274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.506188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:16.650678 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:16.650650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"]
Jul 10 18:28:16.653992 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:28:16.653963    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe6220b_4fcd_4314_90ab_9c88f9166481.slice/crio-adc5ecf479ab99f8ffcacf17b1954f20ec52eb31aa6c7cc34eb7f5731b847d27 WatchSource:0}: Error finding container adc5ecf479ab99f8ffcacf17b1954f20ec52eb31aa6c7cc34eb7f5731b847d27: Status 404 returned error can't find the container with id adc5ecf479ab99f8ffcacf17b1954f20ec52eb31aa6c7cc34eb7f5731b847d27
Jul 10 18:28:17.307931 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:17.307888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh" event={"ID":"6fe6220b-4fcd-4314-90ab-9c88f9166481","Type":"ContainerStarted","Data":"547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048"}
Jul 10 18:28:17.308377 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:17.307988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh" event={"ID":"6fe6220b-4fcd-4314-90ab-9c88f9166481","Type":"ContainerStarted","Data":"adc5ecf479ab99f8ffcacf17b1954f20ec52eb31aa6c7cc34eb7f5731b847d27"}
Jul 10 18:28:17.330245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:17.330190    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh" podStartSLOduration=1.853158455 podStartE2EDuration="2.330170971s" totalImagesPullingTime="477.012516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:17.328460473 +0000 UTC m=+1502.487178298" watchObservedRunningTime="2026-07-10 18:28:17.330170971 +0000 UTC m=+1502.488888800"
Jul 10 18:28:17.445745 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:17.445715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:18.312915 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:18.312875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:20.573583 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:20.573543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:20.882373 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:20.882342    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"]
Jul 10 18:28:20.882632 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:20.882599    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh" podUID="6fe6220b-4fcd-4314-90ab-9c88f9166481" containerName="maas-api" containerID="cri-o://547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048" gracePeriod=30
Jul 10 18:28:20.909154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:20.909118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:21.139707 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.139614    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:21.256161 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.256120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls\") pod \"6fe6220b-4fcd-4314-90ab-9c88f9166481\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") "
Jul 10 18:28:21.256391 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.256203    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6qr4\" (UniqueName: \"kubernetes.io/projected/6fe6220b-4fcd-4314-90ab-9c88f9166481-kube-api-access-n6qr4\") pod \"6fe6220b-4fcd-4314-90ab-9c88f9166481\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") "
Jul 10 18:28:21.256391 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.256341    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6220b-4fcd-4314-90ab-9c88f9166481-openshift-service-ca\") pod \"6fe6220b-4fcd-4314-90ab-9c88f9166481\" (UID: \"6fe6220b-4fcd-4314-90ab-9c88f9166481\") "
Jul 10 18:28:21.256757 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.256729    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe6220b-4fcd-4314-90ab-9c88f9166481-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6fe6220b-4fcd-4314-90ab-9c88f9166481" (UID: "6fe6220b-4fcd-4314-90ab-9c88f9166481"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:28:21.258888 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.258859    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6fe6220b-4fcd-4314-90ab-9c88f9166481" (UID: "6fe6220b-4fcd-4314-90ab-9c88f9166481"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:28:21.258888 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.258862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe6220b-4fcd-4314-90ab-9c88f9166481-kube-api-access-n6qr4" (OuterVolumeSpecName: "kube-api-access-n6qr4") pod "6fe6220b-4fcd-4314-90ab-9c88f9166481" (UID: "6fe6220b-4fcd-4314-90ab-9c88f9166481"). InnerVolumeSpecName "kube-api-access-n6qr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:21.329650 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.329605    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fe6220b-4fcd-4314-90ab-9c88f9166481" containerID="547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048" exitCode=0
Jul 10 18:28:21.329873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.329688    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"
Jul 10 18:28:21.329873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.329704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh" event={"ID":"6fe6220b-4fcd-4314-90ab-9c88f9166481","Type":"ContainerDied","Data":"547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048"}
Jul 10 18:28:21.329873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.329778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh" event={"ID":"6fe6220b-4fcd-4314-90ab-9c88f9166481","Type":"ContainerDied","Data":"adc5ecf479ab99f8ffcacf17b1954f20ec52eb31aa6c7cc34eb7f5731b847d27"}
Jul 10 18:28:21.329873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.329828    2565 scope.go:117] "RemoveContainer" containerID="547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048"
Jul 10 18:28:21.339861 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.339835    2565 scope.go:117] "RemoveContainer" containerID="547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048"
Jul 10 18:28:21.340182 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:21.340160    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048\": container with ID starting with 547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048 not found: ID does not exist" containerID="547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048"
Jul 10 18:28:21.340253 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.340192    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048"} err="failed to get container status \"547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048\": rpc error: code = NotFound desc = could not find container \"547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048\": container with ID starting with 547fbb7fdab83d31bf1c719fcb0b7e7d98d32b85e73fa3690f4ebb00689fe048 not found: ID does not exist"
Jul 10 18:28:21.355047 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.355014    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"]
Jul 10 18:28:21.357478 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.357449    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6220b-4fcd-4314-90ab-9c88f9166481-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:21.357478 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.357476    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe6220b-4fcd-4314-90ab-9c88f9166481-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:21.357657 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.357486    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6qr4\" (UniqueName: \"kubernetes.io/projected/6fe6220b-4fcd-4314-90ab-9c88f9166481-kube-api-access-n6qr4\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:21.359198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.359176    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e40e89b9-559cff6cfd-m5nzh"]
Jul 10 18:28:21.530412 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:21.530329    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe6220b-4fcd-4314-90ab-9c88f9166481" path="/var/lib/kubelet/pods/6fe6220b-4fcd-4314-90ab-9c88f9166481/volumes"
Jul 10 18:28:26.557701 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:26.557598    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"]
Jul 10 18:28:26.558094 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:26.557882    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2" podUID="5d64edf3-023f-4e64-8023-ffad9e0c53a1" containerName="istio-proxy" containerID="cri-o://e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926" gracePeriod=30
Jul 10 18:28:26.585138 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:26.585105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:26.685278 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:26.685242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:27.984340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:27.984298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:29.025330 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.025301    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:29.137963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.137922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-token\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.137979    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-socket\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138051    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tk9m\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-kube-api-access-5tk9m\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138091    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-podinfo\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-certs\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138167 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138161    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istiod-ca-cert\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138432 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138185    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-credential-socket\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138432 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-envoy\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138432 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138321    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:29.138432 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138343    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-data\") pod \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\" (UID: \"5d64edf3-023f-4e64-8023-ffad9e0c53a1\") "
Jul 10 18:28:29.138665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138436    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:29.138665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138619    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:29.138856 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.138782    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:28:29.139239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.139124    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.139239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.139151    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.139239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.139166    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.139239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.139180    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.139503 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.139338    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:29.141294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.141132    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-kube-api-access-5tk9m" (OuterVolumeSpecName: "kube-api-access-5tk9m") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "kube-api-access-5tk9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:29.141294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.141207    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:29.141294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.141256    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:29.141515 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.141296    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d64edf3-023f-4e64-8023-ffad9e0c53a1" (UID: "5d64edf3-023f-4e64-8023-ffad9e0c53a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:28:29.239841 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.239806    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.239841 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.239835    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.239841 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.239846    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tk9m\" (UniqueName: \"kubernetes.io/projected/5d64edf3-023f-4e64-8023-ffad9e0c53a1-kube-api-access-5tk9m\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.240086 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.239855    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.240086 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.239865    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64edf3-023f-4e64-8023-ffad9e0c53a1-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:29.382038 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.382002    2565 generic.go:356] "Generic (PLEG): container finished" podID="5d64edf3-023f-4e64-8023-ffad9e0c53a1" containerID="e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926" exitCode=0
Jul 10 18:28:29.382216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.382046    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"
Jul 10 18:28:29.382216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.382092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2" event={"ID":"5d64edf3-023f-4e64-8023-ffad9e0c53a1","Type":"ContainerDied","Data":"e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926"}
Jul 10 18:28:29.382216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.382151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2" event={"ID":"5d64edf3-023f-4e64-8023-ffad9e0c53a1","Type":"ContainerDied","Data":"c92d4c882b626cefdeb9496b82e0649b4aa39f564862c08e0cfc28ba6adbeca6"}
Jul 10 18:28:29.382216 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.382181    2565 scope.go:117] "RemoveContainer" containerID="e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926"
Jul 10 18:28:29.392141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.392122    2565 scope.go:117] "RemoveContainer" containerID="e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926"
Jul 10 18:28:29.392411 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:29.392390    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926\": container with ID starting with e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926 not found: ID does not exist" containerID="e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926"
Jul 10 18:28:29.392483 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.392419    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926"} err="failed to get container status \"e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926\": rpc error: code = NotFound desc = could not find container \"e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926\": container with ID starting with e56647c6902fd63358f5d5064b7f47cedb681cc4c9f1361b94f7064f2e60b926 not found: ID does not exist"
Jul 10 18:28:29.404661 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.404618    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"]
Jul 10 18:28:29.408763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.408740    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e40e89b9-openshift-default-686648dd59-c8pr2"]
Jul 10 18:28:29.529587 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:29.529552    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d64edf3-023f-4e64-8023-ffad9e0c53a1" path="/var/lib/kubelet/pods/5d64edf3-023f-4e64-8023-ffad9e0c53a1/volumes"
Jul 10 18:28:32.556617 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.556585    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:32.659219 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.659136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:32.732975 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.732904    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"]
Jul 10 18:28:32.733604 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.733581    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d64edf3-023f-4e64-8023-ffad9e0c53a1" containerName="istio-proxy"
Jul 10 18:28:32.733746 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.733607    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d64edf3-023f-4e64-8023-ffad9e0c53a1" containerName="istio-proxy"
Jul 10 18:28:32.733746 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.733622    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe6220b-4fcd-4314-90ab-9c88f9166481" containerName="maas-api"
Jul 10 18:28:32.733746 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.733630    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe6220b-4fcd-4314-90ab-9c88f9166481" containerName="maas-api"
Jul 10 18:28:32.733881 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.733804    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d64edf3-023f-4e64-8023-ffad9e0c53a1" containerName="istio-proxy"
Jul 10 18:28:32.733881 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.733823    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe6220b-4fcd-4314-90ab-9c88f9166481" containerName="maas-api"
Jul 10 18:28:32.737330 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.737308    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.741380 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.741352    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3a3c9056-openshift-default-dockercfg-shrrf\""
Jul 10 18:28:32.752202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.752172    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"]
Jul 10 18:28:32.765419 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.765387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:32.875788 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-podinfo\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.875788 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-data\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.875788 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-token\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.876027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istiod-ca-cert\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.876027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-socket\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.876027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-credential-socket\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.876027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-certs\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.876027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.875989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-envoy\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.876183 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.876030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8scz9\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-kube-api-access-8scz9\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.976971 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.976924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-podinfo\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.976988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-data\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-token\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istiod-ca-cert\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-socket\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-credential-socket\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977432 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-certs\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977432 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-envoy\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977432 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8scz9\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-kube-api-access-8scz9\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-data\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-socket\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977813 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-credential-socket\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.977813 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.977792    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-certs\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.978064 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.978045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istiod-ca-cert\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.979580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.979556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-envoy\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.979684 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.979623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-podinfo\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.985140 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.985117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-token\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.985246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.985179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8scz9\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-kube-api-access-8scz9\") pod \"e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") " pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:32.998159 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:32.998125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:33.051108 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.051067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:33.203669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.203628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"]
Jul 10 18:28:33.206287 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:28:33.206249    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95a5260_716e_4719_89fa_1ace6a4f6d7c.slice/crio-076dda348d4f9ea08672d46294568da9ee4dafda456afe9bc82e6ff14f91fc93 WatchSource:0}: Error finding container 076dda348d4f9ea08672d46294568da9ee4dafda456afe9bc82e6ff14f91fc93: Status 404 returned error can't find the container with id 076dda348d4f9ea08672d46294568da9ee4dafda456afe9bc82e6ff14f91fc93
Jul 10 18:28:33.208519 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.208474    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:33.208604 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.208577    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:33.208670 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.208628    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:28:33.408303 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.408214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk" event={"ID":"a95a5260-716e-4719-89fa-1ace6a4f6d7c","Type":"ContainerStarted","Data":"ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a"}
Jul 10 18:28:33.408454 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.408309    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk" event={"ID":"a95a5260-716e-4719-89fa-1ace6a4f6d7c","Type":"ContainerStarted","Data":"076dda348d4f9ea08672d46294568da9ee4dafda456afe9bc82e6ff14f91fc93"}
Jul 10 18:28:33.430265 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.430190    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk" podStartSLOduration=1.4301666929999999 podStartE2EDuration="1.430166693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:33.42738204 +0000 UTC m=+1518.586099866" watchObservedRunningTime="2026-07-10 18:28:33.430166693 +0000 UTC m=+1518.588884519"
Jul 10 18:28:33.950963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:33.950927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:34.038989 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.038951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:34.040920 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.040890    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"]
Jul 10 18:28:34.044407 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.044384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.047088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.047061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3a3c9056-serving-cert\""
Jul 10 18:28:34.052705 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.052672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:34.054239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.053998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"]
Jul 10 18:28:34.058591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.058564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:34.114875 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.114832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:34.189479 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.189445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.189691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.189494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6rhl\" (UniqueName: \"kubernetes.io/projected/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-kube-api-access-f6rhl\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.189691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.189621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-openshift-service-ca\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.290283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.290185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-openshift-service-ca\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.290283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.290236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.290283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.290270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6rhl\" (UniqueName: \"kubernetes.io/projected/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-kube-api-access-f6rhl\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.290542 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:34.290406    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-serving-cert: secret "maas-api-e2e-derive-3a3c9056-serving-cert" not found
Jul 10 18:28:34.290542 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:34.290476    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls podName:b3de3eb2-c09c-4a33-a3c9-747d7dba0829 nodeName:}" failed. No retries permitted until 2026-07-10 18:28:34.790457105 +0000 UTC m=+1519.949174912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls") pod "maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z" (UID: "b3de3eb2-c09c-4a33-a3c9-747d7dba0829") : secret "maas-api-e2e-derive-3a3c9056-serving-cert" not found
Jul 10 18:28:34.290841 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.290817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-openshift-service-ca\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.301149 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.301125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6rhl\" (UniqueName: \"kubernetes.io/projected/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-kube-api-access-f6rhl\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.414498 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.414464    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:34.415590 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.415563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:34.496823 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.496777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:34.605715 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.605611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:34.709557 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.709508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:34.796989 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.796931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.799654 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.799619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls\") pod \"maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:34.958938 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:34.958897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:35.115244 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:35.115213    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"]
Jul 10 18:28:35.117391 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:28:35.117349    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3de3eb2_c09c_4a33_a3c9_747d7dba0829.slice/crio-07db389299d6b299408a8a22dd04a17694c70456d8258261b609b345c66caf59 WatchSource:0}: Error finding container 07db389299d6b299408a8a22dd04a17694c70456d8258261b609b345c66caf59: Status 404 returned error can't find the container with id 07db389299d6b299408a8a22dd04a17694c70456d8258261b609b345c66caf59
Jul 10 18:28:35.420999 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:35.420961    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z" event={"ID":"b3de3eb2-c09c-4a33-a3c9-747d7dba0829","Type":"ContainerStarted","Data":"07db389299d6b299408a8a22dd04a17694c70456d8258261b609b345c66caf59"}
Jul 10 18:28:36.233798 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:36.233698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:36.429126 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:36.429078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z" event={"ID":"b3de3eb2-c09c-4a33-a3c9-747d7dba0829","Type":"ContainerStarted","Data":"1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311"}
Jul 10 18:28:36.448260 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:36.448135    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z" podStartSLOduration=2.176136022 podStartE2EDuration="2.448113955s" totalImagesPullingTime="271.977933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:36.445955061 +0000 UTC m=+1521.604672887" watchObservedRunningTime="2026-07-10 18:28:36.448113955 +0000 UTC m=+1521.606831780"
Jul 10 18:28:37.434273 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:37.434233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:38.319403 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:38.319373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:38.514414 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:38.514377    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"]
Jul 10 18:28:38.514886 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:38.514625    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk" podUID="a95a5260-716e-4719-89fa-1ace6a4f6d7c" containerName="istio-proxy" containerID="cri-o://ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a" gracePeriod=30
Jul 10 18:28:38.538754 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:38.538559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:38.633628 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:38.633453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:38.903283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:38.903183    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"]
Jul 10 18:28:38.933965 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:38.929328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:39.459119 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.459073    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z" podUID="b3de3eb2-c09c-4a33-a3c9-747d7dba0829" containerName="maas-api" containerID="cri-o://1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311" gracePeriod=30
Jul 10 18:28:39.762899 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.762863    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:39.796822 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.796786    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:39.865735 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.865687    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-openshift-service-ca\") pod \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") "
Jul 10 18:28:39.865965 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.865797    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6rhl\" (UniqueName: \"kubernetes.io/projected/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-kube-api-access-f6rhl\") pod \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") "
Jul 10 18:28:39.865965 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.865915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls\") pod \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\" (UID: \"b3de3eb2-c09c-4a33-a3c9-747d7dba0829\") "
Jul 10 18:28:39.866089 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.866046    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3de3eb2-c09c-4a33-a3c9-747d7dba0829" (UID: "b3de3eb2-c09c-4a33-a3c9-747d7dba0829"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:28:39.866321 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.866282    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:39.870206 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.870163    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3de3eb2-c09c-4a33-a3c9-747d7dba0829" (UID: "b3de3eb2-c09c-4a33-a3c9-747d7dba0829"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:28:39.870352 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.870250    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-kube-api-access-f6rhl" (OuterVolumeSpecName: "kube-api-access-f6rhl") pod "b3de3eb2-c09c-4a33-a3c9-747d7dba0829" (UID: "b3de3eb2-c09c-4a33-a3c9-747d7dba0829"). InnerVolumeSpecName "kube-api-access-f6rhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:39.966996 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.966895    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:39.966996 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:39.966930    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6rhl\" (UniqueName: \"kubernetes.io/projected/b3de3eb2-c09c-4a33-a3c9-747d7dba0829-kube-api-access-f6rhl\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:40.465108 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.465070    2565 generic.go:356] "Generic (PLEG): container finished" podID="b3de3eb2-c09c-4a33-a3c9-747d7dba0829" containerID="1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311" exitCode=0
Jul 10 18:28:40.465309 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.465142    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"
Jul 10 18:28:40.465309 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.465194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z" event={"ID":"b3de3eb2-c09c-4a33-a3c9-747d7dba0829","Type":"ContainerDied","Data":"1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311"}
Jul 10 18:28:40.465309 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.465246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z" event={"ID":"b3de3eb2-c09c-4a33-a3c9-747d7dba0829","Type":"ContainerDied","Data":"07db389299d6b299408a8a22dd04a17694c70456d8258261b609b345c66caf59"}
Jul 10 18:28:40.465309 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.465270    2565 scope.go:117] "RemoveContainer" containerID="1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311"
Jul 10 18:28:40.474672 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.474622    2565 scope.go:117] "RemoveContainer" containerID="1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311"
Jul 10 18:28:40.474989 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:40.474965    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311\": container with ID starting with 1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311 not found: ID does not exist" containerID="1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311"
Jul 10 18:28:40.475067 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.475007    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311"} err="failed to get container status \"1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311\": rpc error: code = NotFound desc = could not find container \"1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311\": container with ID starting with 1d9c3cb47ad594c1eb93b45d64a003f0ff7c7f10dd16151f50949a4a4bc7e311 not found: ID does not exist"
Jul 10 18:28:40.493703 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.493672    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"]
Jul 10 18:28:40.496980 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:40.496949    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a3c9056-6bf57d965-kl97z"]
Jul 10 18:28:41.534147 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:41.534101    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3de3eb2-c09c-4a33-a3c9-747d7dba0829" path="/var/lib/kubelet/pods/b3de3eb2-c09c-4a33-a3c9-747d7dba0829/volumes"
Jul 10 18:28:44.414084 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:44.414024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:44.476022 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:44.475974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:44.853437 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:44.853331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:44.954767 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:44.954713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:45.055056 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.055017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:45.184760 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.184733    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:45.220486 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-envoy\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.220691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-data\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.220691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-certs\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.220691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-credential-socket\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.220691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-socket\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.220691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istiod-ca-cert\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.220691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-podinfo\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.221022 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-token\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.221022 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220839    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:45.221022 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.220984    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:45.221022 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221000    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:45.221241 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8scz9\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-kube-api-access-8scz9\") pod \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\" (UID: \"a95a5260-716e-4719-89fa-1ace6a4f6d7c\") "
Jul 10 18:28:45.221241 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:28:45.221508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221484    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.221599 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221513    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.221599 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221530    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.221599 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221543    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.221803 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.221720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:45.223377 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.223350    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:28:45.223511 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.223446    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:28:45.223511 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.223462    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:45.223765 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.223541    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-kube-api-access-8scz9" (OuterVolumeSpecName: "kube-api-access-8scz9") pod "a95a5260-716e-4719-89fa-1ace6a4f6d7c" (UID: "a95a5260-716e-4719-89fa-1ace6a4f6d7c"). InnerVolumeSpecName "kube-api-access-8scz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:45.322254 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.322215    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.322254 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.322248    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.322254 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.322259    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.322514 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.322268    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.322514 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.322276    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8scz9\" (UniqueName: \"kubernetes.io/projected/a95a5260-716e-4719-89fa-1ace6a4f6d7c-kube-api-access-8scz9\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:28:45.496376 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.496279    2565 generic.go:356] "Generic (PLEG): container finished" podID="a95a5260-716e-4719-89fa-1ace6a4f6d7c" containerID="ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a" exitCode=0
Jul 10 18:28:45.496376 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.496325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk" event={"ID":"a95a5260-716e-4719-89fa-1ace6a4f6d7c","Type":"ContainerDied","Data":"ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a"}
Jul 10 18:28:45.496376 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.496333    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"
Jul 10 18:28:45.496376 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.496366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk" event={"ID":"a95a5260-716e-4719-89fa-1ace6a4f6d7c","Type":"ContainerDied","Data":"076dda348d4f9ea08672d46294568da9ee4dafda456afe9bc82e6ff14f91fc93"}
Jul 10 18:28:45.497005 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.496388    2565 scope.go:117] "RemoveContainer" containerID="ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a"
Jul 10 18:28:45.506076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.506054    2565 scope.go:117] "RemoveContainer" containerID="ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a"
Jul 10 18:28:45.506406 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:28:45.506383    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a\": container with ID starting with ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a not found: ID does not exist" containerID="ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a"
Jul 10 18:28:45.506451 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.506417    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a"} err="failed to get container status \"ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a\": rpc error: code = NotFound desc = could not find container \"ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a\": container with ID starting with ce4a5b0505a0856dd7cd7db1515984162fb0a74410de7896ac850f02e089e85a not found: ID does not exist"
Jul 10 18:28:45.520877 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.520848    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"]
Jul 10 18:28:45.529834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:45.529802    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3a3c9056-openshift-default-5f5f576967-bmrtk"]
Jul 10 18:28:46.387234 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:46.387197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:47.541067 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:47.541027    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95a5260-716e-4719-89fa-1ace6a4f6d7c" path="/var/lib/kubelet/pods/a95a5260-716e-4719-89fa-1ace6a4f6d7c/volumes"
Jul 10 18:28:52.148088 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:52.148049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:52.251396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:52.251358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:52.351335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:52.351291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:52.451038 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:52.450934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:52.813131 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:28:52.813038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:18.736098 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:18.736055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:24.516662 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:24.516617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:24.592900 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:24.586998    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:24.671169 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:24.671130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:33.403832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:33.403794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:33.457297 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:33.457246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:40.575452 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:40.575418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:46.172513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:46.172472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:46.281027 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:46.280990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:46.375886 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:46.375849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:56.855382 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:56.855337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:57.600436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:29:57.600401    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:03.473283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:03.473241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:03.659795 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:03.659755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:03.820387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:03.820291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:04.509285 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:04.509246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:04.635540 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:04.635493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:04.737609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:04.737569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:06.210963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:06.210930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:11.952899 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:11.952794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:12.063849 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:12.063804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:12.647385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:12.647349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:18.284755 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.284708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:18.384905 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.384866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:18.524318 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.524282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:18.836789 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.836745    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"]
Jul 10 18:30:18.837457 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.837436    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95a5260-716e-4719-89fa-1ace6a4f6d7c" containerName="istio-proxy"
Jul 10 18:30:18.837571 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.837459    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95a5260-716e-4719-89fa-1ace6a4f6d7c" containerName="istio-proxy"
Jul 10 18:30:18.837571 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.837477    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3de3eb2-c09c-4a33-a3c9-747d7dba0829" containerName="maas-api"
Jul 10 18:30:18.837571 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.837487    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3de3eb2-c09c-4a33-a3c9-747d7dba0829" containerName="maas-api"
Jul 10 18:30:18.837774 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.837572    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3de3eb2-c09c-4a33-a3c9-747d7dba0829" containerName="maas-api"
Jul 10 18:30:18.837774 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.837585    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95a5260-716e-4719-89fa-1ace6a4f6d7c" containerName="istio-proxy"
Jul 10 18:30:18.841308 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.841279    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.844503 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.844469    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fe1cedaf-openshift-default-dockercfg-4zgv5\""
Jul 10 18:30:18.857897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.857857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"]
Jul 10 18:30:18.870840 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.870802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:18.986263 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-data\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-envoy\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a46ccc-a09e-4fac-9336-7af30a82020e-istiod-ca-cert\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-podinfo\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-certs\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm84q\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-kube-api-access-xm84q\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-token\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-credential-socket\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:18.986830 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:18.986525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-socket\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.010365 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.010326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:19.087976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.087868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-data\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.087976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.087922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-envoy\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.087976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.087964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a46ccc-a09e-4fac-9336-7af30a82020e-istiod-ca-cert\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.087986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-podinfo\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-certs\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm84q\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-kube-api-access-xm84q\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-token\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-credential-socket\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-socket\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088589 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-certs\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088589 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-credential-socket\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088589 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-data\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088779 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-socket\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.088779 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.088737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a46ccc-a09e-4fac-9336-7af30a82020e-istiod-ca-cert\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.090548 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.090525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-envoy\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.090830 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.090809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-podinfo\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.096291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.096261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-token\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.096413 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.096314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm84q\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-kube-api-access-xm84q\") pod \"e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") " pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.154392 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.154342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:19.308256 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.308177    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"]
Jul 10 18:30:19.311206 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:30:19.311172    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a46ccc_a09e_4fac_9336_7af30a82020e.slice/crio-c9ef9272fe006d60a33325f464b17b91ad26f8e981b3623c1418292bd3d2dc04 WatchSource:0}: Error finding container c9ef9272fe006d60a33325f464b17b91ad26f8e981b3623c1418292bd3d2dc04: Status 404 returned error can't find the container with id c9ef9272fe006d60a33325f464b17b91ad26f8e981b3623c1418292bd3d2dc04
Jul 10 18:30:19.313437 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.313397    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:19.313544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.313471    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:19.313544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:19.313501    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:20.003400 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:20.003355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" event={"ID":"85a46ccc-a09e-4fac-9336-7af30a82020e","Type":"ContainerStarted","Data":"a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809"}
Jul 10 18:30:20.003627 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:20.003418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" event={"ID":"85a46ccc-a09e-4fac-9336-7af30a82020e","Type":"ContainerStarted","Data":"c9ef9272fe006d60a33325f464b17b91ad26f8e981b3623c1418292bd3d2dc04"}
Jul 10 18:30:20.026014 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:20.025950    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" podStartSLOduration=2.0259266 podStartE2EDuration="2.0259266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:20.025137725 +0000 UTC m=+1625.183855562" watchObservedRunningTime="2026-07-10 18:30:20.0259266 +0000 UTC m=+1625.184644428"
Jul 10 18:30:20.154844 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:20.154802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:20.160251 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:20.160220    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:21.011857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:21.011817    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:21.016294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:21.016261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:21.947118 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:21.947082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:21.982071 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:21.982034    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"]
Jul 10 18:30:21.986115 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:21.986090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:21.988879 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:21.988851    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fe1cedaf-serving-cert\""
Jul 10 18:30:21.998443 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:21.998094    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"]
Jul 10 18:30:22.014513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.014474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49320e-dcde-4078-ba08-bebeb97c8e01-openshift-service-ca\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.015076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.014529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvj8c\" (UniqueName: \"kubernetes.io/projected/7f49320e-dcde-4078-ba08-bebeb97c8e01-kube-api-access-hvj8c\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.015076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.014616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.050113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.050072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:22.116089 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.116051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49320e-dcde-4078-ba08-bebeb97c8e01-openshift-service-ca\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.116282 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.116111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvj8c\" (UniqueName: \"kubernetes.io/projected/7f49320e-dcde-4078-ba08-bebeb97c8e01-kube-api-access-hvj8c\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.116282 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.116190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.116395 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:30:22.116354    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-serving-cert: secret "maas-api-e2e-mt-fe1cedaf-serving-cert" not found
Jul 10 18:30:22.116472 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:30:22.116452    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls podName:7f49320e-dcde-4078-ba08-bebeb97c8e01 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:22.616430047 +0000 UTC m=+1627.775147849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls") pod "maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8" (UID: "7f49320e-dcde-4078-ba08-bebeb97c8e01") : secret "maas-api-e2e-mt-fe1cedaf-serving-cert" not found
Jul 10 18:30:22.116826 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.116807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49320e-dcde-4078-ba08-bebeb97c8e01-openshift-service-ca\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.140871 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.140841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvj8c\" (UniqueName: \"kubernetes.io/projected/7f49320e-dcde-4078-ba08-bebeb97c8e01-kube-api-access-hvj8c\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.203420 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.203331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:22.483923 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.483836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:22.588215 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.588179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:22.621388 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.621349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.624196 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.624152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls\") pod \"maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:22.684948 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.684913    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:22.902943 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:22.902905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:23.057121 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:23.057096    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"]
Jul 10 18:30:23.059235 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:30:23.059207    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f49320e_dcde_4078_ba08_bebeb97c8e01.slice/crio-484745ea61f2fb62167d6d478b53ab5a4619e6c35d98417c3b357769bd9846d1 WatchSource:0}: Error finding container 484745ea61f2fb62167d6d478b53ab5a4619e6c35d98417c3b357769bd9846d1: Status 404 returned error can't find the container with id 484745ea61f2fb62167d6d478b53ab5a4619e6c35d98417c3b357769bd9846d1
Jul 10 18:30:24.033093 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:24.033052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8" event={"ID":"7f49320e-dcde-4078-ba08-bebeb97c8e01","Type":"ContainerStarted","Data":"484745ea61f2fb62167d6d478b53ab5a4619e6c35d98417c3b357769bd9846d1"}
Jul 10 18:30:25.040202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:25.040094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8" event={"ID":"7f49320e-dcde-4078-ba08-bebeb97c8e01","Type":"ContainerStarted","Data":"059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98"}
Jul 10 18:30:25.040202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:25.040164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:25.060467 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:25.060410    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8" podStartSLOduration=2.457893335 podStartE2EDuration="4.060392048s" totalImagesPullingTime="1.602498713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:25.058706277 +0000 UTC m=+1630.217424103" watchObservedRunningTime="2026-07-10 18:30:25.060392048 +0000 UTC m=+1630.219109872"
Jul 10 18:30:26.378038 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:26.378005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:27.014550 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:27.014516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:27.113021 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:27.112987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:27.432147 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:27.432113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:31.055174 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:31.055140    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:33.178783 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:33.178752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:33.245093 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:33.245042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:33.578064 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:33.577969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:33.975686 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:33.975627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:34.157378 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.157342    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"]
Jul 10 18:30:34.157601 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.157576    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8" podUID="7f49320e-dcde-4078-ba08-bebeb97c8e01" containerName="maas-api" containerID="cri-o://059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98" gracePeriod=30
Jul 10 18:30:34.217491 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.217407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:34.434009 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.433975    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:34.555666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.555538    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49320e-dcde-4078-ba08-bebeb97c8e01-openshift-service-ca\") pod \"7f49320e-dcde-4078-ba08-bebeb97c8e01\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") "
Jul 10 18:30:34.555666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.555597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls\") pod \"7f49320e-dcde-4078-ba08-bebeb97c8e01\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") "
Jul 10 18:30:34.555896 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.555719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvj8c\" (UniqueName: \"kubernetes.io/projected/7f49320e-dcde-4078-ba08-bebeb97c8e01-kube-api-access-hvj8c\") pod \"7f49320e-dcde-4078-ba08-bebeb97c8e01\" (UID: \"7f49320e-dcde-4078-ba08-bebeb97c8e01\") "
Jul 10 18:30:34.555970 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.555945    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f49320e-dcde-4078-ba08-bebeb97c8e01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7f49320e-dcde-4078-ba08-bebeb97c8e01" (UID: "7f49320e-dcde-4078-ba08-bebeb97c8e01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:30:34.556122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.556101    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49320e-dcde-4078-ba08-bebeb97c8e01-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:34.557967 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.557936    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7f49320e-dcde-4078-ba08-bebeb97c8e01" (UID: "7f49320e-dcde-4078-ba08-bebeb97c8e01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:30:34.558068 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.558001    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f49320e-dcde-4078-ba08-bebeb97c8e01-kube-api-access-hvj8c" (OuterVolumeSpecName: "kube-api-access-hvj8c") pod "7f49320e-dcde-4078-ba08-bebeb97c8e01" (UID: "7f49320e-dcde-4078-ba08-bebeb97c8e01"). InnerVolumeSpecName "kube-api-access-hvj8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:30:34.656754 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.656700    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f49320e-dcde-4078-ba08-bebeb97c8e01-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:34.656754 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:34.656742    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvj8c\" (UniqueName: \"kubernetes.io/projected/7f49320e-dcde-4078-ba08-bebeb97c8e01-kube-api-access-hvj8c\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:35.095566 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.095522    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f49320e-dcde-4078-ba08-bebeb97c8e01" containerID="059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98" exitCode=0
Jul 10 18:30:35.095566 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.095564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"
Jul 10 18:30:35.095819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.095600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8" event={"ID":"7f49320e-dcde-4078-ba08-bebeb97c8e01","Type":"ContainerDied","Data":"059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98"}
Jul 10 18:30:35.095819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.095674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8" event={"ID":"7f49320e-dcde-4078-ba08-bebeb97c8e01","Type":"ContainerDied","Data":"484745ea61f2fb62167d6d478b53ab5a4619e6c35d98417c3b357769bd9846d1"}
Jul 10 18:30:35.095819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.095706    2565 scope.go:117] "RemoveContainer" containerID="059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98"
Jul 10 18:30:35.107436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.107412    2565 scope.go:117] "RemoveContainer" containerID="059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98"
Jul 10 18:30:35.107921 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:30:35.107853    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98\": container with ID starting with 059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98 not found: ID does not exist" containerID="059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98"
Jul 10 18:30:35.107921 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.107894    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98"} err="failed to get container status \"059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98\": rpc error: code = NotFound desc = could not find container \"059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98\": container with ID starting with 059a5d68d952eb9e1f6d50f4f03fe15e9868772fed54e5f27c3c725d009a6b98 not found: ID does not exist"
Jul 10 18:30:35.130291 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.130220    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"]
Jul 10 18:30:35.136261 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.136226    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe1cedaf-6f968c9f8b-l8qj8"]
Jul 10 18:30:35.530349 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:35.530313    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f49320e-dcde-4078-ba08-bebeb97c8e01" path="/var/lib/kubelet/pods/7f49320e-dcde-4078-ba08-bebeb97c8e01/volumes"
Jul 10 18:30:36.794536 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:36.793385    2565 patch_prober.go:28] interesting pod/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:55206->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Jul 10 18:30:36.794536 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:36.793479    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:55206->10.134.0.49:15021: read: connection reset by peer"
Jul 10 18:30:37.110188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:37.110079    2565 generic.go:356] "Generic (PLEG): container finished" podID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerID="a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809" exitCode=0
Jul 10 18:30:37.110188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:37.110153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" event={"ID":"85a46ccc-a09e-4fac-9336-7af30a82020e","Type":"ContainerDied","Data":"a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809"}
Jul 10 18:30:37.110677 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:37.110658    2565 scope.go:117] "RemoveContainer" containerID="a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809"
Jul 10 18:30:37.111865 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:37.111833    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:37.111938 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:37.111909    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:37.111975 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:37.111945    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:38.117904 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:38.117864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" event={"ID":"85a46ccc-a09e-4fac-9336-7af30a82020e","Type":"ContainerStarted","Data":"e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185"}
Jul 10 18:30:38.155192 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:38.155150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:38.155450 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:38.155425    2565 patch_prober.go:28] interesting pod/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 10 18:30:38.155500 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:38.155481    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 10 18:30:39.155134 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:39.155086    2565 patch_prober.go:28] interesting pod/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 10 18:30:39.155807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:39.155764    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 10 18:30:39.744893 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:39.744836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:39.806096 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:39.806059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:40.052729 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:40.051617    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"]
Jul 10 18:30:40.062696 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:40.060871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:40.132493 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:40.132436    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy" containerID="cri-o://e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185" gracePeriod=30
Jul 10 18:30:40.230802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:40.230754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:40.376579 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:40.376458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:40.493631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:40.493591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:40.596146 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:40.596110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:46.112602 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:46.112563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:46.213454 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:46.213412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:46.312851 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:46.312812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:46.434647 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:46.434577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:47.515347 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.515260    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:47.710227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710184    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm84q\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-kube-api-access-xm84q\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710222    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-token\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710441 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-certs\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710441 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710286    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-socket\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710441 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-data\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710452    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-credential-socket\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710485    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a46ccc-a09e-4fac-9336-7af30a82020e-istiod-ca-cert\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-envoy\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710552    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-podinfo\") pod \"85a46ccc-a09e-4fac-9336-7af30a82020e\" (UID: \"85a46ccc-a09e-4fac-9336-7af30a82020e\") "
Jul 10 18:30:47.710591 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710583    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:30:47.710832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710683    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:30:47.710832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:30:47.710991 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710961    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a46ccc-a09e-4fac-9336-7af30a82020e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:30:47.711064 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.710974    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.711064 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.711019    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.711064 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.711040    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.711392 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.711366    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-data" (OuterVolumeSpecName: "istio-data") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:30:47.712860 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.712835    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:30:47.712982 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.712936    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-kube-api-access-xm84q" (OuterVolumeSpecName: "kube-api-access-xm84q") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "kube-api-access-xm84q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:30:47.713168 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.713149    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:30:47.713220 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.713156    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-token" (OuterVolumeSpecName: "istio-token") pod "85a46ccc-a09e-4fac-9336-7af30a82020e" (UID: "85a46ccc-a09e-4fac-9336-7af30a82020e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:30:47.812051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.811951    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.812051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.811986    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a46ccc-a09e-4fac-9336-7af30a82020e-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.812051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.811995    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.812051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.812003    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.812051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.812016    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm84q\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-kube-api-access-xm84q\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:47.812051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:47.812028    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a46ccc-a09e-4fac-9336-7af30a82020e-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:30:48.190238 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.190205    2565 generic.go:356] "Generic (PLEG): container finished" podID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerID="e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185" exitCode=0
Jul 10 18:30:48.190447 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.190261    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"
Jul 10 18:30:48.190447 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.190295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" event={"ID":"85a46ccc-a09e-4fac-9336-7af30a82020e","Type":"ContainerDied","Data":"e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185"}
Jul 10 18:30:48.190447 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.190362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw" event={"ID":"85a46ccc-a09e-4fac-9336-7af30a82020e","Type":"ContainerDied","Data":"c9ef9272fe006d60a33325f464b17b91ad26f8e981b3623c1418292bd3d2dc04"}
Jul 10 18:30:48.190447 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.190393    2565 scope.go:117] "RemoveContainer" containerID="e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185"
Jul 10 18:30:48.200286 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.200255    2565 scope.go:117] "RemoveContainer" containerID="a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809"
Jul 10 18:30:48.208932 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.208910    2565 scope.go:117] "RemoveContainer" containerID="e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185"
Jul 10 18:30:48.209236 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:30:48.209216    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185\": container with ID starting with e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185 not found: ID does not exist" containerID="e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185"
Jul 10 18:30:48.209290 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.209247    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185"} err="failed to get container status \"e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185\": rpc error: code = NotFound desc = could not find container \"e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185\": container with ID starting with e09a414404c0a519ede7c61834c5fae9310eb0f8cd9758b39ea5287a7828c185 not found: ID does not exist"
Jul 10 18:30:48.209290 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.209269    2565 scope.go:117] "RemoveContainer" containerID="a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809"
Jul 10 18:30:48.209516 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:30:48.209498    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809\": container with ID starting with a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809 not found: ID does not exist" containerID="a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809"
Jul 10 18:30:48.209576 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.209521    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809"} err="failed to get container status \"a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809\": rpc error: code = NotFound desc = could not find container \"a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809\": container with ID starting with a3639a0208ec9e5762f8fc695aa5afda5a16429236db2ad428aaf1ddfe228809 not found: ID does not exist"
Jul 10 18:30:48.212795 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.212769    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"]
Jul 10 18:30:48.218434 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:48.218407    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fe1cedaf-openshift-default-dd546f755-k2dcw"]
Jul 10 18:30:49.530148 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:49.530115    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" path="/var/lib/kubelet/pods/85a46ccc-a09e-4fac-9336-7af30a82020e/volumes"
Jul 10 18:30:52.078784 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:52.078746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:52.183079 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:52.183041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:59.105263 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.105217    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"]
Jul 10 18:30:59.106007 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.105982    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f49320e-dcde-4078-ba08-bebeb97c8e01" containerName="maas-api"
Jul 10 18:30:59.106077 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.106011    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f49320e-dcde-4078-ba08-bebeb97c8e01" containerName="maas-api"
Jul 10 18:30:59.106077 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.106039    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy"
Jul 10 18:30:59.106077 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.106048    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy"
Jul 10 18:30:59.106185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.106172    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy"
Jul 10 18:30:59.106221 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.106189    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f49320e-dcde-4078-ba08-bebeb97c8e01" containerName="maas-api"
Jul 10 18:30:59.111128 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.111103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.114381 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.114356    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d047b574-openshift-default-dockercfg-zzktq\""
Jul 10 18:30:59.119177 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.119150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"]
Jul 10 18:30:59.214976 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.214932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-data\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215182 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07744b42-fdea-4172-8103-a385c26609da-istio-podinfo\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215182 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-envoy\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215182 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-socket\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215182 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-certs\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215407 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07744b42-fdea-4172-8103-a385c26609da-istiod-ca-cert\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215407 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dxt2\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-kube-api-access-8dxt2\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215512 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-credential-socket\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.215618 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.215511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-istio-token\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316092 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07744b42-fdea-4172-8103-a385c26609da-istiod-ca-cert\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316317 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dxt2\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-kube-api-access-8dxt2\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316317 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-credential-socket\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316317 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-istio-token\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316317 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-data\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316317 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07744b42-fdea-4172-8103-a385c26609da-istio-podinfo\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316317 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-envoy\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316677 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-socket\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316677 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-certs\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316677 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-credential-socket\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316852 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-data\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316852 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-certs\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316926 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-socket\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.316926 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.316891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07744b42-fdea-4172-8103-a385c26609da-istiod-ca-cert\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.318732 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.318708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-envoy\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.319013 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.318995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07744b42-fdea-4172-8103-a385c26609da-istio-podinfo\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.329581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.329548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-istio-token\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.329804 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.329783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dxt2\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-kube-api-access-8dxt2\") pod \"e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") " pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.422502 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.422466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:30:59.474534 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.474501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:59.535525 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.535461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:59.595025 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.594994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"]
Jul 10 18:30:59.596462 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:30:59.596432    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07744b42_fdea_4172_8103_a385c26609da.slice/crio-696dec83f2b2711c5037bf8b10c0859d5da766296c1905b549bd6250a7236921 WatchSource:0}: Error finding container 696dec83f2b2711c5037bf8b10c0859d5da766296c1905b549bd6250a7236921: Status 404 returned error can't find the container with id 696dec83f2b2711c5037bf8b10c0859d5da766296c1905b549bd6250a7236921
Jul 10 18:30:59.598572 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.598536    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:59.598631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.598607    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:30:59.598694 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:30:59.598653    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:31:00.258513 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:00.258475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" event={"ID":"07744b42-fdea-4172-8103-a385c26609da","Type":"ContainerStarted","Data":"ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32"}
Jul 10 18:31:00.259001 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:00.258530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" event={"ID":"07744b42-fdea-4172-8103-a385c26609da","Type":"ContainerStarted","Data":"696dec83f2b2711c5037bf8b10c0859d5da766296c1905b549bd6250a7236921"}
Jul 10 18:31:00.279954 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:00.279869    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" podStartSLOduration=1.279849125 podStartE2EDuration="1.279849125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:00.279070894 +0000 UTC m=+1665.437788720" watchObservedRunningTime="2026-07-10 18:31:00.279849125 +0000 UTC m=+1665.438566950"
Jul 10 18:31:00.423121 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:00.423076    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:00.428810 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:00.428779    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:01.264884 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:01.264840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:01.266101 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:01.266075    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:02.176529 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.176454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:02.274033 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.273993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:02.393827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.393384    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"]
Jul 10 18:31:02.394410 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.394391    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy"
Jul 10 18:31:02.394473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.394413    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy"
Jul 10 18:31:02.394473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.394471    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85a46ccc-a09e-4fac-9336-7af30a82020e" containerName="istio-proxy"
Jul 10 18:31:02.397773 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.397745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.400762 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.400727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d047b574-serving-cert\""
Jul 10 18:31:02.410457 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.410420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"]
Jul 10 18:31:02.433249 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.433153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:02.446531 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.446494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcnrk\" (UniqueName: \"kubernetes.io/projected/1e803318-3900-4fdf-8845-6134b543479c-kube-api-access-pcnrk\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.446770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.446552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e803318-3900-4fdf-8845-6134b543479c-maas-api-tls\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.446770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.446705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e803318-3900-4fdf-8845-6134b543479c-openshift-service-ca\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.547855 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.547811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnrk\" (UniqueName: \"kubernetes.io/projected/1e803318-3900-4fdf-8845-6134b543479c-kube-api-access-pcnrk\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.548070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.547873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e803318-3900-4fdf-8845-6134b543479c-maas-api-tls\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.548070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.547977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e803318-3900-4fdf-8845-6134b543479c-openshift-service-ca\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.548628 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.548598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e803318-3900-4fdf-8845-6134b543479c-openshift-service-ca\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.550442 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.550418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e803318-3900-4fdf-8845-6134b543479c-maas-api-tls\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.558585 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.558558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcnrk\" (UniqueName: \"kubernetes.io/projected/1e803318-3900-4fdf-8845-6134b543479c-kube-api-access-pcnrk\") pod \"maas-api-e2e-mt-d047b574-67845d7994-75bld\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.577689 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.577623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:02.712005 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.711913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:02.870608 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.870579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"]
Jul 10 18:31:02.872586 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:31:02.872552    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e803318_3900_4fdf_8845_6134b543479c.slice/crio-f94f9a3b818a230ba8d9756a6380cbcd43b0e7ab7b4efe2d5168f4d26b0c63cc WatchSource:0}: Error finding container f94f9a3b818a230ba8d9756a6380cbcd43b0e7ab7b4efe2d5168f4d26b0c63cc: Status 404 returned error can't find the container with id f94f9a3b818a230ba8d9756a6380cbcd43b0e7ab7b4efe2d5168f4d26b0c63cc
Jul 10 18:31:02.937385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:02.937351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:03.037829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:03.037732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:03.276778 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:03.276730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld" event={"ID":"1e803318-3900-4fdf-8845-6134b543479c","Type":"ContainerStarted","Data":"f94f9a3b818a230ba8d9756a6380cbcd43b0e7ab7b4efe2d5168f4d26b0c63cc"}
Jul 10 18:31:04.284491 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:04.284439    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld" event={"ID":"1e803318-3900-4fdf-8845-6134b543479c","Type":"ContainerStarted","Data":"a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028"}
Jul 10 18:31:04.285001 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:04.284591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:04.306991 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:04.306921    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld" podStartSLOduration=1.898452055 podStartE2EDuration="2.30689808s" totalImagesPullingTime="408.446025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:04.305171764 +0000 UTC m=+1669.463889604" watchObservedRunningTime="2026-07-10 18:31:04.30689808 +0000 UTC m=+1669.465615907"
Jul 10 18:31:06.030571 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:06.030530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:06.133730 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:06.133692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:06.648437 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:06.648404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:10.297845 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:10.297809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:16.266403 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.266365    2565 patch_prober.go:28] interesting pod/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 10 18:31:16.266849 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.266441    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 10 18:31:16.359091 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.359056    2565 generic.go:356] "Generic (PLEG): container finished" podID="07744b42-fdea-4172-8103-a385c26609da" containerID="ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32" exitCode=0
Jul 10 18:31:16.359281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.359124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" event={"ID":"07744b42-fdea-4172-8103-a385c26609da","Type":"ContainerDied","Data":"ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32"}
Jul 10 18:31:16.359666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.359625    2565 scope.go:117] "RemoveContainer" containerID="ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32"
Jul 10 18:31:16.360728 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.360697    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:31:16.360784 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.360773    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:31:16.360829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:16.360807    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:31:17.367527 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:17.367489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" event={"ID":"07744b42-fdea-4172-8103-a385c26609da","Type":"ContainerStarted","Data":"b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf"}
Jul 10 18:31:17.423009 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:17.422962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:17.423254 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:17.423228    2565 patch_prober.go:28] interesting pod/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 10 18:31:17.423313 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:17.423279    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 10 18:31:18.423178 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:18.423131    2565 patch_prober.go:28] interesting pod/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 10 18:31:18.423623 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:18.423198    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 10 18:31:19.423810 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:19.423754    2565 patch_prober.go:28] interesting pod/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 10 18:31:19.424849 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:19.424407    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 10 18:31:20.422962 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:20.422925    2565 patch_prober.go:28] interesting pod/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 10 18:31:20.423268 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:20.422984    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 10 18:31:21.428580 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:21.428545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:21.429094 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:21.428928    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:21.429909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:21.429890    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:31:24.491333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:24.491292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:25.723323 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:25.723276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:29.893892 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:29.893849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:40.557989 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:40.557886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:40.660255 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:40.660217    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:49.177604 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.177560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:49.552225 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.552131    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"]
Jul 10 18:31:49.552428 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.552394    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld" podUID="1e803318-3900-4fdf-8845-6134b543479c" containerName="maas-api" containerID="cri-o://a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028" gracePeriod=30
Jul 10 18:31:49.582754 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.582718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:49.808368 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.808305    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:49.878877 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.878846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e803318-3900-4fdf-8845-6134b543479c-maas-api-tls\") pod \"1e803318-3900-4fdf-8845-6134b543479c\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") "
Jul 10 18:31:49.879049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.878926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcnrk\" (UniqueName: \"kubernetes.io/projected/1e803318-3900-4fdf-8845-6134b543479c-kube-api-access-pcnrk\") pod \"1e803318-3900-4fdf-8845-6134b543479c\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") "
Jul 10 18:31:49.879049 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.878961    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e803318-3900-4fdf-8845-6134b543479c-openshift-service-ca\") pod \"1e803318-3900-4fdf-8845-6134b543479c\" (UID: \"1e803318-3900-4fdf-8845-6134b543479c\") "
Jul 10 18:31:49.879385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.879361    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e803318-3900-4fdf-8845-6134b543479c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e803318-3900-4fdf-8845-6134b543479c" (UID: "1e803318-3900-4fdf-8845-6134b543479c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:49.880936 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.880913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e803318-3900-4fdf-8845-6134b543479c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e803318-3900-4fdf-8845-6134b543479c" (UID: "1e803318-3900-4fdf-8845-6134b543479c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:31:49.881057 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.881034    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e803318-3900-4fdf-8845-6134b543479c-kube-api-access-pcnrk" (OuterVolumeSpecName: "kube-api-access-pcnrk") pod "1e803318-3900-4fdf-8845-6134b543479c" (UID: "1e803318-3900-4fdf-8845-6134b543479c"). InnerVolumeSpecName "kube-api-access-pcnrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:31:49.980070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.980033    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e803318-3900-4fdf-8845-6134b543479c-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:31:49.980070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.980064    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcnrk\" (UniqueName: \"kubernetes.io/projected/1e803318-3900-4fdf-8845-6134b543479c-kube-api-access-pcnrk\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:31:49.980070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:49.980077    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e803318-3900-4fdf-8845-6134b543479c-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:31:50.547204 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.547160    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e803318-3900-4fdf-8845-6134b543479c" containerID="a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028" exitCode=0
Jul 10 18:31:50.547671 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.547220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld" event={"ID":"1e803318-3900-4fdf-8845-6134b543479c","Type":"ContainerDied","Data":"a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028"}
Jul 10 18:31:50.547671 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.547265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld" event={"ID":"1e803318-3900-4fdf-8845-6134b543479c","Type":"ContainerDied","Data":"f94f9a3b818a230ba8d9756a6380cbcd43b0e7ab7b4efe2d5168f4d26b0c63cc"}
Jul 10 18:31:50.547671 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.547287    2565 scope.go:117] "RemoveContainer" containerID="a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028"
Jul 10 18:31:50.547671 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.547225    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"
Jul 10 18:31:50.557260 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.557042    2565 scope.go:117] "RemoveContainer" containerID="a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028"
Jul 10 18:31:50.557345 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:31:50.557330    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028\": container with ID starting with a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028 not found: ID does not exist" containerID="a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028"
Jul 10 18:31:50.557389 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.557355    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028"} err="failed to get container status \"a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028\": rpc error: code = NotFound desc = could not find container \"a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028\": container with ID starting with a247b1dbfa7b35c2d549783212edcd63534199f0f5f102997d54b1194ff7a028 not found: ID does not exist"
Jul 10 18:31:50.572234 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.572202    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"]
Jul 10 18:31:50.577040 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:50.577016    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d047b574-67845d7994-75bld"]
Jul 10 18:31:51.531193 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:51.531156    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e803318-3900-4fdf-8845-6134b543479c" path="/var/lib/kubelet/pods/1e803318-3900-4fdf-8845-6134b543479c/volumes"
Jul 10 18:31:55.242367 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:31:55.242330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:00.274987 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:32:00.274948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:37.333038 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:32:37.333003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:37.588605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:32:37.588523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:43.181855 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:32:43.181820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:08.303576 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:08.303487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:08.451946 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:08.451908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:08.649131 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:08.649087    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"]
Jul 10 18:33:08.649363 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:08.649316    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy" containerID="cri-o://b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf" gracePeriod=30
Jul 10 18:33:08.667770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:08.667745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:08.913790 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:08.913703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:10.032989 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:10.032947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:10.155086 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:10.155053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:11.023135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:11.023105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:11.189955 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:11.189920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:12.663787 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:12.663760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:13.912369 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.912301    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:33:13.974560 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.974527    2565 generic.go:356] "Generic (PLEG): container finished" podID="07744b42-fdea-4172-8103-a385c26609da" containerID="b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf" exitCode=0
Jul 10 18:33:13.974738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.974592    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"
Jul 10 18:33:13.974738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.974603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" event={"ID":"07744b42-fdea-4172-8103-a385c26609da","Type":"ContainerDied","Data":"b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf"}
Jul 10 18:33:13.974738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.974684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr" event={"ID":"07744b42-fdea-4172-8103-a385c26609da","Type":"ContainerDied","Data":"696dec83f2b2711c5037bf8b10c0859d5da766296c1905b549bd6250a7236921"}
Jul 10 18:33:13.974738 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.974711    2565 scope.go:117] "RemoveContainer" containerID="b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf"
Jul 10 18:33:13.983929 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.983911    2565 scope.go:117] "RemoveContainer" containerID="ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32"
Jul 10 18:33:13.988703 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988681    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07744b42-fdea-4172-8103-a385c26609da-istiod-ca-cert\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.988807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-credential-socket\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.988807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-envoy\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.988807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988792    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-socket\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.988958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988847    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-data\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.988958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07744b42-fdea-4172-8103-a385c26609da-istio-podinfo\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.988958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-istio-token\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.989105 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.988977    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-certs\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.989105 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dxt2\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-kube-api-access-8dxt2\") pod \"07744b42-fdea-4172-8103-a385c26609da\" (UID: \"07744b42-fdea-4172-8103-a385c26609da\") "
Jul 10 18:33:13.989105 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:33:13.989268 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989099    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07744b42-fdea-4172-8103-a385c26609da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:33:13.989268 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:33:13.989663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989418    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07744b42-fdea-4172-8103-a385c26609da-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:13.989663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989464    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:13.989663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989479    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:13.989663 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.989610    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:33:13.990031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.990006    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-data" (OuterVolumeSpecName: "istio-data") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:33:13.991415 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.991374    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:33:13.991578 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.991556    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07744b42-fdea-4172-8103-a385c26609da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:33:13.991665 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.991571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-kube-api-access-8dxt2" (OuterVolumeSpecName: "kube-api-access-8dxt2") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "kube-api-access-8dxt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:33:13.991782 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.991762    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-istio-token" (OuterVolumeSpecName: "istio-token") pod "07744b42-fdea-4172-8103-a385c26609da" (UID: "07744b42-fdea-4172-8103-a385c26609da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:33:13.993037 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.993016    2565 scope.go:117] "RemoveContainer" containerID="b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf"
Jul 10 18:33:13.993311 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:33:13.993289    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf\": container with ID starting with b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf not found: ID does not exist" containerID="b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf"
Jul 10 18:33:13.993387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.993321    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf"} err="failed to get container status \"b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf\": rpc error: code = NotFound desc = could not find container \"b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf\": container with ID starting with b7861d8673869258f8bf095406b1e7c04364db5bfd0fa5ab704069afd5f81dbf not found: ID does not exist"
Jul 10 18:33:13.993387 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.993344    2565 scope.go:117] "RemoveContainer" containerID="ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32"
Jul 10 18:33:13.993700 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:33:13.993621    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32\": container with ID starting with ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32 not found: ID does not exist" containerID="ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32"
Jul 10 18:33:13.993802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:13.993710    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32"} err="failed to get container status \"ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32\": rpc error: code = NotFound desc = could not find container \"ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32\": container with ID starting with ab4797a56057eb1d45623320b87abb560eda3621260399f88776433a9e402c32 not found: ID does not exist"
Jul 10 18:33:14.090386 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.090355    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:14.090386 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.090382    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:14.090386 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.090393    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07744b42-fdea-4172-8103-a385c26609da-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:14.090605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.090401    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:14.090605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.090423    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07744b42-fdea-4172-8103-a385c26609da-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:14.090605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.090431    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dxt2\" (UniqueName: \"kubernetes.io/projected/07744b42-fdea-4172-8103-a385c26609da-kube-api-access-8dxt2\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:33:14.311172 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.311130    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"]
Jul 10 18:33:14.313039 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:14.313017    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d047b574-openshift-default-696fc56fff-7gjqr"]
Jul 10 18:33:15.499263 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:15.499232    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:33:15.506685 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:15.506664    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:33:15.530755 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:15.530730    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07744b42-fdea-4172-8103-a385c26609da" path="/var/lib/kubelet/pods/07744b42-fdea-4172-8103-a385c26609da/volumes"
Jul 10 18:33:20.185439 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:20.185404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:20.281173 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:20.281135    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:20.905708 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:20.905676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:28.617038 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:28.616998    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:28.836754 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:28.836721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:29.035965 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:29.035926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:39.424081 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:39.424044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:39.764535 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:39.764453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:50.526477 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:33:50.526446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:00.719506 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:00.719470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:08.176869 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:08.171197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:08.260533 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:08.260498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:08.540024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:08.539919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:09.036122 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036087    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"]
Jul 10 18:34:09.036569 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036552    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy"
Jul 10 18:34:09.036569 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036569    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy"
Jul 10 18:34:09.036763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036584    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy"
Jul 10 18:34:09.036763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036591    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy"
Jul 10 18:34:09.036763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036599    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e803318-3900-4fdf-8845-6134b543479c" containerName="maas-api"
Jul 10 18:34:09.036763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036605    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e803318-3900-4fdf-8845-6134b543479c" containerName="maas-api"
Jul 10 18:34:09.036763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036717    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e803318-3900-4fdf-8845-6134b543479c" containerName="maas-api"
Jul 10 18:34:09.036763 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.036730    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy"
Jul 10 18:34:09.040184 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.040164    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.047385 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.047352    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7d2779-openshift-default-dockercfg-f5hj8\""
Jul 10 18:34:09.070247 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.070224    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"]
Jul 10 18:34:09.092343 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0894412-0108-410a-87d4-8580f2fd6880-istio-podinfo\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092462 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0894412-0108-410a-87d4-8580f2fd6880-istiod-ca-cert\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092462 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-data\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092462 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-socket\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092462 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-credential-socket\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092462 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-certs\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092633 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rg9j\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-kube-api-access-4rg9j\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092633 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-envoy\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.092633 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.092568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-istio-token\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.182396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.182356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:09.193718 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.193694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0894412-0108-410a-87d4-8580f2fd6880-istio-podinfo\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.193874 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.193729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0894412-0108-410a-87d4-8580f2fd6880-istiod-ca-cert\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.193874 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.193761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-data\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194011 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.193896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-socket\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194083 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-credential-socket\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-certs\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194196 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rg9j\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-kube-api-access-4rg9j\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194196 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-envoy\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-istio-token\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-data\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194307 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-socket\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194560 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0894412-0108-410a-87d4-8580f2fd6880-istiod-ca-cert\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194849 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-certs\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.194947 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.194836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-credential-socket\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.196747 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.196723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-envoy\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.196964 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.196947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0894412-0108-410a-87d4-8580f2fd6880-istio-podinfo\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.210237 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.210216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-istio-token\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.226831 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.226802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rg9j\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-kube-api-access-4rg9j\") pod \"e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") " pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.350581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.350481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:09.404227 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.404191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:09.521946 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:34:09.521918    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0894412_0108_410a_87d4_8580f2fd6880.slice/crio-293ca081e8d1f6481e8e21019fffb7ca067b14ce4b6c315eaac3c83415aaa64a WatchSource:0}: Error finding container 293ca081e8d1f6481e8e21019fffb7ca067b14ce4b6c315eaac3c83415aaa64a: Status 404 returned error can't find the container with id 293ca081e8d1f6481e8e21019fffb7ca067b14ce4b6c315eaac3c83415aaa64a
Jul 10 18:34:09.522568 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.522542    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"]
Jul 10 18:34:09.524511 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.524470    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:34:09.524664 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.524536    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:34:09.524664 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:09.524578    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:34:10.258245 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:10.258208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" event={"ID":"f0894412-0108-410a-87d4-8580f2fd6880","Type":"ContainerStarted","Data":"ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98"}
Jul 10 18:34:10.258737 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:10.258259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" event={"ID":"f0894412-0108-410a-87d4-8580f2fd6880","Type":"ContainerStarted","Data":"293ca081e8d1f6481e8e21019fffb7ca067b14ce4b6c315eaac3c83415aaa64a"}
Jul 10 18:34:10.351147 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:10.351114    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:10.355653 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:10.355616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:10.407522 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:10.407470    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" podStartSLOduration=2.407453383 podStartE2EDuration="2.407453383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:10.31319463 +0000 UTC m=+1855.471912455" watchObservedRunningTime="2026-07-10 18:34:10.407453383 +0000 UTC m=+1855.566171208"
Jul 10 18:34:11.263662 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:11.263623    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:11.264784 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:11.264758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:12.558457 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.558413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:12.733936 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.733819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:12.757988 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.757959    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"]
Jul 10 18:34:12.758483 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.758467    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="07744b42-fdea-4172-8103-a385c26609da" containerName="istio-proxy"
Jul 10 18:34:12.761946 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.761925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.766240 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.766222    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7d2779-serving-cert\""
Jul 10 18:34:12.800241 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.800215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"]
Jul 10 18:34:12.832675 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.832581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16a6ed1-8edd-4516-9844-e206572e058f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.832816 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.832713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tjhw\" (UniqueName: \"kubernetes.io/projected/b16a6ed1-8edd-4516-9844-e206572e058f-kube-api-access-9tjhw\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.832816 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.832802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.911124 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.911090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:12.933442 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.933412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.933586 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.933483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16a6ed1-8edd-4516-9844-e206572e058f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.933586 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:34:12.933566    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-serving-cert: secret "maas-api-e2e-inf-a-7d2779-serving-cert" not found
Jul 10 18:34:12.933586 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.933581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tjhw\" (UniqueName: \"kubernetes.io/projected/b16a6ed1-8edd-4516-9844-e206572e058f-kube-api-access-9tjhw\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.933763 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:34:12.933670    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls podName:b16a6ed1-8edd-4516-9844-e206572e058f nodeName:}" failed. No retries permitted until 2026-07-10 18:34:13.433619553 +0000 UTC m=+1858.592337372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls") pod "maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6" (UID: "b16a6ed1-8edd-4516-9844-e206572e058f") : secret "maas-api-e2e-inf-a-7d2779-serving-cert" not found
Jul 10 18:34:12.934202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.934184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16a6ed1-8edd-4516-9844-e206572e058f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:12.956692 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:12.956659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tjhw\" (UniqueName: \"kubernetes.io/projected/b16a6ed1-8edd-4516-9844-e206572e058f-kube-api-access-9tjhw\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:13.055667 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:13.055621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:13.439834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:13.439799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:13.442440 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:13.442403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:13.673257 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:13.673216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:13.840688 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:13.840661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"]
Jul 10 18:34:13.842743 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:34:13.842716    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16a6ed1_8edd_4516_9844_e206572e058f.slice/crio-b4bcadc86cb88974b10cb12f9d76f705454c70b2687c77e788d91a0f1153300b WatchSource:0}: Error finding container b4bcadc86cb88974b10cb12f9d76f705454c70b2687c77e788d91a0f1153300b: Status 404 returned error can't find the container with id b4bcadc86cb88974b10cb12f9d76f705454c70b2687c77e788d91a0f1153300b
Jul 10 18:34:13.844160 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:13.844141    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:34:13.948569 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:13.948534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:14.066101 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:14.066003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:14.279614 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:14.279573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6" event={"ID":"b16a6ed1-8edd-4516-9844-e206572e058f","Type":"ContainerStarted","Data":"b4bcadc86cb88974b10cb12f9d76f705454c70b2687c77e788d91a0f1153300b"}
Jul 10 18:34:15.286516 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:15.286484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6" event={"ID":"b16a6ed1-8edd-4516-9844-e206572e058f","Type":"ContainerStarted","Data":"9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874"}
Jul 10 18:34:15.287009 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:15.286545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:15.330046 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:15.329984    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6" podStartSLOduration=2.8507245599999997 podStartE2EDuration="3.329963223s" totalImagesPullingTime="479.238663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:15.329945141 +0000 UTC m=+1860.488662977" watchObservedRunningTime="2026-07-10 18:34:15.329963223 +0000 UTC m=+1860.488681060"
Jul 10 18:34:16.938958 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:16.938924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:17.301260 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:17.301181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:17.723351 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:17.723318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:17.842757 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:17.842724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:21.296655 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:21.296619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:34:24.145320 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.145229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:24.359273 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.359233    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"]
Jul 10 18:34:24.363051 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.363029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.397974 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.397910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"]
Jul 10 18:34:24.400328 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.400310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-0dfdd8-serving-cert\""
Jul 10 18:34:24.403325 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.403300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:24.464259 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.464223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.464433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.464288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqqjv\" (UniqueName: \"kubernetes.io/projected/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-kube-api-access-wqqjv\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.464433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.464321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.565286 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.565244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqqjv\" (UniqueName: \"kubernetes.io/projected/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-kube-api-access-wqqjv\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.565520 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.565296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.565520 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.565407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.565687 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:34:24.565523    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-serving-cert: secret "maas-api-e2e-inf-b-0dfdd8-serving-cert" not found
Jul 10 18:34:24.565687 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:34:24.565584    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls podName:549d20b7-b8f4-4200-8450-fb37ac7cb4d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:34:25.065565527 +0000 UTC m=+1870.224283330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls") pod "maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc" (UID: "549d20b7-b8f4-4200-8450-fb37ac7cb4d4") : secret "maas-api-e2e-inf-b-0dfdd8-serving-cert" not found
Jul 10 18:34:24.566131 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.566105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.592139 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.592105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqqjv\" (UniqueName: \"kubernetes.io/projected/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-kube-api-access-wqqjv\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:24.706544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.706460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:24.950086 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:24.950056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:25.071422 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:25.071330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:25.073967 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:25.073936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls\") pod \"maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:25.272975 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:25.272940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:25.545659 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:25.545252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"]
Jul 10 18:34:26.070485 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:26.070449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:26.363337 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:26.363297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc" event={"ID":"549d20b7-b8f4-4200-8450-fb37ac7cb4d4","Type":"ContainerStarted","Data":"43db0006a4b887ad6d4fca1fb1773a4a04da550514c14e021485dd0d8713e7ad"}
Jul 10 18:34:26.363337 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:26.363343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc" event={"ID":"549d20b7-b8f4-4200-8450-fb37ac7cb4d4","Type":"ContainerStarted","Data":"c4f9ca4e85e74336a3095e5234f467a1045bbc640e3eb596fffc3072f11bebae"}
Jul 10 18:34:26.363863 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:26.363433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:26.449073 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:26.449023    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc" podStartSLOduration=1.77791628 podStartE2EDuration="2.449005033s" totalImagesPullingTime="671.088753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:26.437394225 +0000 UTC m=+1871.596112050" watchObservedRunningTime="2026-07-10 18:34:26.449005033 +0000 UTC m=+1871.607722854"
Jul 10 18:34:26.642310 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:26.642263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:27.304807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:27.304758    2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 18:34:27.304991 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:27.304844    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 18:34:28.540880 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:28.540855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:29.380626 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:29.380586    2565 generic.go:356] "Generic (PLEG): container finished" podID="f0894412-0108-410a-87d4-8580f2fd6880" containerID="ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98" exitCode=0
Jul 10 18:34:29.380858 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:29.380673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" event={"ID":"f0894412-0108-410a-87d4-8580f2fd6880","Type":"ContainerDied","Data":"ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98"}
Jul 10 18:34:29.381192 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:29.381172    2565 scope.go:117] "RemoveContainer" containerID="ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98"
Jul 10 18:34:29.382299 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:29.382266    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:34:29.382393 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:29.382355    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:34:29.382454 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:29.382408    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:34:30.388165 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:30.388123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" event={"ID":"f0894412-0108-410a-87d4-8580f2fd6880","Type":"ContainerStarted","Data":"13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7"}
Jul 10 18:34:31.351695 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:31.351228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:31.351695 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:31.351673    2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 10 18:34:31.351969 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:31.351736    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 10 18:34:32.351798 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:32.351759    2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 10 18:34:32.352281 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:32.352023    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 10 18:34:32.376154 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:32.376128    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:34:33.351470 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:33.351428    2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 10 18:34:33.352222 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:33.351789    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 10 18:34:34.356793 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:34.356760    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:34.357278 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:34.357119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:34.357926 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:34.357905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:34:35.627306 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:35.627273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:35.886838 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:35.886807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:44.538026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:44.537987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:49.588882 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:49.588847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:49.798374 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:34:49.798345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:20.668517 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:20.668425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:48.187802 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:48.187763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:49.120055 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:49.120014    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:49.312075 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:49.312042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:49.765764 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:49.765688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:50.027001 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.026885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:50.152991 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.152957    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:50.335967 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.335888    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"]
Jul 10 18:35:50.336368 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.336101    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6" podUID="b16a6ed1-8edd-4516-9844-e206572e058f" containerName="maas-api" containerID="cri-o://9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874" gracePeriod=30
Jul 10 18:35:50.365913 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.365885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:50.596287 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.596232    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:35:50.719552 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.719525    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16a6ed1-8edd-4516-9844-e206572e058f-openshift-service-ca\") pod \"b16a6ed1-8edd-4516-9844-e206572e058f\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") "
Jul 10 18:35:50.719776 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.719578    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls\") pod \"b16a6ed1-8edd-4516-9844-e206572e058f\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") "
Jul 10 18:35:50.719776 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.719665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tjhw\" (UniqueName: \"kubernetes.io/projected/b16a6ed1-8edd-4516-9844-e206572e058f-kube-api-access-9tjhw\") pod \"b16a6ed1-8edd-4516-9844-e206572e058f\" (UID: \"b16a6ed1-8edd-4516-9844-e206572e058f\") "
Jul 10 18:35:50.719890 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.719873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b16a6ed1-8edd-4516-9844-e206572e058f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b16a6ed1-8edd-4516-9844-e206572e058f" (UID: "b16a6ed1-8edd-4516-9844-e206572e058f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:35:50.720001 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.719984    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16a6ed1-8edd-4516-9844-e206572e058f-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:35:50.721745 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.721720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b16a6ed1-8edd-4516-9844-e206572e058f" (UID: "b16a6ed1-8edd-4516-9844-e206572e058f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:35:50.721855 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.721798    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16a6ed1-8edd-4516-9844-e206572e058f-kube-api-access-9tjhw" (OuterVolumeSpecName: "kube-api-access-9tjhw") pod "b16a6ed1-8edd-4516-9844-e206572e058f" (UID: "b16a6ed1-8edd-4516-9844-e206572e058f"). InnerVolumeSpecName "kube-api-access-9tjhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:35:50.821413 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.821390    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b16a6ed1-8edd-4516-9844-e206572e058f-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:35:50.821560 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.821416    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tjhw\" (UniqueName: \"kubernetes.io/projected/b16a6ed1-8edd-4516-9844-e206572e058f-kube-api-access-9tjhw\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:35:50.829631 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.829602    2565 generic.go:356] "Generic (PLEG): container finished" podID="b16a6ed1-8edd-4516-9844-e206572e058f" containerID="9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874" exitCode=0
Jul 10 18:35:50.829764 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.829656    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"
Jul 10 18:35:50.829764 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.829687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6" event={"ID":"b16a6ed1-8edd-4516-9844-e206572e058f","Type":"ContainerDied","Data":"9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874"}
Jul 10 18:35:50.829764 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.829743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6" event={"ID":"b16a6ed1-8edd-4516-9844-e206572e058f","Type":"ContainerDied","Data":"b4bcadc86cb88974b10cb12f9d76f705454c70b2687c77e788d91a0f1153300b"}
Jul 10 18:35:50.829933 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.829782    2565 scope.go:117] "RemoveContainer" containerID="9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874"
Jul 10 18:35:50.839239 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.839223    2565 scope.go:117] "RemoveContainer" containerID="9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874"
Jul 10 18:35:50.839491 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:35:50.839474    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874\": container with ID starting with 9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874 not found: ID does not exist" containerID="9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874"
Jul 10 18:35:50.839540 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.839499    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874"} err="failed to get container status \"9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874\": rpc error: code = NotFound desc = could not find container \"9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874\": container with ID starting with 9f9bfaf38f26d5a01d59981e8883b6c1b212390838ad69cbace327cf09036874 not found: ID does not exist"
Jul 10 18:35:50.854605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.854538    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"]
Jul 10 18:35:50.858954 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:50.858932    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d2779-64f5f7f745-xwmt6"]
Jul 10 18:35:51.531355 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:51.531325    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16a6ed1-8edd-4516-9844-e206572e058f" path="/var/lib/kubelet/pods/b16a6ed1-8edd-4516-9844-e206572e058f/volumes"
Jul 10 18:35:54.835956 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:35:54.835919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:06.866749 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:06.866661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:06.977963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:06.977930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:32.214392 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:32.214353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:32.474833 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:32.474757    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"]
Jul 10 18:36:32.475017 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:32.474974    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy" containerID="cri-o://13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7" gracePeriod=30
Jul 10 18:36:33.860503 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:33.860462    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"]
Jul 10 18:36:33.861003 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:33.860753    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc" podUID="549d20b7-b8f4-4200-8450-fb37ac7cb4d4" containerName="maas-api" containerID="cri-o://43db0006a4b887ad6d4fca1fb1773a4a04da550514c14e021485dd0d8713e7ad" gracePeriod=30
Jul 10 18:36:33.986957 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:33.986920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:34.059603 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.059564    2565 generic.go:356] "Generic (PLEG): container finished" podID="549d20b7-b8f4-4200-8450-fb37ac7cb4d4" containerID="43db0006a4b887ad6d4fca1fb1773a4a04da550514c14e021485dd0d8713e7ad" exitCode=0
Jul 10 18:36:34.059778 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.059620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc" event={"ID":"549d20b7-b8f4-4200-8450-fb37ac7cb4d4","Type":"ContainerDied","Data":"43db0006a4b887ad6d4fca1fb1773a4a04da550514c14e021485dd0d8713e7ad"}
Jul 10 18:36:34.115789 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.115732    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:36:34.135622 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.135592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-openshift-service-ca\") pod \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") "
Jul 10 18:36:34.135776 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.135722    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqqjv\" (UniqueName: \"kubernetes.io/projected/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-kube-api-access-wqqjv\") pod \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") "
Jul 10 18:36:34.135776 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.135755    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls\") pod \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\" (UID: \"549d20b7-b8f4-4200-8450-fb37ac7cb4d4\") "
Jul 10 18:36:34.136032 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.135988    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "549d20b7-b8f4-4200-8450-fb37ac7cb4d4" (UID: "549d20b7-b8f4-4200-8450-fb37ac7cb4d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:36:34.136138 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.136109    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:34.137873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.137850    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "549d20b7-b8f4-4200-8450-fb37ac7cb4d4" (UID: "549d20b7-b8f4-4200-8450-fb37ac7cb4d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:36:34.138076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.138058    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-kube-api-access-wqqjv" (OuterVolumeSpecName: "kube-api-access-wqqjv") pod "549d20b7-b8f4-4200-8450-fb37ac7cb4d4" (UID: "549d20b7-b8f4-4200-8450-fb37ac7cb4d4"). InnerVolumeSpecName "kube-api-access-wqqjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:36:34.237145 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.237111    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqqjv\" (UniqueName: \"kubernetes.io/projected/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-kube-api-access-wqqjv\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:34.237145 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.237137    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/549d20b7-b8f4-4200-8450-fb37ac7cb4d4-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:34.360235 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.360199    2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 18:36:34.360384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:34.360265    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 18:36:35.066398 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:35.066369    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"
Jul 10 18:36:35.066862 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:35.066364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc" event={"ID":"549d20b7-b8f4-4200-8450-fb37ac7cb4d4","Type":"ContainerDied","Data":"c4f9ca4e85e74336a3095e5234f467a1045bbc640e3eb596fffc3072f11bebae"}
Jul 10 18:36:35.066862 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:35.066515    2565 scope.go:117] "RemoveContainer" containerID="43db0006a4b887ad6d4fca1fb1773a4a04da550514c14e021485dd0d8713e7ad"
Jul 10 18:36:35.100310 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:35.100286    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"]
Jul 10 18:36:35.108764 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:35.108739    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0dfdd8-94d874498-z54vc"]
Jul 10 18:36:35.531266 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:35.531229    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="549d20b7-b8f4-4200-8450-fb37ac7cb4d4" path="/var/lib/kubelet/pods/549d20b7-b8f4-4200-8450-fb37ac7cb4d4/volumes"
Jul 10 18:36:37.726502 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.726473    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:36:37.771070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.770995    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0894412-0108-410a-87d4-8580f2fd6880-istio-podinfo\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771037    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-certs\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-credential-socket\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771189    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rg9j\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-kube-api-access-4rg9j\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771239    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-socket\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-envoy\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771333 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771311    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-istio-token\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771341    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0894412-0108-410a-87d4-8580f2fd6880-istiod-ca-cert\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:36:37.771544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771351    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:36:37.771544 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771368    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-data\") pod \"f0894412-0108-410a-87d4-8580f2fd6880\" (UID: \"f0894412-0108-410a-87d4-8580f2fd6880\") "
Jul 10 18:36:37.771771 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771540    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:36:37.771832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771793    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.771832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771816    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.771832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771822    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0894412-0108-410a-87d4-8580f2fd6880-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:36:37.772001 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.771832    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.772570 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.772542    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-data" (OuterVolumeSpecName: "istio-data") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:36:37.773656 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.773610    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0894412-0108-410a-87d4-8580f2fd6880-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:36:37.773656 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.773623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-kube-api-access-4rg9j" (OuterVolumeSpecName: "kube-api-access-4rg9j") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "kube-api-access-4rg9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:36:37.773865 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.773744    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:36:37.773931 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.773876    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0894412-0108-410a-87d4-8580f2fd6880" (UID: "f0894412-0108-410a-87d4-8580f2fd6880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:36:37.872734 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.872693    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0894412-0108-410a-87d4-8580f2fd6880-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.872734 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.872729    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rg9j\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-kube-api-access-4rg9j\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.872734 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.872742    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.872734 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.872750    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0894412-0108-410a-87d4-8580f2fd6880-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.873000 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.872757    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0894412-0108-410a-87d4-8580f2fd6880-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:37.873000 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:37.872765    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0894412-0108-410a-87d4-8580f2fd6880-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:36:38.084047 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.083965    2565 generic.go:356] "Generic (PLEG): container finished" podID="f0894412-0108-410a-87d4-8580f2fd6880" containerID="13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7" exitCode=0
Jul 10 18:36:38.084047 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.084011    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"
Jul 10 18:36:38.084047 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.084028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" event={"ID":"f0894412-0108-410a-87d4-8580f2fd6880","Type":"ContainerDied","Data":"13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7"}
Jul 10 18:36:38.084272 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.084084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k" event={"ID":"f0894412-0108-410a-87d4-8580f2fd6880","Type":"ContainerDied","Data":"293ca081e8d1f6481e8e21019fffb7ca067b14ce4b6c315eaac3c83415aaa64a"}
Jul 10 18:36:38.084272 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.084114    2565 scope.go:117] "RemoveContainer" containerID="13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7"
Jul 10 18:36:38.094209 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.094193    2565 scope.go:117] "RemoveContainer" containerID="ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98"
Jul 10 18:36:38.104204 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.104180    2565 scope.go:117] "RemoveContainer" containerID="13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7"
Jul 10 18:36:38.104564 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:36:38.104543    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7\": container with ID starting with 13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7 not found: ID does not exist" containerID="13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7"
Jul 10 18:36:38.104633 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.104587    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7"} err="failed to get container status \"13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7\": rpc error: code = NotFound desc = could not find container \"13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7\": container with ID starting with 13dd35f7a7bb7cbb7bcdc5112a01f6fa2c453c38fb9257876157d90930197cd7 not found: ID does not exist"
Jul 10 18:36:38.104633 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.104613    2565 scope.go:117] "RemoveContainer" containerID="ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98"
Jul 10 18:36:38.104895 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:36:38.104875    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98\": container with ID starting with ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98 not found: ID does not exist" containerID="ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98"
Jul 10 18:36:38.104936 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.104901    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98"} err="failed to get container status \"ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98\": rpc error: code = NotFound desc = could not find container \"ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98\": container with ID starting with ef311fa49ad72fe4b687418cebc6cb60f4b964cc01d2f903f0b62c4d669d2b98 not found: ID does not exist"
Jul 10 18:36:38.110628 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.110606    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"]
Jul 10 18:36:38.118403 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:38.118377    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7d2779-openshift-default-56c47d5677-tmk6k"]
Jul 10 18:36:39.314829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:39.314794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:39.446157 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:39.446125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:39.530477 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:39.530437    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0894412-0108-410a-87d4-8580f2fd6880" path="/var/lib/kubelet/pods/f0894412-0108-410a-87d4-8580f2fd6880/volumes"
Jul 10 18:36:39.611194 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:39.611112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:39.810462 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:39.810410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:40.156780 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.156745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:40.471793 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.471720    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"]
Jul 10 18:36:40.472170 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472154    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16a6ed1-8edd-4516-9844-e206572e058f" containerName="maas-api"
Jul 10 18:36:40.472213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472172    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16a6ed1-8edd-4516-9844-e206572e058f" containerName="maas-api"
Jul 10 18:36:40.472213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472190    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549d20b7-b8f4-4200-8450-fb37ac7cb4d4" containerName="maas-api"
Jul 10 18:36:40.472213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472197    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="549d20b7-b8f4-4200-8450-fb37ac7cb4d4" containerName="maas-api"
Jul 10 18:36:40.472213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472210    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy"
Jul 10 18:36:40.472384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472216    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy"
Jul 10 18:36:40.472384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472225    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy"
Jul 10 18:36:40.472384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472234    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy"
Jul 10 18:36:40.472384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472306    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16a6ed1-8edd-4516-9844-e206572e058f" containerName="maas-api"
Jul 10 18:36:40.472384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472321    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="549d20b7-b8f4-4200-8450-fb37ac7cb4d4" containerName="maas-api"
Jul 10 18:36:40.472384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472329    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy"
Jul 10 18:36:40.472384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.472336    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0894412-0108-410a-87d4-8580f2fd6880" containerName="istio-proxy"
Jul 10 18:36:40.476867 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.476850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.480543 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.480523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1c4333-openshift-default-dockercfg-87dk6\""
Jul 10 18:36:40.496433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.496411    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"]
Jul 10 18:36:40.498062 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-credential-socket\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498160 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-envoy\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498160 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-podinfo\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-token\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-data\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istiod-ca-cert\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-socket\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498485 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-certs\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.498485 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.498352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bkg9\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-kube-api-access-7bkg9\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.504567 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.504547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:40.599450 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.599414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-credential-socket\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.599618 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.599497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-envoy\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.599722 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.599671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-podinfo\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600002 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.599970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-token\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600144 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-data\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600144 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istiod-ca-cert\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600144 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-credential-socket\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600144 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-socket\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600144 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-certs\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600414 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bkg9\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-kube-api-access-7bkg9\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600414 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-data\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600709 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-certs\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.600933 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-socket\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.601076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.600725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istiod-ca-cert\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.602300 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.602278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-envoy\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.602413 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.602396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-podinfo\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.611402 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.611378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-token\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.611801 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.611777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bkg9\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-kube-api-access-7bkg9\") pod \"e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") " pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.651930 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.651901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:40.787283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.787199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:40.934460 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.934435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"]
Jul 10 18:36:40.936034 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:36:40.936008    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9bee06_cdd9_41ee_bf26_73a5ea3fa1e9.slice/crio-bc78ac86d06eeeafe4a7f7bfecf34dc4f1a8c8da6a543dae6120c45547b9aaea WatchSource:0}: Error finding container bc78ac86d06eeeafe4a7f7bfecf34dc4f1a8c8da6a543dae6120c45547b9aaea: Status 404 returned error can't find the container with id bc78ac86d06eeeafe4a7f7bfecf34dc4f1a8c8da6a543dae6120c45547b9aaea
Jul 10 18:36:40.938304 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.938265    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:36:40.938380 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.938341    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:36:40.938380 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:40.938371    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:36:41.101382 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:41.101282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" event={"ID":"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9","Type":"ContainerStarted","Data":"dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5"}
Jul 10 18:36:41.101382 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:41.101356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" event={"ID":"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9","Type":"ContainerStarted","Data":"bc78ac86d06eeeafe4a7f7bfecf34dc4f1a8c8da6a543dae6120c45547b9aaea"}
Jul 10 18:36:41.126996 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:41.126950    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" podStartSLOduration=1.1269344669999999 podStartE2EDuration="1.126934467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:41.124115646 +0000 UTC m=+2006.282833473" watchObservedRunningTime="2026-07-10 18:36:41.126934467 +0000 UTC m=+2006.285652291"
Jul 10 18:36:41.788328 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:41.788290    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:41.793297 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:41.793274    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:42.107610 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:42.107519    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:42.108507 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:42.108488    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:36:43.101691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.101654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:43.169187 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.169149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"]
Jul 10 18:36:43.173320 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.173297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.176006 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.175982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1c4333-serving-cert\""
Jul 10 18:36:43.191343 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.191320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"]
Jul 10 18:36:43.213143 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.213120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:43.228461 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.228433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.228609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.228584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jh7n\" (UniqueName: \"kubernetes.io/projected/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-kube-api-access-8jh7n\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.228751 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.228729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-maas-api-tls\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.329424 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.329386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-maas-api-tls\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.329598 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.329448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.329598 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.329529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jh7n\" (UniqueName: \"kubernetes.io/projected/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-kube-api-access-8jh7n\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.330341 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.330316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.331881 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.331860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-maas-api-tls\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.349846 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.349821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jh7n\" (UniqueName: \"kubernetes.io/projected/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-kube-api-access-8jh7n\") pod \"maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.355186 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.355130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:43.484158 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.484124    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:43.628053 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.628019    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"]
Jul 10 18:36:43.628901 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:36:43.628871    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cfec38_3eb7_458f_b7e6_38b7c11c43b0.slice/crio-7acf80aa981be28b100681691ac5bd9946ca40c9535069f5ff1960e780ee392d WatchSource:0}: Error finding container 7acf80aa981be28b100681691ac5bd9946ca40c9535069f5ff1960e780ee392d: Status 404 returned error can't find the container with id 7acf80aa981be28b100681691ac5bd9946ca40c9535069f5ff1960e780ee392d
Jul 10 18:36:43.939223 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:43.939190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:44.037931 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:44.037898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:44.118396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:44.118363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d" event={"ID":"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0","Type":"ContainerStarted","Data":"683c74192f991b2f52305d73ec4df3d9188f5ef8bac3b665642542d4de6f815b"}
Jul 10 18:36:44.118781 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:44.118429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d" event={"ID":"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0","Type":"ContainerStarted","Data":"7acf80aa981be28b100681691ac5bd9946ca40c9535069f5ff1960e780ee392d"}
Jul 10 18:36:44.118781 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:44.118469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:44.149032 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:44.148967    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d" podStartSLOduration=0.731793238 podStartE2EDuration="1.148944606s" totalImagesPullingTime="417.151368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:44.146244432 +0000 UTC m=+2009.304962257" watchObservedRunningTime="2026-07-10 18:36:44.148944606 +0000 UTC m=+2009.307662432"
Jul 10 18:36:47.543035 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:47.543001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:48.010605 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:48.010564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:48.341366 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:48.341289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:48.905433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:48.905387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:50.129512 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:50.129479    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:36:51.548294 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.548262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:51.610919 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.610889    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"]
Jul 10 18:36:51.613540 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.613521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.617390 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.617358    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-171b27-serving-cert\""
Jul 10 18:36:51.628229 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.628201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"]
Jul 10 18:36:51.648657 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.648617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:51.715611 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.715581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-openshift-service-ca\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.715792 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.715671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.715792 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.715720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdl62\" (UniqueName: \"kubernetes.io/projected/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-kube-api-access-sdl62\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.727367 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.727332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:51.816414 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.816320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-openshift-service-ca\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.816576 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.816509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.816576 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.816552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdl62\" (UniqueName: \"kubernetes.io/projected/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-kube-api-access-sdl62\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.816739 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:36:51.816682    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-serving-cert: secret "maas-api-e2e-api-b-171b27-serving-cert" not found
Jul 10 18:36:51.816794 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:36:51.816768    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls podName:5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb nodeName:}" failed. No retries permitted until 2026-07-10 18:36:52.316746069 +0000 UTC m=+2017.475463884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls") pod "maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" (UID: "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb") : secret "maas-api-e2e-api-b-171b27-serving-cert" not found
Jul 10 18:36:51.817044 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.817023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-openshift-service-ca\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:51.826336 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:51.826310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdl62\" (UniqueName: \"kubernetes.io/projected/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-kube-api-access-sdl62\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:52.320860 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:52.320819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:52.321041 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:36:52.320983    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-serving-cert: secret "maas-api-e2e-api-b-171b27-serving-cert" not found
Jul 10 18:36:52.321106 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:36:52.321076    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls podName:5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb nodeName:}" failed. No retries permitted until 2026-07-10 18:36:53.32105227 +0000 UTC m=+2018.479770079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls") pod "maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" (UID: "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb") : secret "maas-api-e2e-api-b-171b27-serving-cert" not found
Jul 10 18:36:52.330908 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:52.330879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:52.430563 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:52.430527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:52.531342 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:52.531294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:36:53.333240 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:53.333202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:53.335828 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:53.335805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls\") pod \"maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:53.425736 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:53.425690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:53.614566 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:53.614543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"]
Jul 10 18:36:53.616929 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:36:53.616894    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7c9012_74fa_4a1c_bdc7_3247f1ce52eb.slice/crio-0485d3f79c21d7a565845c2c038b461d434ed1a00294a8dcca2e410dade80bab WatchSource:0}: Error finding container 0485d3f79c21d7a565845c2c038b461d434ed1a00294a8dcca2e410dade80bab: Status 404 returned error can't find the container with id 0485d3f79c21d7a565845c2c038b461d434ed1a00294a8dcca2e410dade80bab
Jul 10 18:36:54.187550 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:54.187514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" event={"ID":"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb","Type":"ContainerStarted","Data":"c18443a64d43f36c67e68ab7417c28752dc43d3c4f8e711ea534bad490650a67"}
Jul 10 18:36:54.187742 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:54.187592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" event={"ID":"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb","Type":"ContainerStarted","Data":"0485d3f79c21d7a565845c2c038b461d434ed1a00294a8dcca2e410dade80bab"}
Jul 10 18:36:54.187742 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:54.187628    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:36:56.004299 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:36:56.004262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:00.199096 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:00.199058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:37:00.229156 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:00.229096    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" podStartSLOduration=8.808291062 podStartE2EDuration="9.229076258s" totalImagesPullingTime="420.785196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:54.215098094 +0000 UTC m=+2019.373815930" watchObservedRunningTime="2026-07-10 18:37:00.229076258 +0000 UTC m=+2025.387794084"
Jul 10 18:37:01.226199 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:01.226165    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerID="dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5" exitCode=0
Jul 10 18:37:01.226745 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:01.226241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" event={"ID":"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9","Type":"ContainerDied","Data":"dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5"}
Jul 10 18:37:01.226745 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:01.226689    2565 scope.go:117] "RemoveContainer" containerID="dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5"
Jul 10 18:37:01.227873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:01.227845    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:01.227960 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:01.227916    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:01.227960 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:01.227950    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:02.237534 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:02.237483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" event={"ID":"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9","Type":"ContainerStarted","Data":"537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01"}
Jul 10 18:37:02.787550 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:02.787508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:37:02.787765 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:02.787710    2565 patch_prober.go:28] interesting pod/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 10 18:37:02.787851 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:02.787768    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 10 18:37:03.788429 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:03.788394    2565 patch_prober.go:28] interesting pod/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 10 18:37:03.788881 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:03.788449    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 10 18:37:04.045716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:04.045554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:04.384325 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:04.384288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:04.632796 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:04.632762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:04.787632 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:04.787543    2565 patch_prober.go:28] interesting pod/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 10 18:37:04.787632 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:04.787599    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 10 18:37:04.798029 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:04.797999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:05.136177 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.136138    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"]
Jul 10 18:37:05.136396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.136364    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d" podUID="d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" containerName="maas-api" containerID="cri-o://683c74192f991b2f52305d73ec4df3d9188f5ef8bac3b665642542d4de6f815b" gracePeriod=30
Jul 10 18:37:05.153145 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.152836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:05.261621 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.261584    2565 generic.go:356] "Generic (PLEG): container finished" podID="d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" containerID="683c74192f991b2f52305d73ec4df3d9188f5ef8bac3b665642542d4de6f815b" exitCode=0
Jul 10 18:37:05.261765 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.261671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d" event={"ID":"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0","Type":"ContainerDied","Data":"683c74192f991b2f52305d73ec4df3d9188f5ef8bac3b665642542d4de6f815b"}
Jul 10 18:37:05.414355 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.414332    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:37:05.488868 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.488838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-openshift-service-ca\") pod \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") "
Jul 10 18:37:05.489025 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.488963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-maas-api-tls\") pod \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") "
Jul 10 18:37:05.489025 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.488996    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jh7n\" (UniqueName: \"kubernetes.io/projected/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-kube-api-access-8jh7n\") pod \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\" (UID: \"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0\") "
Jul 10 18:37:05.489274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.489242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" (UID: "d6cfec38-3eb7-458f-b7e6-38b7c11c43b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:37:05.491339 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.491314    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" (UID: "d6cfec38-3eb7-458f-b7e6-38b7c11c43b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:37:05.491558 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.491537    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-kube-api-access-8jh7n" (OuterVolumeSpecName: "kube-api-access-8jh7n") pod "d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" (UID: "d6cfec38-3eb7-458f-b7e6-38b7c11c43b0"). InnerVolumeSpecName "kube-api-access-8jh7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:37:05.590460 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.590431    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:05.590460 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.590459    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jh7n\" (UniqueName: \"kubernetes.io/projected/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-kube-api-access-8jh7n\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:05.590630 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.590470    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:05.787851 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.787766    2565 patch_prober.go:28] interesting pod/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 10 18:37:05.787851 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:05.787821    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 10 18:37:06.268579 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.268549    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"
Jul 10 18:37:06.269035 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.268585    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d" event={"ID":"d6cfec38-3eb7-458f-b7e6-38b7c11c43b0","Type":"ContainerDied","Data":"7acf80aa981be28b100681691ac5bd9946ca40c9535069f5ff1960e780ee392d"}
Jul 10 18:37:06.269035 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.268669    2565 scope.go:117] "RemoveContainer" containerID="683c74192f991b2f52305d73ec4df3d9188f5ef8bac3b665642542d4de6f815b"
Jul 10 18:37:06.294146 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.294122    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"]
Jul 10 18:37:06.308271 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.308248    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4333-5b9dfb9787-jhr2d"]
Jul 10 18:37:06.791745 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.791711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:37:06.791999 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.791977    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:37:06.792614 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:06.792593    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:37:07.530937 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:07.530904    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" path="/var/lib/kubelet/pods/d6cfec38-3eb7-458f-b7e6-38b7c11c43b0/volumes"
Jul 10 18:37:10.618241 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:10.618214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:10.718171 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:10.718134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:10.862929 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:10.862897    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"]
Jul 10 18:37:10.863103 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:10.863075    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy" containerID="cri-o://537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01" gracePeriod=30
Jul 10 18:37:10.880084 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:10.880015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:11.079894 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:11.079835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:11.280716 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:11.280681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:11.648691 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:11.648656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:11.788832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:11.788798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:11.891577 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:11.891536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:12.066725 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.066647    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"]
Jul 10 18:37:12.066897 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.066863    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" podUID="5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" containerName="maas-api" containerID="cri-o://c18443a64d43f36c67e68ab7417c28752dc43d3c4f8e711ea534bad490650a67" gracePeriod=30
Jul 10 18:37:12.128441 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.128407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:12.300231 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.300204    2565 generic.go:356] "Generic (PLEG): container finished" podID="5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" containerID="c18443a64d43f36c67e68ab7417c28752dc43d3c4f8e711ea534bad490650a67" exitCode=0
Jul 10 18:37:12.300399 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.300283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" event={"ID":"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb","Type":"ContainerDied","Data":"c18443a64d43f36c67e68ab7417c28752dc43d3c4f8e711ea534bad490650a67"}
Jul 10 18:37:12.319143 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.319091    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:37:12.459254 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.459221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdl62\" (UniqueName: \"kubernetes.io/projected/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-kube-api-access-sdl62\") pod \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") "
Jul 10 18:37:12.459433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.459269    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-openshift-service-ca\") pod \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") "
Jul 10 18:37:12.459433 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.459324    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls\") pod \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\" (UID: \"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb\") "
Jul 10 18:37:12.459697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.459621    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" (UID: "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:37:12.461442 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.461410    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-kube-api-access-sdl62" (OuterVolumeSpecName: "kube-api-access-sdl62") pod "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" (UID: "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb"). InnerVolumeSpecName "kube-api-access-sdl62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:37:12.461442 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.461417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" (UID: "5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:37:12.560425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.560391    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:12.560425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.560421    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdl62\" (UniqueName: \"kubernetes.io/projected/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-kube-api-access-sdl62\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:12.560425 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:12.560431    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:13.306367 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:13.306336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"
Jul 10 18:37:13.306851 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:13.306362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9" event={"ID":"5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb","Type":"ContainerDied","Data":"0485d3f79c21d7a565845c2c038b461d434ed1a00294a8dcca2e410dade80bab"}
Jul 10 18:37:13.306851 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:13.306454    2565 scope.go:117] "RemoveContainer" containerID="c18443a64d43f36c67e68ab7417c28752dc43d3c4f8e711ea534bad490650a67"
Jul 10 18:37:13.329077 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:13.329051    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"]
Jul 10 18:37:13.336036 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:13.336006    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-171b27-5786f6bfd7-w48j9"]
Jul 10 18:37:13.529717 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:13.529684    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" path="/var/lib/kubelet/pods/5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb/volumes"
Jul 10 18:37:16.120076 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.120055    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:37:16.194276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-socket\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194280    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-data\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-envoy\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istiod-ca-cert\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bkg9\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-kube-api-access-7bkg9\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-podinfo\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-certs\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194508 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-credential-socket\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-token\") pod \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\" (UID: \"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9\") "
Jul 10 18:37:16.194834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194556    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:37:16.194834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194762    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:37:16.194834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194812    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:37:16.195055 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.194838    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:37:16.195055 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.195005    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.195055 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.195023    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.195055 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.195037    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.195055 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.195050    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.195536 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.195509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:37:16.196714 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.196659    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:37:16.196808 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.196716    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-kube-api-access-7bkg9" (OuterVolumeSpecName: "kube-api-access-7bkg9") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "kube-api-access-7bkg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:37:16.196808 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.196758    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:37:16.196808 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.196777    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" (UID: "9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:37:16.296282 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.296212    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.296282 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.296236    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.296282 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.296245    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.296282 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.296254    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bkg9\" (UniqueName: \"kubernetes.io/projected/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-kube-api-access-7bkg9\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.296282 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.296264    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:37:16.326622 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.326589    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerID="537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01" exitCode=0
Jul 10 18:37:16.326785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.326672    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"
Jul 10 18:37:16.326785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.326671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" event={"ID":"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9","Type":"ContainerDied","Data":"537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01"}
Jul 10 18:37:16.326909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.326787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl" event={"ID":"9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9","Type":"ContainerDied","Data":"bc78ac86d06eeeafe4a7f7bfecf34dc4f1a8c8da6a543dae6120c45547b9aaea"}
Jul 10 18:37:16.326909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.326808    2565 scope.go:117] "RemoveContainer" containerID="537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01"
Jul 10 18:37:16.336804 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.336779    2565 scope.go:117] "RemoveContainer" containerID="dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5"
Jul 10 18:37:16.345155 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.345137    2565 scope.go:117] "RemoveContainer" containerID="537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01"
Jul 10 18:37:16.345449 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:37:16.345423    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01\": container with ID starting with 537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01 not found: ID does not exist" containerID="537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01"
Jul 10 18:37:16.345530 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.345458    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01"} err="failed to get container status \"537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01\": rpc error: code = NotFound desc = could not find container \"537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01\": container with ID starting with 537579f074a133433055141057c084c1708b12c7702c723d1471ea835a74ed01 not found: ID does not exist"
Jul 10 18:37:16.345530 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.345477    2565 scope.go:117] "RemoveContainer" containerID="dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5"
Jul 10 18:37:16.345811 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:37:16.345789    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5\": container with ID starting with dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5 not found: ID does not exist" containerID="dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5"
Jul 10 18:37:16.345870 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.345817    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5"} err="failed to get container status \"dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5\": rpc error: code = NotFound desc = could not find container \"dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5\": container with ID starting with dd19ff009b0ecbeecd1b50a11073d674748f8c162c303b5de20df11b0959d6e5 not found: ID does not exist"
Jul 10 18:37:16.352359 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.352296    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"]
Jul 10 18:37:16.354988 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:16.354963    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1c4333-openshift-default-77ffd9dc45-6nzfl"]
Jul 10 18:37:17.530819 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:17.530782    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" path="/var/lib/kubelet/pods/9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9/volumes"
Jul 10 18:37:17.645854 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:17.645816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:17.770486 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:17.770452    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:17.929384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:17.929350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:18.152202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.152167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:18.533987 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.533951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:18.780210 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780180    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"]
Jul 10 18:37:18.780602 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780590    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy"
Jul 10 18:37:18.780666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780604    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy"
Jul 10 18:37:18.780666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780621    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy"
Jul 10 18:37:18.780666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780627    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy"
Jul 10 18:37:18.780666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780652    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" containerName="maas-api"
Jul 10 18:37:18.780666 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780659    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" containerName="maas-api"
Jul 10 18:37:18.780827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780670    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" containerName="maas-api"
Jul 10 18:37:18.780827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780675    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" containerName="maas-api"
Jul 10 18:37:18.780827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780739    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6cfec38-3eb7-458f-b7e6-38b7c11c43b0" containerName="maas-api"
Jul 10 18:37:18.780827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780750    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy"
Jul 10 18:37:18.780827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780756    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7c9012-74fa-4a1c-bdc7-3247f1ce52eb" containerName="maas-api"
Jul 10 18:37:18.780827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.780762    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9bee06-cdd9-41ee-bf26-73a5ea3fa1e9" containerName="istio-proxy"
Jul 10 18:37:18.783335 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.783318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.786659 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.786595    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-319db5-openshift-default-dockercfg-z46dx\""
Jul 10 18:37:18.798378 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.798359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"]
Jul 10 18:37:18.807913 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.807892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:18.898077 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.898039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:18.927668 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.927621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-token\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.927824 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.927672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-certs\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.927824 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.927704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-credential-socket\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.927951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.927818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-podinfo\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.927951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.927853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdvx6\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-kube-api-access-hdvx6\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.927951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.927904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d966bae1-b5df-45ab-9e16-74d5051bee50-istiod-ca-cert\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.927951 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.927937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-envoy\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.928111 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.928036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-data\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:18.928111 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:18.928098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-socket\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029081 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d966bae1-b5df-45ab-9e16-74d5051bee50-istiod-ca-cert\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029081 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-envoy\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-data\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-socket\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-token\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-certs\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029505 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-credential-socket\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029505 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-podinfo\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029505 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdvx6\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-kube-api-access-hdvx6\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029674 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-data\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029674 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-certs\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029786 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-socket\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.029942 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d966bae1-b5df-45ab-9e16-74d5051bee50-istiod-ca-cert\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.030026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.029916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-credential-socket\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.031589 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.031564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-envoy\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.032026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.032009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-podinfo\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.037999 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.037945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-token\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.038192 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.038171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdvx6\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-kube-api-access-hdvx6\") pod \"e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") " pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.093000 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.092973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:19.240898 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.240873    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"]
Jul 10 18:37:19.243220 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:37:19.243192    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd966bae1_b5df_45ab_9e16_74d5051bee50.slice/crio-ba6e571b0ee05c30ebb6e818851bc4f7996a7c9f151ad0ba8ff0ccd04fdab38c WatchSource:0}: Error finding container ba6e571b0ee05c30ebb6e818851bc4f7996a7c9f151ad0ba8ff0ccd04fdab38c: Status 404 returned error can't find the container with id ba6e571b0ee05c30ebb6e818851bc4f7996a7c9f151ad0ba8ff0ccd04fdab38c
Jul 10 18:37:19.245832 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.245797    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:19.245925 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.245860    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:19.245925 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.245895    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:19.348623 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.348593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" event={"ID":"d966bae1-b5df-45ab-9e16-74d5051bee50","Type":"ContainerStarted","Data":"f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592"}
Jul 10 18:37:19.348818 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.348666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" event={"ID":"d966bae1-b5df-45ab-9e16-74d5051bee50","Type":"ContainerStarted","Data":"ba6e571b0ee05c30ebb6e818851bc4f7996a7c9f151ad0ba8ff0ccd04fdab38c"}
Jul 10 18:37:19.374354 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:19.374292    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" podStartSLOduration=1.374272199 podStartE2EDuration="1.374272199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:19.371074248 +0000 UTC m=+2044.529792073" watchObservedRunningTime="2026-07-10 18:37:19.374272199 +0000 UTC m=+2044.532990028"
Jul 10 18:37:20.093607 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:20.093565    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:20.098521 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:20.098493    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:20.353808 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:20.353708    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:20.354609 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:20.354584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:21.284528 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.284492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:21.366197 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.366166    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"]
Jul 10 18:37:21.368755 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.368733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.371412 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.371393    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-319db5-serving-cert\""
Jul 10 18:37:21.383709 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.383686    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"]
Jul 10 18:37:21.391012 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.390990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:21.456851 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.456810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr2s8\" (UniqueName: \"kubernetes.io/projected/ad9e16ec-4384-40fb-b5d8-158ec35f90da-kube-api-access-kr2s8\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.457045 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.456936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.457213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.457185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e16ec-4384-40fb-b5d8-158ec35f90da-openshift-service-ca\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.484627 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.484590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:21.558096 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.558018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr2s8\" (UniqueName: \"kubernetes.io/projected/ad9e16ec-4384-40fb-b5d8-158ec35f90da-kube-api-access-kr2s8\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.558231 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.558104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.558231 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.558166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e16ec-4384-40fb-b5d8-158ec35f90da-openshift-service-ca\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.558231 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:37:21.558217    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-serving-cert: secret "maas-api-e2e-shared-a-319db5-serving-cert" not found
Jul 10 18:37:21.558366 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:37:21.558278    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls podName:ad9e16ec-4384-40fb-b5d8-158ec35f90da nodeName:}" failed. No retries permitted until 2026-07-10 18:37:22.058260184 +0000 UTC m=+2047.216977990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls") pod "maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw" (UID: "ad9e16ec-4384-40fb-b5d8-158ec35f90da") : secret "maas-api-e2e-shared-a-319db5-serving-cert" not found
Jul 10 18:37:21.558777 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.558759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e16ec-4384-40fb-b5d8-158ec35f90da-openshift-service-ca\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.574274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.574252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr2s8\" (UniqueName: \"kubernetes.io/projected/ad9e16ec-4384-40fb-b5d8-158ec35f90da-kube-api-access-kr2s8\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:21.751349 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.751302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:21.976807 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:21.976768    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:22.063191 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:22.063150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:22.065618 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:22.065598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls\") pod \"maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:22.081973 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:22.081940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:22.279728 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:22.279619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:22.431964 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:22.431935    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"]
Jul 10 18:37:22.434063 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:37:22.434030    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9e16ec_4384_40fb_b5d8_158ec35f90da.slice/crio-97224c958ac04a8fb0dcc942293a8a9e6ee6330e62abc9f4911c39392cd9886b WatchSource:0}: Error finding container 97224c958ac04a8fb0dcc942293a8a9e6ee6330e62abc9f4911c39392cd9886b: Status 404 returned error can't find the container with id 97224c958ac04a8fb0dcc942293a8a9e6ee6330e62abc9f4911c39392cd9886b
Jul 10 18:37:23.370217 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:23.370122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw" event={"ID":"ad9e16ec-4384-40fb-b5d8-158ec35f90da","Type":"ContainerStarted","Data":"3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792"}
Jul 10 18:37:23.370217 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:23.370192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw" event={"ID":"ad9e16ec-4384-40fb-b5d8-158ec35f90da","Type":"ContainerStarted","Data":"97224c958ac04a8fb0dcc942293a8a9e6ee6330e62abc9f4911c39392cd9886b"}
Jul 10 18:37:23.370399 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:23.370221    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:23.393391 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:23.393341    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw" podStartSLOduration=1.829287069 podStartE2EDuration="2.393327301s" totalImagesPullingTime="564.040232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:23.391075854 +0000 UTC m=+2048.549793679" watchObservedRunningTime="2026-07-10 18:37:23.393327301 +0000 UTC m=+2048.552045127"
Jul 10 18:37:25.743156 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:25.743122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:26.133095 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:26.133060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:26.448843 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:26.448756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:26.575176 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:26.575137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:29.381252 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.381223    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:37:29.804891 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.804798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:29.910482 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.910454    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"]
Jul 10 18:37:29.913507 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.913488    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:29.917162 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.917143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-4cfdb5-serving-cert\""
Jul 10 18:37:29.935192 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.935169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"]
Jul 10 18:37:29.952484 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.952456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:29.953620 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.953598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvwch\" (UniqueName: \"kubernetes.io/projected/7deddbd7-21c9-447d-bd44-9fc32e0985e2-kube-api-access-hvwch\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:29.954006 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.953986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deddbd7-21c9-447d-bd44-9fc32e0985e2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:29.954175 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:29.954159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7deddbd7-21c9-447d-bd44-9fc32e0985e2-maas-api-tls\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.057298 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.057219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvwch\" (UniqueName: \"kubernetes.io/projected/7deddbd7-21c9-447d-bd44-9fc32e0985e2-kube-api-access-hvwch\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.057524 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.057509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deddbd7-21c9-447d-bd44-9fc32e0985e2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.057629 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.057619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7deddbd7-21c9-447d-bd44-9fc32e0985e2-maas-api-tls\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.058140 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.058116    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deddbd7-21c9-447d-bd44-9fc32e0985e2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.060047 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.060021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7deddbd7-21c9-447d-bd44-9fc32e0985e2-maas-api-tls\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.067559 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.067541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvwch\" (UniqueName: \"kubernetes.io/projected/7deddbd7-21c9-447d-bd44-9fc32e0985e2-kube-api-access-hvwch\") pod \"maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.070330 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.070308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:30.185253 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.185218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:30.224428 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.224397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:30.420264 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.420241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"]
Jul 10 18:37:30.422948 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:37:30.422920    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7deddbd7_21c9_447d_bd44_9fc32e0985e2.slice/crio-c16d91344bbce1b92b77aed886d68f54dd689376ffeaf0fcdd64d68c704ddede WatchSource:0}: Error finding container c16d91344bbce1b92b77aed886d68f54dd689376ffeaf0fcdd64d68c704ddede: Status 404 returned error can't find the container with id c16d91344bbce1b92b77aed886d68f54dd689376ffeaf0fcdd64d68c704ddede
Jul 10 18:37:30.790019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.789976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:30.898517 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:30.898494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:31.410700 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:31.410631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd" event={"ID":"7deddbd7-21c9-447d-bd44-9fc32e0985e2","Type":"ContainerStarted","Data":"4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb"}
Jul 10 18:37:31.410890 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:31.410723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd" event={"ID":"7deddbd7-21c9-447d-bd44-9fc32e0985e2","Type":"ContainerStarted","Data":"c16d91344bbce1b92b77aed886d68f54dd689376ffeaf0fcdd64d68c704ddede"}
Jul 10 18:37:31.410890 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:31.410754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:31.450183 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:31.450100    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd" podStartSLOduration=2.092221316 podStartE2EDuration="2.450078933s" totalImagesPullingTime="357.857617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:31.448248396 +0000 UTC m=+2056.606966222" watchObservedRunningTime="2026-07-10 18:37:31.450078933 +0000 UTC m=+2056.608796759"
Jul 10 18:37:34.222347 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:34.222307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:35.536697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:35.535494    2565 patch_prober.go:28] interesting pod/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:56830->10.134.0.59:15021: read: connection reset by peer" start-of-body=
Jul 10 18:37:35.536697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:35.535566    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:56830->10.134.0.59:15021: read: connection reset by peer"
Jul 10 18:37:36.441415 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:36.441340    2565 generic.go:356] "Generic (PLEG): container finished" podID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerID="f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592" exitCode=0
Jul 10 18:37:36.441415 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:36.441393    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" event={"ID":"d966bae1-b5df-45ab-9e16-74d5051bee50","Type":"ContainerDied","Data":"f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592"}
Jul 10 18:37:36.441780 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:36.441765    2565 scope.go:117] "RemoveContainer" containerID="f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592"
Jul 10 18:37:36.442852 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:36.442796    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:36.442933 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:36.442915    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:36.442973 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:36.442955    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:37:37.420974 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:37.420943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:37:37.454980 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:37.454940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" event={"ID":"d966bae1-b5df-45ab-9e16-74d5051bee50","Type":"ContainerStarted","Data":"04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66"}
Jul 10 18:37:38.093320 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:38.093286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:38.093496 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:38.093479    2565 patch_prober.go:28] interesting pod/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 10 18:37:38.093542 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:38.093522    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 10 18:37:39.093887 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:39.093853    2565 patch_prober.go:28] interesting pod/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 10 18:37:39.094350 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:39.093908    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 10 18:37:40.093620 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:40.093583    2565 patch_prober.go:28] interesting pod/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 10 18:37:40.093827 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:40.093663    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 10 18:37:41.094026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:41.093988    2565 patch_prober.go:28] interesting pod/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 10 18:37:41.094396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:41.094042    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 10 18:37:42.096443 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:42.096412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:42.096910 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:42.096851    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:42.097581 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:42.097560    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:37:43.716074 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:43.716040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:43.818695 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:43.818632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:53.154405 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:53.154360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:53.254773 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:37:53.254737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:15.536774 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:38:15.536747    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:38:15.544626 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:38:15.544605    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:38:16.238135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:38:16.238100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:39.030549 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:38:39.030503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:18.344707 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:39:18.344673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:57.904117 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:39:57.904078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:07.653259 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:40:07.653225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:17.344873 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:40:17.344839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:35.391690 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:40:35.391632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:36.301765 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:40:36.301684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:47.053021 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:40:47.052978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:51.014000 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:40:51.013961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:07.830778 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:41:07.830741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:07.944834 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:41:07.944800    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:29.074762 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:41:29.074699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:06.999473 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:06.999388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:08.374242 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:08.374200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:14.898328 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:14.898290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:26.113881 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:26.113833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:38.540202 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:38.540164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:43.921675 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:43.921617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:44.021857 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:44.021822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:54.050229 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:54.050184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:54.151198 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:54.151156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:42:59.674206 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:42:59.674162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:43:15.572859 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:43:15.572825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:43:15.581886 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:43:15.581852    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:43:51.440593 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:43:51.440550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:43:52.431752 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:43:52.431714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:12.235500 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:12.235458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:12.636305 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:12.636269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:12.736355 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:12.736307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:12.836966 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:12.836932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:12.958062 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:12.957969    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"]
Jul 10 18:44:12.958279 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:12.958248    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw" podUID="ad9e16ec-4384-40fb-b5d8-158ec35f90da" containerName="maas-api" containerID="cri-o://3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792" gracePeriod=30
Jul 10 18:44:12.985938 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:12.985901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:13.228188 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.228149    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:44:13.336230 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.336197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr2s8\" (UniqueName: \"kubernetes.io/projected/ad9e16ec-4384-40fb-b5d8-158ec35f90da-kube-api-access-kr2s8\") pod \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") "
Jul 10 18:44:13.336770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.336251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls\") pod \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") "
Jul 10 18:44:13.336770 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.336354    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e16ec-4384-40fb-b5d8-158ec35f90da-openshift-service-ca\") pod \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\" (UID: \"ad9e16ec-4384-40fb-b5d8-158ec35f90da\") "
Jul 10 18:44:13.336902 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.336827    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad9e16ec-4384-40fb-b5d8-158ec35f90da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad9e16ec-4384-40fb-b5d8-158ec35f90da" (UID: "ad9e16ec-4384-40fb-b5d8-158ec35f90da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:44:13.338623 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.338592    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad9e16ec-4384-40fb-b5d8-158ec35f90da" (UID: "ad9e16ec-4384-40fb-b5d8-158ec35f90da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:44:13.338812 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.338682    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad9e16ec-4384-40fb-b5d8-158ec35f90da-kube-api-access-kr2s8" (OuterVolumeSpecName: "kube-api-access-kr2s8") pod "ad9e16ec-4384-40fb-b5d8-158ec35f90da" (UID: "ad9e16ec-4384-40fb-b5d8-158ec35f90da"). InnerVolumeSpecName "kube-api-access-kr2s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:44:13.438019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.437976    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad9e16ec-4384-40fb-b5d8-158ec35f90da-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:13.438019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.438013    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e16ec-4384-40fb-b5d8-158ec35f90da-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:13.438019 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.438024    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr2s8\" (UniqueName: \"kubernetes.io/projected/ad9e16ec-4384-40fb-b5d8-158ec35f90da-kube-api-access-kr2s8\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:13.630504 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.630452    2565 generic.go:356] "Generic (PLEG): container finished" podID="ad9e16ec-4384-40fb-b5d8-158ec35f90da" containerID="3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792" exitCode=0
Jul 10 18:44:13.630504 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.630502    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"
Jul 10 18:44:13.630765 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.630540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw" event={"ID":"ad9e16ec-4384-40fb-b5d8-158ec35f90da","Type":"ContainerDied","Data":"3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792"}
Jul 10 18:44:13.630765 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.630620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw" event={"ID":"ad9e16ec-4384-40fb-b5d8-158ec35f90da","Type":"ContainerDied","Data":"97224c958ac04a8fb0dcc942293a8a9e6ee6330e62abc9f4911c39392cd9886b"}
Jul 10 18:44:13.630765 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.630667    2565 scope.go:117] "RemoveContainer" containerID="3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792"
Jul 10 18:44:13.640466 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.640437    2565 scope.go:117] "RemoveContainer" containerID="3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792"
Jul 10 18:44:13.640866 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:44:13.640842    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792\": container with ID starting with 3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792 not found: ID does not exist" containerID="3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792"
Jul 10 18:44:13.640948 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.640876    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792"} err="failed to get container status \"3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792\": rpc error: code = NotFound desc = could not find container \"3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792\": container with ID starting with 3d87b24803f802107c6434b8983bedd0f5563a9628207711d528b08cd4900792 not found: ID does not exist"
Jul 10 18:44:13.648891 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.648851    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"]
Jul 10 18:44:13.652358 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:13.652323    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-319db5-c47db7cbf-k7gfw"]
Jul 10 18:44:15.532430 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:15.532393    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad9e16ec-4384-40fb-b5d8-158ec35f90da" path="/var/lib/kubelet/pods/ad9e16ec-4384-40fb-b5d8-158ec35f90da/volumes"
Jul 10 18:44:18.673430 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:18.673385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:18.776448 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:18.776399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:18.917978 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:18.917943    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"]
Jul 10 18:44:18.918262 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:18.918227    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy" containerID="cri-o://04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66" gracePeriod=30
Jul 10 18:44:18.950303 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:18.950205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:19.156396 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:19.156352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:19.508699 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:19.508627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:19.842070 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:19.841974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:19.963607 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:19.963572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:20.069785 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.069740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:20.191507 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.191456    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"]
Jul 10 18:44:20.191839 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.191799    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd" podUID="7deddbd7-21c9-447d-bd44-9fc32e0985e2" containerName="maas-api" containerID="cri-o://4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb" gracePeriod=30
Jul 10 18:44:20.215925 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.215890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:20.463090 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.463049    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:44:20.612963 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.612922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvwch\" (UniqueName: \"kubernetes.io/projected/7deddbd7-21c9-447d-bd44-9fc32e0985e2-kube-api-access-hvwch\") pod \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") "
Jul 10 18:44:20.613152 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.613037    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deddbd7-21c9-447d-bd44-9fc32e0985e2-openshift-service-ca\") pod \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") "
Jul 10 18:44:20.613152 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.613069    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7deddbd7-21c9-447d-bd44-9fc32e0985e2-maas-api-tls\") pod \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\" (UID: \"7deddbd7-21c9-447d-bd44-9fc32e0985e2\") "
Jul 10 18:44:20.613470 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.613432    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7deddbd7-21c9-447d-bd44-9fc32e0985e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7deddbd7-21c9-447d-bd44-9fc32e0985e2" (UID: "7deddbd7-21c9-447d-bd44-9fc32e0985e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:44:20.615263 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.615237    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7deddbd7-21c9-447d-bd44-9fc32e0985e2-kube-api-access-hvwch" (OuterVolumeSpecName: "kube-api-access-hvwch") pod "7deddbd7-21c9-447d-bd44-9fc32e0985e2" (UID: "7deddbd7-21c9-447d-bd44-9fc32e0985e2"). InnerVolumeSpecName "kube-api-access-hvwch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:44:20.615263 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.615242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7deddbd7-21c9-447d-bd44-9fc32e0985e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7deddbd7-21c9-447d-bd44-9fc32e0985e2" (UID: "7deddbd7-21c9-447d-bd44-9fc32e0985e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:44:20.680715 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.680628    2565 generic.go:356] "Generic (PLEG): container finished" podID="7deddbd7-21c9-447d-bd44-9fc32e0985e2" containerID="4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb" exitCode=0
Jul 10 18:44:20.680715 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.680704    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"
Jul 10 18:44:20.680936 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.680709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd" event={"ID":"7deddbd7-21c9-447d-bd44-9fc32e0985e2","Type":"ContainerDied","Data":"4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb"}
Jul 10 18:44:20.680936 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.680821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd" event={"ID":"7deddbd7-21c9-447d-bd44-9fc32e0985e2","Type":"ContainerDied","Data":"c16d91344bbce1b92b77aed886d68f54dd689376ffeaf0fcdd64d68c704ddede"}
Jul 10 18:44:20.680936 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.680843    2565 scope.go:117] "RemoveContainer" containerID="4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb"
Jul 10 18:44:20.691403 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.691381    2565 scope.go:117] "RemoveContainer" containerID="4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb"
Jul 10 18:44:20.691792 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:44:20.691769    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb\": container with ID starting with 4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb not found: ID does not exist" containerID="4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb"
Jul 10 18:44:20.691846 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.691805    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb"} err="failed to get container status \"4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb\": rpc error: code = NotFound desc = could not find container \"4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb\": container with ID starting with 4b4416b4cfba4ce8b06c27b387bbe0a8815b8ae28c3d31f7e4e14b6574946adb not found: ID does not exist"
Jul 10 18:44:20.713185 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.713086    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"]
Jul 10 18:44:20.714219 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.714195    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvwch\" (UniqueName: \"kubernetes.io/projected/7deddbd7-21c9-447d-bd44-9fc32e0985e2-kube-api-access-hvwch\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:20.714284 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.714221    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deddbd7-21c9-447d-bd44-9fc32e0985e2-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:20.714284 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.714235    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7deddbd7-21c9-447d-bd44-9fc32e0985e2-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:20.717267 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:20.717232    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4cfdb5-7fbc77d-n4kmd"]
Jul 10 18:44:21.530990 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:21.530948    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7deddbd7-21c9-447d-bd44-9fc32e0985e2" path="/var/lib/kubelet/pods/7deddbd7-21c9-447d-bd44-9fc32e0985e2/volumes"
Jul 10 18:44:24.184918 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.184843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:44:24.353572 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdvx6\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-kube-api-access-hdvx6\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.353815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353586    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-data\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.353815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-podinfo\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.353815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-token\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.353815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d966bae1-b5df-45ab-9e16-74d5051bee50-istiod-ca-cert\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.353815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-socket\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.353815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353812    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-credential-socket\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.354141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353896    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-envoy\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.354141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.353924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-certs\") pod \"d966bae1-b5df-45ab-9e16-74d5051bee50\" (UID: \"d966bae1-b5df-45ab-9e16-74d5051bee50\") "
Jul 10 18:44:24.354243 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354124    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:44:24.354243 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d966bae1-b5df-45ab-9e16-74d5051bee50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:44:24.354243 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354138    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:44:24.354421 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:44:24.354509 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354449    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d966bae1-b5df-45ab-9e16-74d5051bee50-istiod-ca-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.354509 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354471    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.354509 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354484    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-credential-socket\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.354669 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.354561    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-data" (OuterVolumeSpecName: "istio-data") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:44:24.356031 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.356000    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-kube-api-access-hdvx6" (OuterVolumeSpecName: "kube-api-access-hdvx6") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "kube-api-access-hdvx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:44:24.356141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.356047    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-token" (OuterVolumeSpecName: "istio-token") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:44:24.356575 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.356546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:44:24.356628 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.356551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d966bae1-b5df-45ab-9e16-74d5051bee50" (UID: "d966bae1-b5df-45ab-9e16-74d5051bee50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 18:44:24.455106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.454998    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-envoy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.455106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.455036    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-workload-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.455106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.455045    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdvx6\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-kube-api-access-hdvx6\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.455106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.455055    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-data\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.455106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.455064    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-podinfo\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.455106 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.455071    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d966bae1-b5df-45ab-9e16-74d5051bee50-istio-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 10 18:44:24.711447 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.711353    2565 generic.go:356] "Generic (PLEG): container finished" podID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerID="04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66" exitCode=0
Jul 10 18:44:24.711447 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.711428    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"
Jul 10 18:44:24.711683 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.711433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" event={"ID":"d966bae1-b5df-45ab-9e16-74d5051bee50","Type":"ContainerDied","Data":"04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66"}
Jul 10 18:44:24.711683 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.711554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt" event={"ID":"d966bae1-b5df-45ab-9e16-74d5051bee50","Type":"ContainerDied","Data":"ba6e571b0ee05c30ebb6e818851bc4f7996a7c9f151ad0ba8ff0ccd04fdab38c"}
Jul 10 18:44:24.711683 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.711577    2565 scope.go:117] "RemoveContainer" containerID="04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66"
Jul 10 18:44:24.721139 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.721119    2565 scope.go:117] "RemoveContainer" containerID="f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592"
Jul 10 18:44:24.731714 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.731689    2565 scope.go:117] "RemoveContainer" containerID="04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66"
Jul 10 18:44:24.732099 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:44:24.732073    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66\": container with ID starting with 04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66 not found: ID does not exist" containerID="04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66"
Jul 10 18:44:24.732191 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.732115    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66"} err="failed to get container status \"04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66\": rpc error: code = NotFound desc = could not find container \"04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66\": container with ID starting with 04716955a19e18159f34943250d7d6d6ecbc7db2df3440bf42aa0178d320be66 not found: ID does not exist"
Jul 10 18:44:24.732191 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.732136    2565 scope.go:117] "RemoveContainer" containerID="f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592"
Jul 10 18:44:24.732513 ip-10-0-135-41 kubenswrapper[2565]: E0710 18:44:24.732481    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592\": container with ID starting with f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592 not found: ID does not exist" containerID="f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592"
Jul 10 18:44:24.732733 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.732521    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592"} err="failed to get container status \"f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592\": rpc error: code = NotFound desc = could not find container \"f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592\": container with ID starting with f9fb2f7d24de4ca960c925ae8a1dc51d832f467aa2c0a736571c1afec8abd592 not found: ID does not exist"
Jul 10 18:44:24.735700 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.735666    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"]
Jul 10 18:44:24.740141 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:24.740105    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-319db5-openshift-default-cc899d587-v7fvt"]
Jul 10 18:44:25.532933 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:25.532886    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" path="/var/lib/kubelet/pods/d966bae1-b5df-45ab-9e16-74d5051bee50/volumes"
Jul 10 18:44:25.927206 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:25.927165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:26.029944 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:26.029901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:26.198079 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:26.197987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:26.450612 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:26.450512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:31.573322 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:31.573284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zfvsw_59ee70ee-6236-4ac5-ad49-eafe4523ba0f/manager/0.log"
Jul 10 18:44:31.684215 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:31.684176    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dcb6c7c86-b58xw_a9d7cd76-a3c5-4917-922a-99f8f437fbd1/manager/0.log"
Jul 10 18:44:32.296750 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:32.296719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795b486df7-vxv8n_d4630c23-e9df-4d23-92fc-eca942b42a5d/copy-manifests/0.log"
Jul 10 18:44:32.304386 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:32.304353    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795b486df7-vxv8n_d4630c23-e9df-4d23-92fc-eca942b42a5d/manager/0.log"
Jul 10 18:44:32.627115 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:32.627021    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6c76b6b79f-4cf5h_88b15721-8090-4063-8019-1b3c7522f466/maas-api/0.log"
Jul 10 18:44:32.736754 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:32.736719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-p2fs6_5b32b82c-6be9-46e1-b847-29647a488d9f/postgres/0.log"
Jul 10 18:44:34.100178 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:34.100139    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rrx52_250210b5-f504-4b2c-aeeb-1a78e5750f8b/manager/0.log"
Jul 10 18:44:34.441823 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:34.441792    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k82qf_446b3bba-2033-4681-b400-a6c923bbd769/registry-server/0.log"
Jul 10 18:44:34.561917 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:34.561878    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dxbqq_07f50502-ea7e-47cc-8c53-dd118b223041/manager/0.log"
Jul 10 18:44:35.133288 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:35.133256    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ql85g_75195547-5aa6-4923-9cd6-056a33f4098f/istio-proxy/0.log"
Jul 10 18:44:35.245497 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:35.245463    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnrkq_baef7210-f53b-482d-9aa2-19fe93feae90/discovery/0.log"
Jul 10 18:44:35.351408 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:35.351372    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655946c88b-n8pm9_86162152-be73-4d9d-b076-85d266e6a897/kube-auth-proxy/0.log"
Jul 10 18:44:35.567128 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:35.567031    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xg4wc_c015c4b8-69cd-499b-90fb-4d1e8a8d9594/istio-proxy/1.log"
Jul 10 18:44:35.796156 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:35.796122    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-knqwm_503a3de8-6621-482f-bb2e-a99ca8a69cbf/payload-processing/0.log"
Jul 10 18:44:36.342495 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:36.342459    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ghxwv_fadcfd91-617e-40ab-a76a-d66cdf2f8db1/main/0.log"
Jul 10 18:44:36.448443 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:36.448414    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7txkq_6e105ef5-9493-4786-8505-81ab8ea8715a/main/0.log"
Jul 10 18:44:40.998997 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:40.998959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:41.098303 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:41.098263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:44:43.854603 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:43.854561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkmgq_dc3cf1fc-a022-4cdc-8aba-146d23d84f5a/global-pull-secret-syncer/0.log"
Jul 10 18:44:43.953525 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:43.953478    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log"
Jul 10 18:44:44.095200 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:44.095157    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-41.ec2.internal_daf4e3bb9336c51a7b1e768dcaf8ad41/haproxy/0.log"
Jul 10 18:44:48.914296 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:48.914263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rrx52_250210b5-f504-4b2c-aeeb-1a78e5750f8b/manager/0.log"
Jul 10 18:44:49.017528 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:49.017490    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k82qf_446b3bba-2033-4681-b400-a6c923bbd769/registry-server/0.log"
Jul 10 18:44:49.108919 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:49.108874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dxbqq_07f50502-ea7e-47cc-8c53-dd118b223041/manager/0.log"
Jul 10 18:44:50.750081 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:50.750052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_348abe3a-c2ba-4eb7-8a31-27b03e5b8425/alertmanager/0.log"
Jul 10 18:44:50.782622 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:50.782592    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_348abe3a-c2ba-4eb7-8a31-27b03e5b8425/config-reloader/0.log"
Jul 10 18:44:50.808168 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:50.808139    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_348abe3a-c2ba-4eb7-8a31-27b03e5b8425/kube-rbac-proxy-web/0.log"
Jul 10 18:44:50.832458 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:50.832428    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_348abe3a-c2ba-4eb7-8a31-27b03e5b8425/kube-rbac-proxy/0.log"
Jul 10 18:44:50.856203 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:50.856176    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_348abe3a-c2ba-4eb7-8a31-27b03e5b8425/kube-rbac-proxy-metric/0.log"
Jul 10 18:44:50.895331 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:50.895305    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_348abe3a-c2ba-4eb7-8a31-27b03e5b8425/prom-label-proxy/0.log"
Jul 10 18:44:50.943579 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:50.943502    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_348abe3a-c2ba-4eb7-8a31-27b03e5b8425/init-config-reloader/0.log"
Jul 10 18:44:51.035779 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.035750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gbjpm_f1601948-4a01-4b75-a7fa-a01b68ef9845/kube-state-metrics/0.log"
Jul 10 18:44:51.055564 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.055521    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gbjpm_f1601948-4a01-4b75-a7fa-a01b68ef9845/kube-rbac-proxy-main/0.log"
Jul 10 18:44:51.084384 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.084351    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gbjpm_f1601948-4a01-4b75-a7fa-a01b68ef9845/kube-rbac-proxy-self/0.log"
Jul 10 18:44:51.143117 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.143091    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-gr88t_682d87a2-ada2-426a-b89d-e8309b5b48b7/monitoring-plugin/0.log"
Jul 10 18:44:51.330604 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.330520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2v2v_fffe8938-1725-400c-ab0b-e26965c59124/node-exporter/0.log"
Jul 10 18:44:51.357047 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.357017    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2v2v_fffe8938-1725-400c-ab0b-e26965c59124/kube-rbac-proxy/0.log"
Jul 10 18:44:51.388276 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.388249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2v2v_fffe8938-1725-400c-ab0b-e26965c59124/init-textfile/0.log"
Jul 10 18:44:51.437841 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.437811    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ndrcs_b220ab3d-a66b-40ef-af2c-26c9b0e654a2/kube-rbac-proxy-main/0.log"
Jul 10 18:44:51.466526 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.466485    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ndrcs_b220ab3d-a66b-40ef-af2c-26c9b0e654a2/kube-rbac-proxy-self/0.log"
Jul 10 18:44:51.489311 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.489280    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ndrcs_b220ab3d-a66b-40ef-af2c-26c9b0e654a2/openshift-state-metrics/0.log"
Jul 10 18:44:51.536727 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.536689    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df56efb6-c876-43d4-bbde-ab7b63dd3eeb/prometheus/0.log"
Jul 10 18:44:51.569189 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.569162    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df56efb6-c876-43d4-bbde-ab7b63dd3eeb/config-reloader/0.log"
Jul 10 18:44:51.600478 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.600384    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df56efb6-c876-43d4-bbde-ab7b63dd3eeb/thanos-sidecar/0.log"
Jul 10 18:44:51.641043 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.641013    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df56efb6-c876-43d4-bbde-ab7b63dd3eeb/kube-rbac-proxy-web/0.log"
Jul 10 18:44:51.668117 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.668088    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df56efb6-c876-43d4-bbde-ab7b63dd3eeb/kube-rbac-proxy/0.log"
Jul 10 18:44:51.697815 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.697790    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df56efb6-c876-43d4-bbde-ab7b63dd3eeb/kube-rbac-proxy-thanos/0.log"
Jul 10 18:44:51.723024 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.722997    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df56efb6-c876-43d4-bbde-ab7b63dd3eeb/init-config-reloader/0.log"
Jul 10 18:44:51.757022 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.756987    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-294vf_16f272d5-3306-45b1-8e51-0b90129b26ff/prometheus-operator/0.log"
Jul 10 18:44:51.779436 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.779374    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-294vf_16f272d5-3306-45b1-8e51-0b90129b26ff/kube-rbac-proxy/0.log"
Jul 10 18:44:51.942408 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.942381    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455b5f5f7-jdjgb_a5915cba-321d-44aa-b74b-256b66fe4e78/thanos-query/0.log"
Jul 10 18:44:51.964172 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.964141    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455b5f5f7-jdjgb_a5915cba-321d-44aa-b74b-256b66fe4e78/kube-rbac-proxy-web/0.log"
Jul 10 18:44:51.986909 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:51.986874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455b5f5f7-jdjgb_a5915cba-321d-44aa-b74b-256b66fe4e78/kube-rbac-proxy/0.log"
Jul 10 18:44:52.010379 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:52.010346    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455b5f5f7-jdjgb_a5915cba-321d-44aa-b74b-256b66fe4e78/prom-label-proxy/0.log"
Jul 10 18:44:52.037872 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:52.037842    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455b5f5f7-jdjgb_a5915cba-321d-44aa-b74b-256b66fe4e78/kube-rbac-proxy-rules/0.log"
Jul 10 18:44:52.060901 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:52.060869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455b5f5f7-jdjgb_a5915cba-321d-44aa-b74b-256b66fe4e78/kube-rbac-proxy-metrics/0.log"
Jul 10 18:44:54.456192 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456151    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"]
Jul 10 18:44:54.456888 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456866    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad9e16ec-4384-40fb-b5d8-158ec35f90da" containerName="maas-api"
Jul 10 18:44:54.456888 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456890    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad9e16ec-4384-40fb-b5d8-158ec35f90da" containerName="maas-api"
Jul 10 18:44:54.457023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456911    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy"
Jul 10 18:44:54.457023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456918    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy"
Jul 10 18:44:54.457023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456939    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy"
Jul 10 18:44:54.457023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456946    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy"
Jul 10 18:44:54.457023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456955    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7deddbd7-21c9-447d-bd44-9fc32e0985e2" containerName="maas-api"
Jul 10 18:44:54.457023 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.456960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7deddbd7-21c9-447d-bd44-9fc32e0985e2" containerName="maas-api"
Jul 10 18:44:54.457213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.457038    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy"
Jul 10 18:44:54.457213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.457047    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d966bae1-b5df-45ab-9e16-74d5051bee50" containerName="istio-proxy"
Jul 10 18:44:54.457213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.457053    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7deddbd7-21c9-447d-bd44-9fc32e0985e2" containerName="maas-api"
Jul 10 18:44:54.457213 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.457061    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad9e16ec-4384-40fb-b5d8-158ec35f90da" containerName="maas-api"
Jul 10 18:44:54.460442 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.460415    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.465537 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.465507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjmm9\"/\"kube-root-ca.crt\""
Jul 10 18:44:54.466835 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.466809    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rjmm9\"/\"default-dockercfg-r9c95\""
Jul 10 18:44:54.466985 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.466833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjmm9\"/\"openshift-service-ca.crt\""
Jul 10 18:44:54.472328 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.472296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"]
Jul 10 18:44:54.556822 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.556791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-podres\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.557046 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.556857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-sys\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.557046 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.556883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjx9c\" (UniqueName: \"kubernetes.io/projected/0f9d939e-89c2-4415-af6e-b8326e6941e6-kube-api-access-xjx9c\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.557046 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.556915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-lib-modules\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.557195 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.557048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-proc\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658026 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.657980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-sys\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjx9c\" (UniqueName: \"kubernetes.io/projected/0f9d939e-89c2-4415-af6e-b8326e6941e6-kube-api-access-xjx9c\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-lib-modules\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-sys\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658420 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-lib-modules\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658487 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-proc\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658589 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-proc\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658684 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-podres\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.658828 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.658814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f9d939e-89c2-4415-af6e-b8326e6941e6-podres\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.663910 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.663887    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56776f75b5-9j9qc_1a3f15de-8759-4618-ab82-30df95cf6ee3/console/0.log"
Jul 10 18:44:54.667816 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.667790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjx9c\" (UniqueName: \"kubernetes.io/projected/0f9d939e-89c2-4415-af6e-b8326e6941e6-kube-api-access-xjx9c\") pod \"perf-node-gather-daemonset-px8tx\" (UID: \"0f9d939e-89c2-4415-af6e-b8326e6941e6\") " pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.772029 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.771920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:54.929559 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:54.929528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"]
Jul 10 18:44:54.932402 ip-10-0-135-41 kubenswrapper[2565]: W0710 18:44:54.932364    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f9d939e_89c2_4415_af6e_b8326e6941e6.slice/crio-a0edc7c42190f17707db729346b443678ec6a7cdc686fe819ded62e21acfc045 WatchSource:0}: Error finding container a0edc7c42190f17707db729346b443678ec6a7cdc686fe819ded62e21acfc045: Status 404 returned error can't find the container with id a0edc7c42190f17707db729346b443678ec6a7cdc686fe819ded62e21acfc045
Jul 10 18:44:55.886829 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:55.886783    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx" event={"ID":"0f9d939e-89c2-4415-af6e-b8326e6941e6","Type":"ContainerStarted","Data":"79ac42763079c6561af4795e04b7363fa7f419104d409b82b6089fc1c4060aeb"}
Jul 10 18:44:55.887248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:55.886840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx" event={"ID":"0f9d939e-89c2-4415-af6e-b8326e6941e6","Type":"ContainerStarted","Data":"a0edc7c42190f17707db729346b443678ec6a7cdc686fe819ded62e21acfc045"}
Jul 10 18:44:55.887248 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:55.886909    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:44:55.905295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:55.905237    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx" podStartSLOduration=1.905219606 podStartE2EDuration="1.905219606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:44:55.902976613 +0000 UTC m=+2501.061694438" watchObservedRunningTime="2026-07-10 18:44:55.905219606 +0000 UTC m=+2501.063937430"
Jul 10 18:44:56.462408 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:56.462374    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g87kr_4bf5794f-aab9-4f11-a2a5-4fca7a3becce/dns/0.log"
Jul 10 18:44:56.506419 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:56.506385    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g87kr_4bf5794f-aab9-4f11-a2a5-4fca7a3becce/kube-rbac-proxy/0.log"
Jul 10 18:44:56.629084 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:56.629055    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dp4kp_411a9b95-29e8-4e06-a2bf-771e3a6507d9/dns-node-resolver/0.log"
Jul 10 18:44:57.320502 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:57.320471    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-58vxb_741e0c1d-a790-453a-8222-93dacf76c03c/node-ca/0.log"
Jul 10 18:44:58.350246 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:58.350213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ql85g_75195547-5aa6-4923-9cd6-056a33f4098f/istio-proxy/0.log"
Jul 10 18:44:58.474697 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:58.474661    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnrkq_baef7210-f53b-482d-9aa2-19fe93feae90/discovery/0.log"
Jul 10 18:44:58.501283 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:58.501246    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655946c88b-n8pm9_86162152-be73-4d9d-b076-85d266e6a897/kube-auth-proxy/0.log"
Jul 10 18:44:58.562018 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:58.561981    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xg4wc_c015c4b8-69cd-499b-90fb-4d1e8a8d9594/istio-proxy/0.log"
Jul 10 18:44:58.594822 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:58.594789    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xg4wc_c015c4b8-69cd-499b-90fb-4d1e8a8d9594/istio-proxy/1.log"
Jul 10 18:44:58.674372 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:58.674333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-knqwm_503a3de8-6621-482f-bb2e-a99ca8a69cbf/payload-processing/0.log"
Jul 10 18:44:59.480852 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:44:59.480822    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zd95w_f4a7b551-f99b-4a81-bbda-50f9dddbbec9/serve-healthcheck-canary/0.log"
Jul 10 18:45:00.069914 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:00.069883    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k2fzk_214bd43b-1407-4b79-b29a-946fc1ecd918/kube-rbac-proxy/0.log"
Jul 10 18:45:00.096300 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:00.096270    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k2fzk_214bd43b-1407-4b79-b29a-946fc1ecd918/exporter/0.log"
Jul 10 18:45:00.121953 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:00.121916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k2fzk_214bd43b-1407-4b79-b29a-946fc1ecd918/extractor/0.log"
Jul 10 18:45:01.903996 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:01.903963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rjmm9/perf-node-gather-daemonset-px8tx"
Jul 10 18:45:02.454215 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:02.454179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zfvsw_59ee70ee-6236-4ac5-ad49-eafe4523ba0f/manager/0.log"
Jul 10 18:45:02.554269 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:02.554232    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dcb6c7c86-b58xw_a9d7cd76-a3c5-4917-922a-99f8f437fbd1/manager/0.log"
Jul 10 18:45:02.935790 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:02.935760    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795b486df7-vxv8n_d4630c23-e9df-4d23-92fc-eca942b42a5d/manager/0.log"
Jul 10 18:45:02.957989 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:02.957962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795b486df7-vxv8n_d4630c23-e9df-4d23-92fc-eca942b42a5d/copy-manifests/0.log"
Jul 10 18:45:04.583113 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:04.583080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ql85g_75195547-5aa6-4923-9cd6-056a33f4098f/istio-proxy/0.log"
Jul 10 18:45:04.704135 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:04.704101    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnrkq_baef7210-f53b-482d-9aa2-19fe93feae90/discovery/0.log"
Jul 10 18:45:04.730866 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:04.730837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655946c88b-n8pm9_86162152-be73-4d9d-b076-85d266e6a897/kube-auth-proxy/0.log"
Jul 10 18:45:04.771445 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:04.771338    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xg4wc_c015c4b8-69cd-499b-90fb-4d1e8a8d9594/istio-proxy/0.log"
Jul 10 18:45:04.806553 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:04.806520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xg4wc_c015c4b8-69cd-499b-90fb-4d1e8a8d9594/istio-proxy/1.log"
Jul 10 18:45:04.858209 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:04.858179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-knqwm_503a3de8-6621-482f-bb2e-a99ca8a69cbf/payload-processing/0.log"
Jul 10 18:45:05.257974 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:05.257941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-62552_b75791fd-840a-4528-9f09-a2cff62bf90a/konnectivity-agent/0.log" limit=1024
Jul 10 18:45:06.213725 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:06.213693    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ql85g_75195547-5aa6-4923-9cd6-056a33f4098f/istio-proxy/0.log"
Jul 10 18:45:06.336295 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:06.336215    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnrkq_baef7210-f53b-482d-9aa2-19fe93feae90/discovery/0.log"
Jul 10 18:45:06.350348 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:06.350319    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655946c88b-n8pm9_86162152-be73-4d9d-b076-85d266e6a897/kube-auth-proxy/0.log"
Jul 10 18:45:06.396153 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:06.396109    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xg4wc_c015c4b8-69cd-499b-90fb-4d1e8a8d9594/istio-proxy/0.log"
Jul 10 18:45:06.426592 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:06.426561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xg4wc_c015c4b8-69cd-499b-90fb-4d1e8a8d9594/istio-proxy/1.log"
Jul 10 18:45:06.478676 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:06.478575    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-knqwm_503a3de8-6621-482f-bb2e-a99ca8a69cbf/payload-processing/0.log"
Jul 10 18:45:10.977274 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:10.977245    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7cvb_dd67c2f8-794d-4d25-80a3-75acecb9e39e/kube-multus-additional-cni-plugins/0.log"
Jul 10 18:45:11.001220 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.001184    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7cvb_dd67c2f8-794d-4d25-80a3-75acecb9e39e/egress-router-binary-copy/0.log"
Jul 10 18:45:11.025622 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.025592    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7cvb_dd67c2f8-794d-4d25-80a3-75acecb9e39e/cni-plugins/0.log"
Jul 10 18:45:11.051069 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.051039    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7cvb_dd67c2f8-794d-4d25-80a3-75acecb9e39e/bond-cni-plugin/0.log"
Jul 10 18:45:11.076956 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.076925    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7cvb_dd67c2f8-794d-4d25-80a3-75acecb9e39e/routeoverride-cni/0.log"
Jul 10 18:45:11.105061 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.105032    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7cvb_dd67c2f8-794d-4d25-80a3-75acecb9e39e/whereabouts-cni-bincopy/0.log"
Jul 10 18:45:11.128654 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.128616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7cvb_dd67c2f8-794d-4d25-80a3-75acecb9e39e/whereabouts-cni/0.log"
Jul 10 18:45:11.591006 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.590970    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xg288_17966e87-b173-49bf-adcc-9f65e446ceed/kube-multus/0.log"
Jul 10 18:45:11.615340 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.615305    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h67nc_9a47b623-fe71-4336-b9e7-a68d1e38a9db/network-metrics-daemon/0.log"
Jul 10 18:45:11.638659 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:11.638616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h67nc_9a47b623-fe71-4336-b9e7-a68d1e38a9db/kube-rbac-proxy/0.log"
Jul 10 18:45:12.855611 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:12.855567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-controller/0.log"
Jul 10 18:45:12.880545 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:12.880513    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/0.log"
Jul 10 18:45:12.880739 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:12.880520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovn-acl-logging/1.log"
Jul 10 18:45:12.901941 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:12.901900    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/kube-rbac-proxy-node/0.log"
Jul 10 18:45:12.928058 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:12.928029    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/kube-rbac-proxy-ovn-metrics/0.log"
Jul 10 18:45:12.953055 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:12.953026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/northd/0.log"
Jul 10 18:45:12.978980 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:12.978950    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/nbdb/0.log"
Jul 10 18:45:13.004151 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:13.004120    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/sbdb/0.log"
Jul 10 18:45:13.065224 ip-10-0-135-41 kubenswrapper[2565]: I0710 18:45:13.065191    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9tmd_37698526-7a93-4eb5-b448-eaf8bde7fd7e/ovnkube-controller/0.log"