Sep 08 15:10:54.318758 ip-10-0-129-54 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 15:10:54.318772 ip-10-0-129-54 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 15:10:54.318782 ip-10-0-129-54 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 15:10:54.319027 ip-10-0-129-54 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 15:11:04.568160 ip-10-0-129-54 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 15:11:04.568175 ip-10-0-129-54 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 073cf23683c4416085124ccec615c785 --
Sep 08 15:12:59.227865 ip-10-0-129-54 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 15:12:59.609165 ip-10-0-129-54 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:12:59.609165 ip-10-0-129-54 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 15:12:59.609165 ip-10-0-129-54 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:12:59.609165 ip-10-0-129-54 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 15:12:59.609165 ip-10-0-129-54 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:12:59.611522 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.611432    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 15:12:59.614984 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.614969    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:59.614984 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.614983    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:59.614984 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.614987    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.614992    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.614995    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.614998    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615010    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615013    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615016    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615019    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615021    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615024    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615027    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615030    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615032    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615035    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615038    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615040    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615043    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615045    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615048    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:59.615096 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615050    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615053    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615055    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615058    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615060    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615062    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615071    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615075    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615078    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615081    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615084    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615087    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615089    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615092    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615094    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615098    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615100    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615108    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615111    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615113    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:59.615550 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615116    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615119    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615122    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615124    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615129    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615133    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615135    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615138    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615141    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615144    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615146    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615151    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615153    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615156    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615159    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615161    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615164    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615166    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615169    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:59.616067 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615171    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615174    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615178    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615181    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615183    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615186    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615188    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615191    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615194    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615196    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615199    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615202    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615206    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615210    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615213    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615216    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615220    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615222    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615226    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:59.616533 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615228    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615231    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615233    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615236    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615239    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615243    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615245    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615248    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615251    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615254    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615256    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615259    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615263    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615267    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615271    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615275    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615278    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615281    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615284    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615286    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:59.617019 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.615994    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616001    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616004    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616007    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616010    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616014    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616017    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616020    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616022    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616025    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616028    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616030    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616033    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616035    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616038    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616040    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616043    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616045    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616048    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616051    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:59.617510 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616053    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616055    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616058    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616061    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616064    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616067    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616070    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616073    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616076    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616079    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616082    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616084    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616087    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616090    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616092    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616095    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616097    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616100    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616103    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:59.618061 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616105    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616108    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616111    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616113    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616116    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616118    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616121    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616123    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616126    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616129    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616132    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616135    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616137    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616140    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616142    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616145    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616148    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616150    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616153    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616156    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:59.618537 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616159    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616161    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616164    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616167    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616169    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616172    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616174    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616177    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616180    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616183    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616185    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616188    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616191    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616194    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616196    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616199    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616201    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616204    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616206    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616209    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:59.619046 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616213    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616217    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616220    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616223    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616226    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616229    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616232    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616235    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616239    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616242    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616245    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616249    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616252    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616256    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616260    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616263    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616266    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616269    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616272    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:59.619556 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616275    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616647    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616653    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616655    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616658    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616662    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616664    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616667    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616671    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616674    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616677    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616679    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616682    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616684    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616687    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616690    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616693    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616695    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616698    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616700    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:59.620038 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616703    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616705    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616708    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616711    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616714    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616717    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616720    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616722    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616725    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616728    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616730    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616733    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616736    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616738    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616741    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616743    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616746    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616748    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616751    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616754    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:59.620539 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616756    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616761    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616765    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616768    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616771    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616774    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616777    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616779    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616781    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616784    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616788    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616791    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616794    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616796    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616799    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616805    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616808    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616811    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616814    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:59.621045 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616816    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616820    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616823    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616825    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616828    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616830    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616833    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616835    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616837    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616840    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616842    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616845    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616848    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616850    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616853    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616855    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616857    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616860    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616862    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616865    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:59.621515 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616867    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616870    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616872    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616875    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616878    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616880    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616883    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616885    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616889    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616892    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616895    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616898    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616900    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616903    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616906    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616908    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616910    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616913    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616916    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616918    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:59.622001 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.616921    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.616996    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617031    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617038    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617042    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617047    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617050    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617054    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617058    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617061    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617064    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617068    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617071    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617074    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617077    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617080    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617083    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617086    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617089    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617092    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617097    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617100    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617103    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617107    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 15:12:59.622517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617111    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617114    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617118    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617121    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617124    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617127    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617130    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617134    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617136    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617140    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617143    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617146    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617149    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617152    2578 flags.go:64] FLAG: --enable-server="true"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617156    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617161    2578 flags.go:64] FLAG: --event-burst="100"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617164    2578 flags.go:64] FLAG: --event-qps="50"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617167    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617170    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617173    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617177    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617180    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617183    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617186    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617189    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 15:12:59.623216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617192    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617195    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617198    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617202    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617205    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617208    2578 flags.go:64] FLAG: --feature-gates=""
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617212    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617215    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617218    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617221    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617224    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617227    2578 flags.go:64] FLAG: --help="false"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617230    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617233    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617236    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617239    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617242    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617246    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617248    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617251    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617254    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617257    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617260    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617264    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 15:12:59.623851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617267    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617270    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617273    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617277    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617280    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617283    2578 flags.go:64] FLAG: --lock-file=""
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617286    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617289    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617292    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617297    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617300    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617304    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617307    2578 flags.go:64] FLAG: --logging-format="text"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617309    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617313    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617315    2578 flags.go:64] FLAG: --manifest-url=""
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617318    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617325    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617328    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617332    2578 flags.go:64] FLAG: --max-pods="110"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617335    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617338    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617341    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617344    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617347    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 15:12:59.624495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617350    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617352    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617359    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617362    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617365    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617368    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617371    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617377    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617379    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617383    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617387    2578 flags.go:64] FLAG: --port="10250"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617390    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617393    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-014c311efb69a2392"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617396    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617399    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617402    2578 flags.go:64] FLAG: --register-node="true"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617405    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617408    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617411    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617416    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617419    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617422    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617425    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617428    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617431    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 15:12:59.625152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617434    2578 flags.go:64] FLAG: --runonce="false"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617437    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617440    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617443    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617446    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617449    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617452    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617455    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617458    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617461    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617464    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617467    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617469    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617472    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617476    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617479    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617484    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617488    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617491    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617495    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617497    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617500    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617503    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617506    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617509    2578 flags.go:64] FLAG: --v="2"
Sep 08 15:12:59.625792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617512    2578 flags.go:64] FLAG: --version="false"
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617517    2578 flags.go:64] FLAG: --vmodule=""
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617522    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.617525    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617649    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617653    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617657    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617659    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617662    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617665    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617668    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617671    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617674    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617677    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617679    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617682    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617685    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617687    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617690    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617693    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:59.626437 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617696    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617698    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617701    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617704    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617708    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617710    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617713    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617716    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617718    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617721    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617724    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617726    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617729    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617733    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617736    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617738    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617741    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617744    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617746    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617749    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:59.626950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617751    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617754    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617756    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617759    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617762    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617764    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617767    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617769    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617772    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617774    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617777    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617779    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617782    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617786    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617789    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617798    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617802    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617805    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617807    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:59.627444 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617811    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617814    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617816    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617819    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617821    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617824    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617828    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617830    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617833    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617836    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617839    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617841    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617844    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617846    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617849    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617852    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617854    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617857    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617859    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617862    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:59.627935 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617865    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617868    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617871    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617873    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617876    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617878    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617881    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617884    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617886    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617891    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617895    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617898    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617901    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617904    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617907    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617909    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617912    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617916    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617921    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:59.628448 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617923    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617926    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617929    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617932    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.617934    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.618852    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.626037    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.626050    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.626799    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.626807    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626861    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626867    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626870    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626873    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:59.628950 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626876    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626879    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626882    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626885    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626888    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626890    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626893    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626896    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626899    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626901    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626904    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626907    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626910    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626913    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626915    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626918    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626920    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626923    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626925    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626928    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:59.629297 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626930    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626933    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626935    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626939    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626941    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626944    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626947    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626950    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626953    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626956    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626960    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626964    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626966    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626969    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626972    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626974    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626977    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626979    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626982    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626984    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:59.629847 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626987    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626990    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626992    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626995    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.626997    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627000    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627003    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627005    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627008    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627011    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627014    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627017    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627019    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627022    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627025    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627027    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627030    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627033    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627035    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627038    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:59.630336 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627040    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627043    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627045    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627047    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627050    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627053    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627055    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627058    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627060    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627063    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627073    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627076    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627078    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627081    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627084    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627086    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627089    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627092    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627094    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627099    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:59.630840 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627102    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627105    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627109    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627111    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627114    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627118    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627121    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627124    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627127    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627130    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627133    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627136    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627138    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627141    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:59.631334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627144    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.627149    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627255    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627260    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627263    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627265    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627268    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627271    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627273    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627276    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627278    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627281    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627284    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627294    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:59.631704 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627296    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627300    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627305    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627307    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627310    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627313    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627316    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627318    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627321    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627324    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627326    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627328    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627331    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627334    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627337    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627339    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627342    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627345    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627347    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:59.632064 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627350    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627352    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627355    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627358    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627360    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627363    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627366    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627370    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627373    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627376    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627379    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627382    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627384    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627387    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627389    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627392    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627394    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627397    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627399    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:59.632527 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627402    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627404    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627407    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627409    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627412    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627414    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627417    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627419    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627422    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627425    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627427    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627430    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627432    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627435    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627437    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627440    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627442    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627444    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627447    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:59.633008 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627450    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627452    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627455    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627458    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627460    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627463    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627466    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627468    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627471    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627473    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627476    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627478    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627481    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627484    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627486    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627489    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627491    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627493    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627496    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627498    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:59.633476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627501    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627503    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627506    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627508    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627511    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627513    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627516    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627519    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627521    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:12:59.627525    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.627530    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.627643    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.631154    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.632132    2578 server.go:1019] "Starting client certificate rotation"
Sep 08 15:12:59.633983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.632230    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:12:59.634329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.632272    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:12:59.634726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.634596    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:12:59.640068 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.640043    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:12:59.651546 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.651526    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 08 15:12:59.654283 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.654270    2578 log.go:25] "Validated CRI v1 image API"
Sep 08 15:12:59.655210 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.655188    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 15:12:59.659163 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.659142    2578 fs.go:135] Filesystem UUIDs: map[0be3ae9a-b0d4-461a-bd84-83b12513c78c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c879d918-f887-4791-b2c0-42601b7e6a3d:/dev/nvme0n1p3]
Sep 08 15:12:59.659237 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.659161    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 15:12:59.659539 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.659522    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:12:59.664286 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.664175    2578 manager.go:216] Machine: {Timestamp:2026-09-08 15:12:59.662872024 +0000 UTC m=+0.322033142 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099730 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2def1725cd4db27658d2487d5b3897 SystemUUID:ec2def17-25cd-4db2-7658-d2487d5b3897 BootID:073cf236-83c4-4160-8512-4ccec615c785 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:f5:68:de:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:f5:68:de:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:5b:77:37:8a:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 15:12:59.664286 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.664278    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 15:12:59.664450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.664434    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 15:12:59.667478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.667450    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 15:12:59.667636 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.667480    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 15:12:59.668267 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.668257    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 15:12:59.668302 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.668269    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 15:12:59.668302 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.668277    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:12:59.668959 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.668948    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:12:59.669740 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.669730    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 15:12:59.672474 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.672461    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:12:59.672596 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.672573    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 15:12:59.672628 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.672622    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 15:12:59.672661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.672633    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 15:12:59.672661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.672647    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 15:12:59.672661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.672656    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 08 15:12:59.672777 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.672665    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 15:12:59.673062 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.673045    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:12:59.673124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.673076    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:12:59.676757 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.676725    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 15:12:59.679213 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.679197    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 15:12:59.679274 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.679228    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 15:12:59.680910 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680892    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680921    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680929    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680936    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680945    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680950    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680965    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680971    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 15:12:59.680989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680990    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 15:12:59.681222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.680996    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 15:12:59.681222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.681005    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 15:12:59.681222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.681010    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 15:12:59.681841 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.681829    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 15:12:59.681872 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.681843    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 15:12:59.682957 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.682921    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 15:12:59.683060 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.683036    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 15:12:59.686803 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.686785    2578 server.go:1268] "Started kubelet"
Sep 08 15:12:59.686935 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.686875    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 15:12:59.687043 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.686921    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 15:12:59.687043 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.686987    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 15:12:59.687542 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.687525    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 15:12:59.687683 ip-10-0-129-54 systemd[1]: Started Kubernetes Kubelet.
Sep 08 15:12:59.688141 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.688114    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 15:12:59.688852 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.688839    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 15:12:59.690886 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.690868    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rrdj"
Sep 08 15:12:59.692351 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.691343    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-54.ec2.internal.18d3613a38e4ee45  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-54.ec2.internal,UID:ip-10-0-129-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-54.ec2.internal,},FirstTimestamp:2026-09-08 15:12:59.686743621 +0000 UTC m=+0.345904739,LastTimestamp:2026-09-08 15:12:59.686743621 +0000 UTC m=+0.345904739,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-54.ec2.internal,}"
Sep 08 15:12:59.692797 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.692778    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 15:12:59.693029 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693014    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 15:12:59.693093 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693030    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 15:12:59.693147 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.693115    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:12:59.693595 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693565    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 15:12:59.693685 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693563    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 15:12:59.693768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693740    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 15:12:59.693898 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693886    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 15:12:59.693898 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693896    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 15:12:59.694025 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.693969    2578 factory.go:55] Registering systemd factory
Sep 08 15:12:59.694025 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.694006    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 08 15:12:59.694227 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.694213    2578 factory.go:153] Registering CRI-O factory
Sep 08 15:12:59.694276 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.694230    2578 factory.go:223] Registration of the crio container factory successfully
Sep 08 15:12:59.694321 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.694283    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 15:12:59.694321 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.694300    2578 factory.go:103] Registering Raw factory
Sep 08 15:12:59.694414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.694329    2578 manager.go:1196] Started watching for new ooms in manager
Sep 08 15:12:59.694895 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.694879    2578 manager.go:349] Starting recovery of all containers
Sep 08 15:12:59.697555 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.697501    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rrdj"
Sep 08 15:12:59.704567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.704530    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:12:59.708029 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.707885    2578 manager.go:354] Recovery completed
Sep 08 15:12:59.708300 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.708285    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-54.ec2.internal\" not found" node="ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.714780 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.714765    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:59.716665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.716647    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:59.716739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.716682    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:59.716739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.716698    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:59.717254 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.717240    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 15:12:59.717306 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.717253    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 15:12:59.717306 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.717275    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:12:59.717390 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.717314    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:59.718016 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.717998    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:59.718092 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.718027    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:59.718092 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.718039    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:59.718489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.718475    2578 policy_none.go:49] "None policy: Start"
Sep 08 15:12:59.718531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.718499    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 15:12:59.718531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.718515    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 15:12:59.719641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.719627    2578 policy_none.go:47] "Start"
Sep 08 15:12:59.745285 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.745267    2578 manager.go:337] "Starting Device Plugin manager"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.745322    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.745337    2578 server.go:87] "Starting device plugin registration server"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.745622    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.745649    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.745737    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.745894    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.745903    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.746375    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.746434    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.819164    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.820329    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.820377    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.820400    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.820435    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.823254    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.846473    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.847406    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.847436    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.847451    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.847475    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.857158    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.872781 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.857177    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-54.ec2.internal\": node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:12:59.877542 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.877512    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:12:59.920869 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.920825    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"]
Sep 08 15:12:59.920994 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.920909    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:59.922499 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.922484    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:59.922565 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.922519    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:59.922565 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.922534    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:59.923846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.923831    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:59.923972 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.923957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.924031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.923995    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:59.924573 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.924557    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:59.924666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.924605    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:59.924666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.924619    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:59.924666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.924643    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:59.924666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.924655    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:59.924666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.924621    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:59.925721 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.925706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.925801 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.925731    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:59.926425 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.926409    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:59.926510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.926437    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:59.926510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.926447    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:59.941100 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.941084    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-54.ec2.internal\" not found" node="ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.944314 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.944295    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-54.ec2.internal\" not found" node="ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.978613 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:12:59.978566    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:12:59.995691 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.995672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d0358a143f5ee61a4eab8951a3101e2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-54.ec2.internal\" (UID: \"8d0358a143f5ee61a4eab8951a3101e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.995788 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.995699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a98f563da94cdac8641418c2454a7583-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal\" (UID: \"a98f563da94cdac8641418c2454a7583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:12:59.995788 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:12:59.995716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a98f563da94cdac8641418c2454a7583-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal\" (UID: \"a98f563da94cdac8641418c2454a7583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.078812 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.078787    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.096185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.096156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d0358a143f5ee61a4eab8951a3101e2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-54.ec2.internal\" (UID: \"8d0358a143f5ee61a4eab8951a3101e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.096272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.096189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a98f563da94cdac8641418c2454a7583-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal\" (UID: \"a98f563da94cdac8641418c2454a7583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.096272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.096215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a98f563da94cdac8641418c2454a7583-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal\" (UID: \"a98f563da94cdac8641418c2454a7583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.096272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.096252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d0358a143f5ee61a4eab8951a3101e2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-54.ec2.internal\" (UID: \"8d0358a143f5ee61a4eab8951a3101e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.096369 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.096270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a98f563da94cdac8641418c2454a7583-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal\" (UID: \"a98f563da94cdac8641418c2454a7583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.096369 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.096280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a98f563da94cdac8641418c2454a7583-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal\" (UID: \"a98f563da94cdac8641418c2454a7583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.179669 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.179593    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.243076 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.243036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.248108 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.248087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:00.280048 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.280013    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.380495 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.380461    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.480930 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.480905    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.581334 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.581305    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.631747 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.631721    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 15:13:00.632125 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.631852    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 15:13:00.632125 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.631883    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 15:13:00.682300 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.682093    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.701773 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.701728    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 15:07:59 +0000 UTC" deadline="2028-05-05 04:04:59.875528005 +0000 UTC"
Sep 08 15:13:00.701773 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.701769    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14508h51m59.173762886s"
Sep 08 15:13:00.782562 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.782500    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.797381 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:00.797346    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0358a143f5ee61a4eab8951a3101e2.slice/crio-b48261d6a1306203ae13c2ffec9a7e39486440dab3037a7fc4064c570e4fd322 WatchSource:0}: Error finding container b48261d6a1306203ae13c2ffec9a7e39486440dab3037a7fc4064c570e4fd322: Status 404 returned error can't find the container with id b48261d6a1306203ae13c2ffec9a7e39486440dab3037a7fc4064c570e4fd322
Sep 08 15:13:00.797786 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:00.797765    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98f563da94cdac8641418c2454a7583.slice/crio-33f1bec1312e9f070279f78d7cb3e9599e70bc4e218907b1f221cf12c13761ba WatchSource:0}: Error finding container 33f1bec1312e9f070279f78d7cb3e9599e70bc4e218907b1f221cf12c13761ba: Status 404 returned error can't find the container with id 33f1bec1312e9f070279f78d7cb3e9599e70bc4e218907b1f221cf12c13761ba
Sep 08 15:13:00.802825 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.802808    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:13:00.823653 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.823606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal" event={"ID":"8d0358a143f5ee61a4eab8951a3101e2","Type":"ContainerStarted","Data":"b48261d6a1306203ae13c2ffec9a7e39486440dab3037a7fc4064c570e4fd322"}
Sep 08 15:13:00.824634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:00.824615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal" event={"ID":"a98f563da94cdac8641418c2454a7583","Type":"ContainerStarted","Data":"33f1bec1312e9f070279f78d7cb3e9599e70bc4e218907b1f221cf12c13761ba"}
Sep 08 15:13:00.882768 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.882733    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:00.983109 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:00.983081    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:01.083254 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.083169    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:01.087418 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.087396    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:13:01.184121 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.184094    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-54.ec2.internal\" not found"
Sep 08 15:13:01.228073 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.228029    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:13:01.293546 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.293363    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:01.301299 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.301255    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:13:01.302308 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.302287    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal"
Sep 08 15:13:01.313706 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.313682    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:13:01.653719 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.653687    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:13:01.673757 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.673728    2578 apiserver.go:52] "Watching apiserver"
Sep 08 15:13:01.682987 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.682959    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 15:13:01.683393 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.683368    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-8bwml","kube-system/global-pull-secret-syncer-2qjpj","kube-system/konnectivity-agent-7628m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj","openshift-image-registry/node-ca-nmt7d","openshift-multus/multus-additional-cni-plugins-pzb9z","openshift-multus/multus-wh4rg","openshift-multus/network-metrics-daemon-qrzdq","openshift-network-diagnostics/network-check-target-8xphl","kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pmwxw","openshift-dns/node-resolver-pqx66","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal","openshift-network-operator/iptables-alerter-5j2ss"]
Sep 08 15:13:01.685062 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.685037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.686156 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.686133    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.687376 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.687345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:01.687894 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.687873    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 15:13:01.688132 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.688115    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 15:13:01.688403 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.688379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:13:01.688485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.688389    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 15:13:01.688543 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.688498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 15:13:01.688751 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.688732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.688838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.688750    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6gm8\""
Sep 08 15:13:01.689194 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.689178    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 15:13:01.689361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.689339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sg6pd\""
Sep 08 15:13:01.690035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.689832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 15:13:01.690035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.689836    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jshnn\""
Sep 08 15:13:01.690035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.689946    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 15:13:01.690224 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.690207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.691177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.691045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-shvbl\""
Sep 08 15:13:01.691177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.691060    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 15:13:01.691177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.691101    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 15:13:01.691372 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.691198    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 15:13:01.691534 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.691518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.692398 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.692356    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bnh8h\""
Sep 08 15:13:01.692498 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.692477    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 15:13:01.692755 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.692700    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 15:13:01.692894 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.692873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:01.692994 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.692943    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:01.693396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.693232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 15:13:01.693396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.693353    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 15:13:01.693548 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.693530    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 15:13:01.694226 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.694056    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wwkxw\""
Sep 08 15:13:01.694226 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.694184    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 15:13:01.694684 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.694665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.696107 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.696092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.696198 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.696146    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:01.696690 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.696671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:13:01.697055 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.697039    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 15:13:01.697055 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.697050    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 15:13:01.697182 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.697069    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vxps2\""
Sep 08 15:13:01.697409 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.697394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:01.697503 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.697462    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:01.698931 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.698901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.700250 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.700230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.701734 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.701715    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 15:13:01.701823 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.701717    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 15:13:01.701982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.701967    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 15:13:01.702049 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.702032    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 15:13:01.702096 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.702087    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 15:13:01.702170 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.702153    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-79wnw\""
Sep 08 15:13:01.702170 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.702164    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 15:13:01.702466 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.702434    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9c76\""
Sep 08 15:13:01.702466 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.702434    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 15:13:01.702940 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.702921    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 15:13:01.704365 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7fb0085-184d-4787-abc4-87d4dcdcc09c-serviceca\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.704467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/d7fb0085-184d-4787-abc4-87d4dcdcc09c-kube-api-access-wkbcm\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.704467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65118f5a-b030-45d0-a814-64f48c43ecd3-agent-certs\") pod \"konnectivity-agent-7628m\" (UID: \"65118f5a-b030-45d0-a814-64f48c43ecd3\") " pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:01.704467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:01.704467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-host-slash\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.704708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-socket-dir-parent\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.704708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-hostroot\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.704708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysctl-d\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.704708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-run\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.704708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-cni-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.704708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysconfig\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.704708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-sys\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65118f5a-b030-45d0-a814-64f48c43ecd3-konnectivity-ca\") pod \"konnectivity-agent-7628m\" (UID: \"65118f5a-b030-45d0-a814-64f48c43ecd3\") " pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-socket-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-netns\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-modprobe-d\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-tuned\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-tmp\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7fb0085-184d-4787-abc4-87d4dcdcc09c-host\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cnibin\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.704964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-registration-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.705045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-device-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-sys-fs\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swvv8\" (UniqueName: \"kubernetes.io/projected/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-kube-api-access-swvv8\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-cni-multus\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-system-cni-dir\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-iptables-alerter-script\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-conf-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-etc-kubernetes\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc72c\" (UniqueName: \"kubernetes.io/projected/03554dff-f02a-46ab-aa36-d614bbb909cf-kube-api-access-bc72c\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-kubernetes\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxm2m\" (UniqueName: \"kubernetes.io/projected/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-kube-api-access-lxm2m\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-system-cni-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-k8s-cni-cncf-io\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.705634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-cni-bin\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-kubelet\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysctl-conf\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-systemd\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgsz\" (UniqueName: \"kubernetes.io/projected/a6e8db2d-f735-490d-a1e8-0c0d096f3590-kube-api-access-pvgsz\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-cnibin\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-multus-certs\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-lib-modules\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-host\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03554dff-f02a-46ab-aa36-d614bbb909cf-cni-binary-copy\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-daemon-config\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-var-lib-kubelet\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.705776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr89n\" (UniqueName: \"kubernetes.io/projected/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-kube-api-access-rr89n\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.706378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.706110    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:13:01.729970 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.729948    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s9njp"
Sep 08 15:13:01.738304 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.738280    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s9njp"
Sep 08 15:13:01.794958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.794927    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 15:13:01.806551 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.806728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxm2m\" (UniqueName: \"kubernetes.io/projected/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-kube-api-access-lxm2m\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.806728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-system-cni-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.806728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-cni-bin\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.806728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-kubelet-config\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.806728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-host\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.806728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.806728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806720    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-cni-bin\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-host\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-system-cni-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-dbus\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03554dff-f02a-46ab-aa36-d614bbb909cf-cni-binary-copy\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.806996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-daemon-config\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/d7fb0085-184d-4787-abc4-87d4dcdcc09c-kube-api-access-wkbcm\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-systemd-units\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.807128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-hostroot\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysctl-d\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-run\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-sys\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4335589-749e-4577-9e80-bf1f026e392b-tmp-dir\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-hostroot\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-systemd\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-ovn\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-sys\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovnkube-script-lib\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-netns\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.807502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-netns\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-modprobe-d\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-run\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03554dff-f02a-46ab-aa36-d614bbb909cf-cni-binary-copy\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysctl-d\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-var-lib-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-modprobe-d\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-log-socket\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovn-node-metrics-cert\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cnibin\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cnibin\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-device-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-device-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.808090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-etc-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807932    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-daemon-config\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.807975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-iptables-alerter-script\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-conf-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc72c\" (UniqueName: \"kubernetes.io/projected/03554dff-f02a-46ab-aa36-d614bbb909cf-kube-api-access-bc72c\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-kubernetes\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysctl-conf\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-node-log\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-cni-netd\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-lib-modules\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-conf-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-k8s-cni-cncf-io\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-kubelet\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-k8s-cni-cncf-io\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysctl-conf\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.808847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgsz\" (UniqueName: \"kubernetes.io/projected/a6e8db2d-f735-490d-a1e8-0c0d096f3590-kube-api-access-pvgsz\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-cnibin\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-multus-certs\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-lib-modules\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4335589-749e-4577-9e80-bf1f026e392b-hosts-file\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-kubelet\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-kubelet\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-cnibin\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-env-overrides\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-kubernetes\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-run-multus-certs\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-iptables-alerter-script\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-var-lib-kubelet\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7fb0085-184d-4787-abc4-87d4dcdcc09c-serviceca\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.809698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-var-lib-kubelet\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65118f5a-b030-45d0-a814-64f48c43ecd3-agent-certs\") pod \"konnectivity-agent-7628m\" (UID: \"65118f5a-b030-45d0-a814-64f48c43ecd3\") " pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-host-slash\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-socket-dir-parent\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovnkube-config\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-host-slash\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-cni-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysconfig\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-socket-dir-parent\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7z4k\" (UniqueName: \"kubernetes.io/projected/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-kube-api-access-r7z4k\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65118f5a-b030-45d0-a814-64f48c43ecd3-konnectivity-ca\") pod \"konnectivity-agent-7628m\" (UID: \"65118f5a-b030-45d0-a814-64f48c43ecd3\") " pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-sysconfig\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.808996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7fb0085-184d-4787-abc4-87d4dcdcc09c-serviceca\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-socket-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809031    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-tuned\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.810438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-multus-cni-dir\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-tmp\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7fb0085-184d-4787-abc4-87d4dcdcc09c-host\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-776kl\" (UniqueName: \"kubernetes.io/projected/e4335589-749e-4577-9e80-bf1f026e392b-kube-api-access-776kl\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-slash\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-socket-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7fb0085-184d-4787-abc4-87d4dcdcc09c-host\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-registration-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65118f5a-b030-45d0-a814-64f48c43ecd3-konnectivity-ca\") pod \"konnectivity-agent-7628m\" (UID: \"65118f5a-b030-45d0-a814-64f48c43ecd3\") " pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-sys-fs\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swvv8\" (UniqueName: \"kubernetes.io/projected/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-kube-api-access-swvv8\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-registration-dir\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-cni-multus\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-run-netns\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-sys-fs\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr89n\" (UniqueName: \"kubernetes.io/projected/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-kube-api-access-rr89n\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-system-cni-dir\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.811212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-etc-kubernetes\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-systemd\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809549    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6e8db2d-f735-490d-a1e8-0c0d096f3590-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-host-var-lib-cni-multus\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03554dff-f02a-46ab-aa36-d614bbb909cf-etc-kubernetes\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-cni-bin\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-system-cni-dir\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-systemd\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vlmx\" (UniqueName: \"kubernetes.io/projected/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-kube-api-access-8vlmx\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.811911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.809782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6e8db2d-f735-490d-a1e8-0c0d096f3590-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.813287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.813137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-etc-tuned\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.813287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.813189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-tmp\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.813428 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.813416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65118f5a-b030-45d0-a814-64f48c43ecd3-agent-certs\") pod \"konnectivity-agent-7628m\" (UID: \"65118f5a-b030-45d0-a814-64f48c43ecd3\") " pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:01.814164 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.814144    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:01.814271 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.814170    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:01.814271 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.814184    2578 projected.go:196] Error preparing data for projected volume kube-api-access-q54h2 for pod openshift-network-diagnostics/network-check-target-8xphl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:01.814271 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.814244    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2 podName:b3e698d3-ff4e-45ec-ab17-1b87cf823bb3 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:02.314224243 +0000 UTC m=+2.973385369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q54h2" (UniqueName: "kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2") pod "network-check-target-8xphl" (UID: "b3e698d3-ff4e-45ec-ab17-1b87cf823bb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:01.815742 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.815715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/d7fb0085-184d-4787-abc4-87d4dcdcc09c-kube-api-access-wkbcm\") pod \"node-ca-nmt7d\" (UID: \"d7fb0085-184d-4787-abc4-87d4dcdcc09c\") " pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:01.816532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.816432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxm2m\" (UniqueName: \"kubernetes.io/projected/f0d6c832-48b9-4bfe-8a40-a0604beb4d28-kube-api-access-lxm2m\") pod \"aws-ebs-csi-driver-node-8j4xj\" (UID: \"f0d6c832-48b9-4bfe-8a40-a0604beb4d28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:01.816885 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.816836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgsz\" (UniqueName: \"kubernetes.io/projected/a6e8db2d-f735-490d-a1e8-0c0d096f3590-kube-api-access-pvgsz\") pod \"multus-additional-cni-plugins-pzb9z\" (UID: \"a6e8db2d-f735-490d-a1e8-0c0d096f3590\") " pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:01.816969 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.816919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swvv8\" (UniqueName: \"kubernetes.io/projected/2ff7d48a-32f2-45ab-8211-8b7f07d52ebf-kube-api-access-swvv8\") pod \"iptables-alerter-5j2ss\" (UID: \"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf\") " pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:01.817354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.817331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc72c\" (UniqueName: \"kubernetes.io/projected/03554dff-f02a-46ab-aa36-d614bbb909cf-kube-api-access-bc72c\") pod \"multus-wh4rg\" (UID: \"03554dff-f02a-46ab-aa36-d614bbb909cf\") " pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.818245 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.818224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr89n\" (UniqueName: \"kubernetes.io/projected/08e10792-d0b2-4865-b6dc-dca79a6dc6b1-kube-api-access-rr89n\") pod \"tuned-pmwxw\" (UID: \"08e10792-d0b2-4865-b6dc-dca79a6dc6b1\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:01.910041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.909956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-etc-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.909997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-node-log\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-cni-netd\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-cni-netd\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-node-log\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-etc-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4335589-749e-4577-9e80-bf1f026e392b-hosts-file\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-kubelet\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-env-overrides\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4335589-749e-4577-9e80-bf1f026e392b-hosts-file\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovnkube-config\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-kubelet\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z4k\" (UniqueName: \"kubernetes.io/projected/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-kube-api-access-r7z4k\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-776kl\" (UniqueName: \"kubernetes.io/projected/e4335589-749e-4577-9e80-bf1f026e392b-kube-api-access-776kl\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-slash\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-run-netns\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-cni-bin\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vlmx\" (UniqueName: \"kubernetes.io/projected/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-kube-api-access-8vlmx\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-kubelet-config\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-dbus\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-systemd-units\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4335589-749e-4577-9e80-bf1f026e392b-tmp-dir\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-systemd\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-cni-bin\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.910764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-ovn\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-ovn\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-systemd-units\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovnkube-script-lib\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-var-lib-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-log-socket\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-kubelet-config\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovn-node-metrics-cert\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-dbus\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-run-systemd\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.910929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4335589-749e-4577-9e80-bf1f026e392b-tmp-dir\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.910993    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.911008    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-log-socket\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.911046    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret podName:7a5fa953-84c7-4b92-b1e0-b78a8d2ef623 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:02.411032855 +0000 UTC m=+3.070193960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret") pod "global-pull-secret-syncer-2qjpj" (UID: "7a5fa953-84c7-4b92-b1e0-b78a8d2ef623") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:01.911524 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:01.911060    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs podName:7a794bf5-8ad3-4021-bbef-ef64dd10cfaa nodeName:}" failed. No retries permitted until 2026-09-08 15:13:02.411054051 +0000 UTC m=+3.070215156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs") pod "network-metrics-daemon-qrzdq" (UID: "7a794bf5-8ad3-4021-bbef-ef64dd10cfaa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:01.912239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-var-lib-openvswitch\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.912239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.912239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-slash\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.912239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-host-run-netns\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.912239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-env-overrides\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.912239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovnkube-config\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.912239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.911897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovnkube-script-lib\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.913732 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.913709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-ovn-node-metrics-cert\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.921678 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.921651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vlmx\" (UniqueName: \"kubernetes.io/projected/2d3f3324-7399-4c56-b7c0-ac5c93f3dab9-kube-api-access-8vlmx\") pod \"ovnkube-node-8bwml\" (UID: \"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:01.922101 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.922074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-776kl\" (UniqueName: \"kubernetes.io/projected/e4335589-749e-4577-9e80-bf1f026e392b-kube-api-access-776kl\") pod \"node-resolver-pqx66\" (UID: \"e4335589-749e-4577-9e80-bf1f026e392b\") " pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:01.922278 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.922260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7z4k\" (UniqueName: \"kubernetes.io/projected/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-kube-api-access-r7z4k\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:01.997796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.997767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wh4rg"
Sep 08 15:13:01.999174 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:01.999148    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:13:02.004689 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.004665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nmt7d"
Sep 08 15:13:02.016739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.016710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmwxw"
Sep 08 15:13:02.021270 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.021249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:02.027785 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.027768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj"
Sep 08 15:13:02.036329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.036312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pzb9z"
Sep 08 15:13:02.044068 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.044051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5j2ss"
Sep 08 15:13:02.051859 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.051842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:02.056807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.056789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pqx66"
Sep 08 15:13:02.414598 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.414543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:02.414789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.414604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:02.414789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.414648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:02.414789 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414717    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:02.414789 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414737    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:02.414789 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414750    2578 projected.go:196] Error preparing data for projected volume kube-api-access-q54h2 for pod openshift-network-diagnostics/network-check-target-8xphl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:02.414789 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414769    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:02.414789 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414781    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:02.415140 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414810    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret podName:7a5fa953-84c7-4b92-b1e0-b78a8d2ef623 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:03.414793276 +0000 UTC m=+4.073954395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret") pod "global-pull-secret-syncer-2qjpj" (UID: "7a5fa953-84c7-4b92-b1e0-b78a8d2ef623") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:02.415140 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414826    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2 podName:b3e698d3-ff4e-45ec-ab17-1b87cf823bb3 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:03.414817788 +0000 UTC m=+4.073978896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q54h2" (UniqueName: "kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2") pod "network-check-target-8xphl" (UID: "b3e698d3-ff4e-45ec-ab17-1b87cf823bb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:02.415140 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.414858    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs podName:7a794bf5-8ad3-4021-bbef-ef64dd10cfaa nodeName:}" failed. No retries permitted until 2026-09-08 15:13:03.414838703 +0000 UTC m=+4.073999832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs") pod "network-metrics-daemon-qrzdq" (UID: "7a794bf5-8ad3-4021-bbef-ef64dd10cfaa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:02.569334 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.569278    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e10792_d0b2_4865_b6dc_dca79a6dc6b1.slice/crio-ba5abc5af1c38961cd1459d828c2abc59ef6f79181a56f3989f542d29b99d3d0 WatchSource:0}: Error finding container ba5abc5af1c38961cd1459d828c2abc59ef6f79181a56f3989f542d29b99d3d0: Status 404 returned error can't find the container with id ba5abc5af1c38961cd1459d828c2abc59ef6f79181a56f3989f542d29b99d3d0
Sep 08 15:13:02.571120 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.571094    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3f3324_7399_4c56_b7c0_ac5c93f3dab9.slice/crio-6fae8d773e120cd4fe119672119f00397950ab707bd5a6916184fd7937e80049 WatchSource:0}: Error finding container 6fae8d773e120cd4fe119672119f00397950ab707bd5a6916184fd7937e80049: Status 404 returned error can't find the container with id 6fae8d773e120cd4fe119672119f00397950ab707bd5a6916184fd7937e80049
Sep 08 15:13:02.571730 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.571698    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e8db2d_f735_490d_a1e8_0c0d096f3590.slice/crio-96e3af57ea63019493544c9b7f5ce9d6a1cd60c05733cd404d4015ba4c24d4d6 WatchSource:0}: Error finding container 96e3af57ea63019493544c9b7f5ce9d6a1cd60c05733cd404d4015ba4c24d4d6: Status 404 returned error can't find the container with id 96e3af57ea63019493544c9b7f5ce9d6a1cd60c05733cd404d4015ba4c24d4d6
Sep 08 15:13:02.572485 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.572447    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03554dff_f02a_46ab_aa36_d614bbb909cf.slice/crio-d41c7297e9cc190a1e5bb0a40ef751b868895d57262951d527008636d1afaa6a WatchSource:0}: Error finding container d41c7297e9cc190a1e5bb0a40ef751b868895d57262951d527008636d1afaa6a: Status 404 returned error can't find the container with id d41c7297e9cc190a1e5bb0a40ef751b868895d57262951d527008636d1afaa6a
Sep 08 15:13:02.576299 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.576276    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fb0085_184d_4787_abc4_87d4dcdcc09c.slice/crio-b88d432b8cacdfcf82c8a49c5cd5105e78b2963e385cfe637ad68bf5c0237d5a WatchSource:0}: Error finding container b88d432b8cacdfcf82c8a49c5cd5105e78b2963e385cfe637ad68bf5c0237d5a: Status 404 returned error can't find the container with id b88d432b8cacdfcf82c8a49c5cd5105e78b2963e385cfe637ad68bf5c0237d5a
Sep 08 15:13:02.577390 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.577366    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff7d48a_32f2_45ab_8211_8b7f07d52ebf.slice/crio-07572d77e7e34832d83ce4cd5c6ca821d14b0a673db669f8ff446c61883b5be1 WatchSource:0}: Error finding container 07572d77e7e34832d83ce4cd5c6ca821d14b0a673db669f8ff446c61883b5be1: Status 404 returned error can't find the container with id 07572d77e7e34832d83ce4cd5c6ca821d14b0a673db669f8ff446c61883b5be1
Sep 08 15:13:02.578481 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.578459    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4335589_749e_4577_9e80_bf1f026e392b.slice/crio-89b52c1b032ad17d587d4c3b26145a07897e46387e3b60d48e441903467fed41 WatchSource:0}: Error finding container 89b52c1b032ad17d587d4c3b26145a07897e46387e3b60d48e441903467fed41: Status 404 returned error can't find the container with id 89b52c1b032ad17d587d4c3b26145a07897e46387e3b60d48e441903467fed41
Sep 08 15:13:02.579304 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.579106    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d6c832_48b9_4bfe_8a40_a0604beb4d28.slice/crio-b84af49ff603763f7c10748c209e6a14daf76978c1b787f2cc207a57b62f1a23 WatchSource:0}: Error finding container b84af49ff603763f7c10748c209e6a14daf76978c1b787f2cc207a57b62f1a23: Status 404 returned error can't find the container with id b84af49ff603763f7c10748c209e6a14daf76978c1b787f2cc207a57b62f1a23
Sep 08 15:13:02.580821 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:02.580795    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65118f5a_b030_45d0_a814_64f48c43ecd3.slice/crio-2b95b48a609f85dadd15dae31edd17973c99e86d5314f45c3875ac08a73a86ae WatchSource:0}: Error finding container 2b95b48a609f85dadd15dae31edd17973c99e86d5314f45c3875ac08a73a86ae: Status 404 returned error can't find the container with id 2b95b48a609f85dadd15dae31edd17973c99e86d5314f45c3875ac08a73a86ae
Sep 08 15:13:02.741354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.741310    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:08:01 +0000 UTC" deadline="2028-02-11 07:01:43.087365763 +0000 UTC"
Sep 08 15:13:02.741354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.741341    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12495h48m40.346027384s"
Sep 08 15:13:02.820917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.820897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:02.821014 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:02.820997    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:02.828488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.828462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5j2ss" event={"ID":"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf","Type":"ContainerStarted","Data":"07572d77e7e34832d83ce4cd5c6ca821d14b0a673db669f8ff446c61883b5be1"}
Sep 08 15:13:02.829795 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.829772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerStarted","Data":"96e3af57ea63019493544c9b7f5ce9d6a1cd60c05733cd404d4015ba4c24d4d6"}
Sep 08 15:13:02.830958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.830933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nmt7d" event={"ID":"d7fb0085-184d-4787-abc4-87d4dcdcc09c","Type":"ContainerStarted","Data":"b88d432b8cacdfcf82c8a49c5cd5105e78b2963e385cfe637ad68bf5c0237d5a"}
Sep 08 15:13:02.832045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.832024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmwxw" event={"ID":"08e10792-d0b2-4865-b6dc-dca79a6dc6b1","Type":"ContainerStarted","Data":"ba5abc5af1c38961cd1459d828c2abc59ef6f79181a56f3989f542d29b99d3d0"}
Sep 08 15:13:02.833156 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.833129    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7628m" event={"ID":"65118f5a-b030-45d0-a814-64f48c43ecd3","Type":"ContainerStarted","Data":"2b95b48a609f85dadd15dae31edd17973c99e86d5314f45c3875ac08a73a86ae"}
Sep 08 15:13:02.834380 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.834362    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj" event={"ID":"f0d6c832-48b9-4bfe-8a40-a0604beb4d28","Type":"ContainerStarted","Data":"b84af49ff603763f7c10748c209e6a14daf76978c1b787f2cc207a57b62f1a23"}
Sep 08 15:13:02.835493 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.835473    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wh4rg" event={"ID":"03554dff-f02a-46ab-aa36-d614bbb909cf","Type":"ContainerStarted","Data":"d41c7297e9cc190a1e5bb0a40ef751b868895d57262951d527008636d1afaa6a"}
Sep 08 15:13:02.836699 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.836674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"6fae8d773e120cd4fe119672119f00397950ab707bd5a6916184fd7937e80049"}
Sep 08 15:13:02.838484 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.838460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal" event={"ID":"8d0358a143f5ee61a4eab8951a3101e2","Type":"ContainerStarted","Data":"5e0a5b1646f4db305d7fc893c35dab6a143f6fe0d2eabca3c982595f53dc2180"}
Sep 08 15:13:02.839869 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.839848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal" event={"ID":"a98f563da94cdac8641418c2454a7583","Type":"ContainerStarted","Data":"e3f98cd3002fddc1bff33941a06c6ce9c286c28bf145282f11a7a6bef6cad759"}
Sep 08 15:13:02.840891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.840872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pqx66" event={"ID":"e4335589-749e-4577-9e80-bf1f026e392b","Type":"ContainerStarted","Data":"89b52c1b032ad17d587d4c3b26145a07897e46387e3b60d48e441903467fed41"}
Sep 08 15:13:02.851562 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:02.851520    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-54.ec2.internal" podStartSLOduration=1.851484989 podStartE2EDuration="1.851484989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:02.851281786 +0000 UTC m=+3.510442916" watchObservedRunningTime="2026-09-08 15:13:02.851484989 +0000 UTC m=+3.510646115"
Sep 08 15:13:03.425812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.425772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:03.426041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.425831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:03.426041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.425860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:03.426041 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.425984    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:03.426194 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.426054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret podName:7a5fa953-84c7-4b92-b1e0-b78a8d2ef623 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:05.426037241 +0000 UTC m=+6.085198365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret") pod "global-pull-secret-syncer-2qjpj" (UID: "7a5fa953-84c7-4b92-b1e0-b78a8d2ef623") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:03.426484 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.426464    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:03.426562 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.426489    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:03.426562 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.426503    2578 projected.go:196] Error preparing data for projected volume kube-api-access-q54h2 for pod openshift-network-diagnostics/network-check-target-8xphl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:03.426562 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.426545    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2 podName:b3e698d3-ff4e-45ec-ab17-1b87cf823bb3 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:05.426531117 +0000 UTC m=+6.085692223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q54h2" (UniqueName: "kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2") pod "network-check-target-8xphl" (UID: "b3e698d3-ff4e-45ec-ab17-1b87cf823bb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:03.426752 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.426621    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:03.426752 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.426656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs podName:7a794bf5-8ad3-4021-bbef-ef64dd10cfaa nodeName:}" failed. No retries permitted until 2026-09-08 15:13:05.426644239 +0000 UTC m=+6.085805344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs") pod "network-metrics-daemon-qrzdq" (UID: "7a794bf5-8ad3-4021-bbef-ef64dd10cfaa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:03.741545 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.741485    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:08:01 +0000 UTC" deadline="2028-05-02 08:47:46.737763549 +0000 UTC"
Sep 08 15:13:03.741545 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.741543    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14441h34m42.996224451s"
Sep 08 15:13:03.823726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.823692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:03.823895 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.823817    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:03.824293 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.824270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:03.824408 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:03.824367    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:03.851003 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.849856    2578 generic.go:356] "Generic (PLEG): container finished" podID="a98f563da94cdac8641418c2454a7583" containerID="e3f98cd3002fddc1bff33941a06c6ce9c286c28bf145282f11a7a6bef6cad759" exitCode=0
Sep 08 15:13:03.851003 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:03.850778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal" event={"ID":"a98f563da94cdac8641418c2454a7583","Type":"ContainerDied","Data":"e3f98cd3002fddc1bff33941a06c6ce9c286c28bf145282f11a7a6bef6cad759"}
Sep 08 15:13:04.821904 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:04.821657    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:04.822351 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:04.822038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:04.860528 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:04.859787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal" event={"ID":"a98f563da94cdac8641418c2454a7583","Type":"ContainerStarted","Data":"24bb9fe0ab6cacbf5202d0c8ab3d0fdac42473203e6a301243ebeb57f0210e8a"}
Sep 08 15:13:05.441838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:05.441797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:05.442030 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:05.441859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:05.442030 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:05.441890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:05.442030 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.441946    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:05.442030 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.441975    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:05.442030 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.441987    2578 projected.go:196] Error preparing data for projected volume kube-api-access-q54h2 for pod openshift-network-diagnostics/network-check-target-8xphl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:05.442030 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.442004    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:05.442030 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.442023    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:05.442323 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.442055    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2 podName:b3e698d3-ff4e-45ec-ab17-1b87cf823bb3 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:09.442034959 +0000 UTC m=+10.101196081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q54h2" (UniqueName: "kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2") pod "network-check-target-8xphl" (UID: "b3e698d3-ff4e-45ec-ab17-1b87cf823bb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:05.442323 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.442075    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs podName:7a794bf5-8ad3-4021-bbef-ef64dd10cfaa nodeName:}" failed. No retries permitted until 2026-09-08 15:13:09.442065824 +0000 UTC m=+10.101226931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs") pod "network-metrics-daemon-qrzdq" (UID: "7a794bf5-8ad3-4021-bbef-ef64dd10cfaa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:05.442323 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.442091    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret podName:7a5fa953-84c7-4b92-b1e0-b78a8d2ef623 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:09.442081649 +0000 UTC m=+10.101242756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret") pod "global-pull-secret-syncer-2qjpj" (UID: "7a5fa953-84c7-4b92-b1e0-b78a8d2ef623") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:05.821281 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:05.821249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:05.821439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:05.821284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:05.821439 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.821400    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:05.821563 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:05.821532    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:06.821128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:06.821093    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:06.821707 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:06.821245    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:07.821076 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:07.821039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:07.821353 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:07.821182    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:07.821856 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:07.821680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:07.821856 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:07.821790    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:08.821809 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:08.821300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:08.821809 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:08.821443    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.474020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.474078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.474109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474239    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474258    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474282    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474294    2578 projected.go:196] Error preparing data for projected volume kube-api-access-q54h2 for pod openshift-network-diagnostics/network-check-target-8xphl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474309    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret podName:7a5fa953-84c7-4b92-b1e0-b78a8d2ef623 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:17.474289981 +0000 UTC m=+18.133451101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret") pod "global-pull-secret-syncer-2qjpj" (UID: "7a5fa953-84c7-4b92-b1e0-b78a8d2ef623") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474239    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:09.474366 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474347    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2 podName:b3e698d3-ff4e-45ec-ab17-1b87cf823bb3 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:17.474328949 +0000 UTC m=+18.133490074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q54h2" (UniqueName: "kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2") pod "network-check-target-8xphl" (UID: "b3e698d3-ff4e-45ec-ab17-1b87cf823bb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:09.475082 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.474390    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs podName:7a794bf5-8ad3-4021-bbef-ef64dd10cfaa nodeName:}" failed. No retries permitted until 2026-09-08 15:13:17.474376822 +0000 UTC m=+18.133537940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs") pod "network-metrics-daemon-qrzdq" (UID: "7a794bf5-8ad3-4021-bbef-ef64dd10cfaa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:09.820985 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.820803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:09.823312 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.822679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:09.823312 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.822787    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:09.823312 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:09.822991    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:09.875553 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.875511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7628m" event={"ID":"65118f5a-b030-45d0-a814-64f48c43ecd3","Type":"ContainerStarted","Data":"336ebb41bb171bd6d4fb6dbbc6f346706f972e4236b101dfa1a920284381acfa"}
Sep 08 15:13:09.881883 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.881810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj" event={"ID":"f0d6c832-48b9-4bfe-8a40-a0604beb4d28","Type":"ContainerStarted","Data":"857b273e2f24f0025130e7dad4232e08960cb4cfc58f04541919447a855ee224"}
Sep 08 15:13:09.885366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.884616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pqx66" event={"ID":"e4335589-749e-4577-9e80-bf1f026e392b","Type":"ContainerStarted","Data":"d8c3e85529d9b0e5db6834adb2c36ad7f7eb0b756d3d3ae2796bb18e7f878612"}
Sep 08 15:13:09.890361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.889910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerStarted","Data":"6371353bfd372123e5d137da5cef14d64de186c4132c0099360bebf0c175dc15"}
Sep 08 15:13:09.890361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.889946    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-54.ec2.internal" podStartSLOduration=8.889929249 podStartE2EDuration="8.889929249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:04.875600226 +0000 UTC m=+5.534761351" watchObservedRunningTime="2026-09-08 15:13:09.889929249 +0000 UTC m=+10.549090377"
Sep 08 15:13:09.890361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.890285    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7628m" podStartSLOduration=3.838884458 podStartE2EDuration="10.890278899s" totalImagesPullingTime="7.051394441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:09.889601999 +0000 UTC m=+10.548763129" watchObservedRunningTime="2026-09-08 15:13:09.890278899 +0000 UTC m=+10.549440027"
Sep 08 15:13:09.893378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.892997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nmt7d" event={"ID":"d7fb0085-184d-4787-abc4-87d4dcdcc09c","Type":"ContainerStarted","Data":"bcbd73669992f71756e10da3beafce72df9e66f831ef4444892b8fabe57c9f47"}
Sep 08 15:13:09.905171 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.905060    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pqx66" podStartSLOduration=3.844773513 podStartE2EDuration="10.905045144s" totalImagesPullingTime="7.060271631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:09.904807172 +0000 UTC m=+10.563968298" watchObservedRunningTime="2026-09-08 15:13:09.905045144 +0000 UTC m=+10.564206271"
Sep 08 15:13:09.936777 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:09.936722    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nmt7d" podStartSLOduration=3.8816557229999997 podStartE2EDuration="10.936701378s" totalImagesPullingTime="7.055045655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:09.936567585 +0000 UTC m=+10.595728712" watchObservedRunningTime="2026-09-08 15:13:09.936701378 +0000 UTC m=+10.595862506"
Sep 08 15:13:10.821095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:10.820942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:10.821095 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:10.821078    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:10.897429 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:10.897310    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6e8db2d-f735-490d-a1e8-0c0d096f3590" containerID="6371353bfd372123e5d137da5cef14d64de186c4132c0099360bebf0c175dc15" exitCode=0
Sep 08 15:13:10.897963 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:10.897421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerDied","Data":"6371353bfd372123e5d137da5cef14d64de186c4132c0099360bebf0c175dc15"}
Sep 08 15:13:11.821518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:11.821017    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:11.821518 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:11.821159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:11.821518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:11.821205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:11.821518 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:11.821313    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:11.902122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:11.902083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5j2ss" event={"ID":"2ff7d48a-32f2-45ab-8211-8b7f07d52ebf","Type":"ContainerStarted","Data":"2499f0a409db1670e4a4942b4a613d947aabb4bf676a19276d85f65ebd89c947"}
Sep 08 15:13:12.124864 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:12.124785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:12.286043 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:12.286006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:12.820881 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:12.820846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:12.821067 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:12.820959    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:12.825941 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:12.825912    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:12.827059 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:12.827034    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:12.841778 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:12.841736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5j2ss" podStartSLOduration=6.787659235 podStartE2EDuration="13.84172s" totalImagesPullingTime="7.054060765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:11.929046705 +0000 UTC m=+12.588207833" watchObservedRunningTime="2026-09-08 15:13:12.84172 +0000 UTC m=+13.500881128"
Sep 08 15:13:13.821451 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:13.821287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:13.821451 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:13.821394    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:13.821953 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:13.821614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:13.821953 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:13.821721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:14.630360 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:14.630321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:14.684213 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:14.684183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:14.751418 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:14.751371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:14.821658 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:14.821448    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:14.822057 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:14.821747    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:15.567309 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:15.567271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:15.668075 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:15.668028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:15.821222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:15.821149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:15.821222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:15.821185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:15.821408 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:15.821298    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:15.821408 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:15.821393    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:16.507921 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:16.507853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:16.821170 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:16.821084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:16.821436 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:16.821214    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:17.532941 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:17.532907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:17.532941 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:17.532948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:17.532967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533089    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533104    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533129    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533133    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533143    2578 projected.go:196] Error preparing data for projected volume kube-api-access-q54h2 for pod openshift-network-diagnostics/network-check-target-8xphl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533156    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret podName:7a5fa953-84c7-4b92-b1e0-b78a8d2ef623 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:33.533137773 +0000 UTC m=+34.192298879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret") pod "global-pull-secret-syncer-2qjpj" (UID: "7a5fa953-84c7-4b92-b1e0-b78a8d2ef623") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533174    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs podName:7a794bf5-8ad3-4021-bbef-ef64dd10cfaa nodeName:}" failed. No retries permitted until 2026-09-08 15:13:33.533164715 +0000 UTC m=+34.192325819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs") pod "network-metrics-daemon-qrzdq" (UID: "7a794bf5-8ad3-4021-bbef-ef64dd10cfaa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:17.533467 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.533186    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2 podName:b3e698d3-ff4e-45ec-ab17-1b87cf823bb3 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:33.533179524 +0000 UTC m=+34.192340631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q54h2" (UniqueName: "kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2") pod "network-check-target-8xphl" (UID: "b3e698d3-ff4e-45ec-ab17-1b87cf823bb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:17.821540 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:17.821458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:17.821730 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.821605    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:17.821914 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:17.821458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:17.822026 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:17.822004    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:18.820849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:18.820814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:18.821272 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:18.820940    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:19.824936 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:19.824902    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:19.825400 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:19.825054    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:19.825400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:19.825105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:19.825400 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:19.825216    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:20.821393 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:20.821361    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:20.821590 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:20.821481    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:21.820807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:21.820764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:21.821268 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:21.820896    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:21.821268 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:21.820959    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:21.821268 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:21.821076    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:22.033287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.033249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:22.120592 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.120535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:22.206864 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.206828    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 15:13:22.219339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.219021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:22.681539 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.681464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:22.763317 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.763187    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T15:13:22.206847557Z","UUID":"83b51e84-cd77-42d5-9164-fc5ddafc479f","Handler":null,"Name":"","Endpoint":""}
Sep 08 15:13:22.765136 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.765111    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 15:13:22.765255 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.765151    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 15:13:22.780461 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.780417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:22.821250 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.821224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:22.822050 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:22.821338    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:22.873538 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.873493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:22.927504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.927475    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6e8db2d-f735-490d-a1e8-0c0d096f3590" containerID="88173069da3b32df85d39221e11b8dc09449d4070de35b08769bc3809d8c7522" exitCode=0
Sep 08 15:13:22.927686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.927573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerDied","Data":"88173069da3b32df85d39221e11b8dc09449d4070de35b08769bc3809d8c7522"}
Sep 08 15:13:22.929373 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.929346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmwxw" event={"ID":"08e10792-d0b2-4865-b6dc-dca79a6dc6b1","Type":"ContainerStarted","Data":"785667ec44aff0bd84dce0aec7d2690cba821c0b91a352a5061439203d4cc095"}
Sep 08 15:13:22.931671 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.931604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj" event={"ID":"f0d6c832-48b9-4bfe-8a40-a0604beb4d28","Type":"ContainerStarted","Data":"4caafb93e687c31f4a9e65098a413438b11373b9cacb383f9bf0dd0f9e6a5bbf"}
Sep 08 15:13:22.933323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.933281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wh4rg" event={"ID":"03554dff-f02a-46ab-aa36-d614bbb909cf","Type":"ContainerStarted","Data":"64127fdd02a97ec4424b7cebebc292e1aecfecb43cdb44816f390c6b8ab78566"}
Sep 08 15:13:22.936847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.936825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"82b433c9ac246dfac42bf3a1ba22d9b20f78664562ec16b80008c8eaf018c829"}
Sep 08 15:13:22.936929 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.936892    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"7a6ead1cc3e30a28cc03bd359756d980f08cc4c2afbc06cf31c9c26e44e6f61e"}
Sep 08 15:13:22.936929 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.936923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"eabbefd2ebf2c3dfd90d54f165a362db3c649ace1a7acbcef59ff21c15f52430"}
Sep 08 15:13:22.937006 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.936954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"299aef426de64007a22fecbfbf129b2d42f8f4b6a03afaded7641f7fe7852454"}
Sep 08 15:13:22.937006 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.936982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"e01d229f4912401b87f9d3eb4ca80d60abae14d78a60c9559fb18815b0eafaf8"}
Sep 08 15:13:22.937080 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.937022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"5204924e2ce34a5e7de7cc9e4a77343161a14b24d9697c5d591d72b06a04ee25"}
Sep 08 15:13:22.963894 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.963842    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wh4rg" podStartSLOduration=4.451715276 podStartE2EDuration="23.963827694s" totalImagesPullingTime="19.512112418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:22.963288954 +0000 UTC m=+23.622450083" watchObservedRunningTime="2026-09-08 15:13:22.963827694 +0000 UTC m=+23.622988820"
Sep 08 15:13:22.978626 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:22.978570    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pmwxw" podStartSLOduration=6.190395305 podStartE2EDuration="23.978557889s" totalImagesPullingTime="17.788162584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:22.978541541 +0000 UTC m=+23.637702669" watchObservedRunningTime="2026-09-08 15:13:22.978557889 +0000 UTC m=+23.637719015"
Sep 08 15:13:23.074412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.074379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:23.140481 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.140423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:23.331301 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.331263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:23.391793 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.391767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:23.748108 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.748078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:23.821514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.821478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:23.821916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.821530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:23.821916 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:23.821620    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:23.821916 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:23.821741    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:23.845324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.845296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:23.941041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:23.941006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj" event={"ID":"f0d6c832-48b9-4bfe-8a40-a0604beb4d28","Type":"ContainerStarted","Data":"4af48477e25bb450e96a456ee17165c97bae2e3abeaa2e8c7704ac6d52d301ca"}
Sep 08 15:13:24.000748 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.000678    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:24.000866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.000786    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 15:13:24.001275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.001255    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7628m"
Sep 08 15:13:24.018821 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.018781    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4xj" podStartSLOduration=4.577046033 podStartE2EDuration="25.018767188s" totalImagesPullingTime="20.441721155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:23.96346722 +0000 UTC m=+24.622628346" watchObservedRunningTime="2026-09-08 15:13:24.018767188 +0000 UTC m=+24.677928323"
Sep 08 15:13:24.062078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.062055    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:24.755403 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.755213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:24.821688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.821612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:24.822026 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:24.821721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:24.879924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.879889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:24.946061 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.946014    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6e8db2d-f735-490d-a1e8-0c0d096f3590" containerID="edcda8544068d91a39f7290d962542b4a501220fada282b9bca84cc87a659177" exitCode=0
Sep 08 15:13:24.946251 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.946053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerDied","Data":"edcda8544068d91a39f7290d962542b4a501220fada282b9bca84cc87a659177"}
Sep 08 15:13:24.949972 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:24.949947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"a9794f1dd5a58827b63315abe5881cc8e5e1ca65d2ca33c75dffeaccb010b44e"}
Sep 08 15:13:25.035213 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:25.035168    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:25.042118 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:25.042099    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pqx66_e4335589-749e-4577-9e80-bf1f026e392b/dns-node-resolver/0.log"
Sep 08 15:13:25.203979 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:25.203950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:25.279928 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:25.279888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:25.820928 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:25.820891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:25.821111 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:25.821018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:25.821111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:25.821077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:25.821227 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:25.821201    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:26.153507 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.153404    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:26.238453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.238427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nmt7d_d7fb0085-184d-4787-abc4-87d4dcdcc09c/node-ca/0.log"
Sep 08 15:13:26.821475 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.821311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:26.821475 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:26.821422    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:26.960567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.960470    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6e8db2d-f735-490d-a1e8-0c0d096f3590" containerID="9dc43de44686c504e178fcb6e33e11d8aa6f8308ee05a9e04937d150ae4eda2b" exitCode=0
Sep 08 15:13:26.960724 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.960563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerDied","Data":"9dc43de44686c504e178fcb6e33e11d8aa6f8308ee05a9e04937d150ae4eda2b"}
Sep 08 15:13:26.964451 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.964431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" event={"ID":"2d3f3324-7399-4c56-b7c0-ac5c93f3dab9","Type":"ContainerStarted","Data":"bcddeff3e3f590c9ef452caad8d30da3d2d2a765dcc48fdaaaa9d88d6d5fcdf5"}
Sep 08 15:13:26.964682 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.964668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:26.964745 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.964738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:26.982185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:26.980131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:27.017929 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:27.017879    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml" podStartSLOduration=8.504272242 podStartE2EDuration="28.017866012s" totalImagesPullingTime="19.51359377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:27.01774193 +0000 UTC m=+27.676903056" watchObservedRunningTime="2026-09-08 15:13:27.017866012 +0000 UTC m=+27.677027140"
Sep 08 15:13:27.596738 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:27.596495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:27.820727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:27.820695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:27.820907 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:27.820798    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:27.820983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:27.820898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:27.821071 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:27.821051    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:27.919242 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:27.919146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:27.967109 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:27.967088    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:27.981608 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:27.981572    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:13:28.115526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:28.115488    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:28.215595 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:28.215556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:28.316730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:28.316692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:28.400416 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:28.400375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:28.820907 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:28.820880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:28.821229 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:28.820984    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:28.913435 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:28.913406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:29.096412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:29.096341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:29.717175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:29.717144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:29.821304 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:29.821275    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:29.821675 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:29.821350    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:29.821675 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:29.821450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:29.821675 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:29.821545    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:29.920416 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:29.920375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:30.364814 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:30.364768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:30.547839 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:30.547803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:30.820824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:30.820794    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:30.820994 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:30.820938    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:31.113315 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.113221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:31.297400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.297358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:31.363817 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.363728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:31.630935 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.630857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:31.731089 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.731050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:31.820618 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.820572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:31.820789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.820572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:31.820789 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:31.820739    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:31.820789 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:31.820754    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:31.831030 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.831004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:31.932188 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:31.932083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:32.313349 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:32.313315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:32.420765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:32.420729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:32.710038 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:32.709991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:32.821544 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:32.821510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:32.821735 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:32.821662    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:32.975981 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:32.975902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.088308 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.088273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.297836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.297748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.397808 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.397771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.499352 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.499317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.557191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.557115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:33.557191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.557167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:33.557416 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.557201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:33.557416 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557301    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:33.557416 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557325    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:33.557416 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557386    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs podName:7a794bf5-8ad3-4021-bbef-ef64dd10cfaa nodeName:}" failed. No retries permitted until 2026-09-08 15:14:05.557368183 +0000 UTC m=+66.216529293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs") pod "network-metrics-daemon-qrzdq" (UID: "7a794bf5-8ad3-4021-bbef-ef64dd10cfaa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:33.557416 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557325    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:33.557689 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557463    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret podName:7a5fa953-84c7-4b92-b1e0-b78a8d2ef623 nodeName:}" failed. No retries permitted until 2026-09-08 15:14:05.557446306 +0000 UTC m=+66.216607425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret") pod "global-pull-secret-syncer-2qjpj" (UID: "7a5fa953-84c7-4b92-b1e0-b78a8d2ef623") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:33.557689 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557327    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:33.557689 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557491    2578 projected.go:196] Error preparing data for projected volume kube-api-access-q54h2 for pod openshift-network-diagnostics/network-check-target-8xphl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:33.557689 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.557533    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2 podName:b3e698d3-ff4e-45ec-ab17-1b87cf823bb3 nodeName:}" failed. No retries permitted until 2026-09-08 15:14:05.557521437 +0000 UTC m=+66.216682559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q54h2" (UniqueName: "kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2") pod "network-check-target-8xphl" (UID: "b3e698d3-ff4e-45ec-ab17-1b87cf823bb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:33.599536 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.599508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.699325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.699290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.821461 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.821380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:33.821461 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.821386    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:33.821693 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.821501    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:33.821693 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:33.821641    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:33.866303 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.866273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.966275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.966249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:33.983533 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:33.983506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerStarted","Data":"05aeb7b6a92ed6ffed46fda870335c5a437fc8aabb6c91e4d5c4edf409710015"}
Sep 08 15:13:34.066568 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.066543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:34.168565 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.168491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:34.325288 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.325258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:34.425289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.425214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:34.773689 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.773653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:34.821596 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.821562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:34.821738 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:34.821675    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:34.988647 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.988616    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6e8db2d-f735-490d-a1e8-0c0d096f3590" containerID="05aeb7b6a92ed6ffed46fda870335c5a437fc8aabb6c91e4d5c4edf409710015" exitCode=0
Sep 08 15:13:34.988647 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:34.988652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerDied","Data":"05aeb7b6a92ed6ffed46fda870335c5a437fc8aabb6c91e4d5c4edf409710015"}
Sep 08 15:13:35.820796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:35.820763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:35.821169 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:35.820873    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:35.821169 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:35.820942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:35.821169 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:35.821022    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:35.993557 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:35.993526    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6e8db2d-f735-490d-a1e8-0c0d096f3590" containerID="8c146dcf18627f29f6b65517d6671e404ca8594b6b1aa83b5dbcd5c7eba6e289" exitCode=0
Sep 08 15:13:35.993724 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:35.993572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerDied","Data":"8c146dcf18627f29f6b65517d6671e404ca8594b6b1aa83b5dbcd5c7eba6e289"}
Sep 08 15:13:36.821260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:36.821230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:36.821713 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:36.821362    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:36.999398 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:36.999366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" event={"ID":"a6e8db2d-f735-490d-a1e8-0c0d096f3590","Type":"ContainerStarted","Data":"9d5bbd640da4a4e62fbe042d0af5cb5f9a5f9f63a5a7417fd4988b89a205ec37"}
Sep 08 15:13:37.311640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:37.311603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:37.385137 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:37.385091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:37.521329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:37.521290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:37.679159 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:37.679079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:37.738675 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:37.738644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:37.820771 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:37.820738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:37.820942 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:37.820863    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:37.820942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:37.820932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:37.821108 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:37.821065    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:38.115263 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:38.115232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:38.633436 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:38.633401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:38.732346 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:38.732310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:38.821511 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:38.821479    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:38.821693 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:38.821597    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:38.834362 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:38.834331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:39.823865 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:39.823833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:39.824295 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:39.823840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:39.824295 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:39.823941    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:39.824295 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:39.823994    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:40.821222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:40.821193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:40.821396 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:40.821293    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:41.821531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:41.821504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:41.821891 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:41.821625    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:41.821891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:41.821687    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:41.821891 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:41.821766    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:42.821319 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:42.821282    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:42.821516 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:42.821426    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:43.821172 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:43.821136    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:43.821524 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:43.821261    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:43.821524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:43.821299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:43.821524 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:43.821374    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:44.821206 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:44.821170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:44.821645 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:44.821308    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:45.821383 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:45.821347    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:45.821874 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:45.821347    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:45.821874 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:45.821451    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:45.821874 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:45.821539    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:46.821056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:46.821019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:46.821222 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:46.821134    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:47.163365 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:47.163272    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pzb9z" podStartSLOduration=20.709410193 podStartE2EDuration="48.163256375s" totalImagesPullingTime="27.453846182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:37.029092172 +0000 UTC m=+37.688253298" watchObservedRunningTime="2026-09-08 15:13:47.163256375 +0000 UTC m=+47.822417501"
Sep 08 15:13:47.433681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:47.433608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:47.531474 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:47.531443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:47.685175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:47.685071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:47.777532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:47.777500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:47.820711 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:47.820684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:47.820711 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:47.820702    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:47.820918 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:47.820800    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:47.820918 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:47.820889    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:48.733816 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:48.733552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8xphl"]
Sep 08 15:13:48.734198 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:48.733911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:48.734198 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:48.734003    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:48.737138 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:48.737097    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2qjpj"]
Sep 08 15:13:48.737281 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:48.737198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:48.737349 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:48.737289    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:48.737809 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:48.737785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qrzdq"]
Sep 08 15:13:48.737929 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:48.737891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:48.737998 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:48.737972    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:49.049966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:49.049938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:49.135005 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:49.134975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:49.823879 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:49.823847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:49.824413 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:49.824221    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:49.967481 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:49.967443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:50.063940 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:50.063900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:50.152024 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:50.151926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:50.256642 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:50.256612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:50.318304 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:50.318271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:50.387177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:50.387141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:50.821297 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:50.821263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:50.821489 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:50.821366    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qjpj" podUID="7a5fa953-84c7-4b92-b1e0-b78a8d2ef623"
Sep 08 15:13:50.821489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:50.821423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:50.821625 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:50.821522    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qrzdq" podUID="7a794bf5-8ad3-4021-bbef-ef64dd10cfaa"
Sep 08 15:13:51.066496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:51.066459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:51.122347 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:51.122260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:51.473997 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:51.473965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:51.559976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:51.559944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:51.823791 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:51.823709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:51.823947 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:13:51.823821    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8xphl" podUID="b3e698d3-ff4e-45ec-ab17-1b87cf823bb3"
Sep 08 15:13:52.577677 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.577654    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-54.ec2.internal" event="NodeReady"
Sep 08 15:13:52.578277 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.577810    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 15:13:52.620950 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.620915    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rhxn6"]
Sep 08 15:13:52.635408 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.635381    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gkt4t"]
Sep 08 15:13:52.635572 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.635554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.638130 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.638104    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 15:13:52.638254 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.638104    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 15:13:52.638254 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.638177    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9nsl6\""
Sep 08 15:13:52.638502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.638483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 15:13:52.644508 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.644490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rhxn6"]
Sep 08 15:13:52.644615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.644525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkt4t"]
Sep 08 15:13:52.644615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.644558    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cwcvm"]
Sep 08 15:13:52.644727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.644684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.647153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.647135    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 15:13:52.647229 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.647156    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 15:13:52.647229 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.647218    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xgtpp\""
Sep 08 15:13:52.647342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.647330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 15:13:52.647444 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.647427    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 15:13:52.652676 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.652659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.654761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.654743    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 15:13:52.654852 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.654763    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j59vx\""
Sep 08 15:13:52.654852 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.654811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 15:13:52.657486 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.657467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cwcvm"]
Sep 08 15:13:52.749969 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.749939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:52.787289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7907de3-9695-41df-85fc-b4de8d5d0e23-metrics-tls\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.787289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73d2f7cf-c76e-40cc-859a-2ab76a8352af-crio-socket\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.787289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73d2f7cf-c76e-40cc-859a-2ab76a8352af-data-volume\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/394ce1c2-7a5c-48c2-9da6-5d238b34d4cf-cert\") pod \"ingress-canary-rhxn6\" (UID: \"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf\") " pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73d2f7cf-c76e-40cc-859a-2ab76a8352af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7907de3-9695-41df-85fc-b4de8d5d0e23-config-volume\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfd4n\" (UniqueName: \"kubernetes.io/projected/394ce1c2-7a5c-48c2-9da6-5d238b34d4cf-kube-api-access-wfd4n\") pod \"ingress-canary-rhxn6\" (UID: \"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf\") " pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7907de3-9695-41df-85fc-b4de8d5d0e23-tmp-dir\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73d2f7cf-c76e-40cc-859a-2ab76a8352af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvl5s\" (UniqueName: \"kubernetes.io/projected/73d2f7cf-c76e-40cc-859a-2ab76a8352af-kube-api-access-qvl5s\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.787537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.787501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ptg\" (UniqueName: \"kubernetes.io/projected/a7907de3-9695-41df-85fc-b4de8d5d0e23-kube-api-access-r9ptg\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.805615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.805575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:52.821574 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.821551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:13:52.821675 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.821551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:13:52.824158 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.824141    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:13:52.824267 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.824193    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ws5f4\""
Sep 08 15:13:52.824267 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.824257    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:13:52.888779 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfd4n\" (UniqueName: \"kubernetes.io/projected/394ce1c2-7a5c-48c2-9da6-5d238b34d4cf-kube-api-access-wfd4n\") pod \"ingress-canary-rhxn6\" (UID: \"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf\") " pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.888779 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7907de3-9695-41df-85fc-b4de8d5d0e23-tmp-dir\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73d2f7cf-c76e-40cc-859a-2ab76a8352af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvl5s\" (UniqueName: \"kubernetes.io/projected/73d2f7cf-c76e-40cc-859a-2ab76a8352af-kube-api-access-qvl5s\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ptg\" (UniqueName: \"kubernetes.io/projected/a7907de3-9695-41df-85fc-b4de8d5d0e23-kube-api-access-r9ptg\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7907de3-9695-41df-85fc-b4de8d5d0e23-metrics-tls\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73d2f7cf-c76e-40cc-859a-2ab76a8352af-crio-socket\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73d2f7cf-c76e-40cc-859a-2ab76a8352af-data-volume\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/394ce1c2-7a5c-48c2-9da6-5d238b34d4cf-cert\") pod \"ingress-canary-rhxn6\" (UID: \"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf\") " pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.888983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.888968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73d2f7cf-c76e-40cc-859a-2ab76a8352af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.889368 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.889020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7907de3-9695-41df-85fc-b4de8d5d0e23-config-volume\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.889368 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.889026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73d2f7cf-c76e-40cc-859a-2ab76a8352af-crio-socket\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.889368 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.889160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7907de3-9695-41df-85fc-b4de8d5d0e23-tmp-dir\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.889520 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.889482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73d2f7cf-c76e-40cc-859a-2ab76a8352af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.889665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.889642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7907de3-9695-41df-85fc-b4de8d5d0e23-config-volume\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.889738 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.889646    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73d2f7cf-c76e-40cc-859a-2ab76a8352af-data-volume\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.892943 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.892920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7907de3-9695-41df-85fc-b4de8d5d0e23-metrics-tls\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.893058 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.893020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73d2f7cf-c76e-40cc-859a-2ab76a8352af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.893058 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.893033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/394ce1c2-7a5c-48c2-9da6-5d238b34d4cf-cert\") pod \"ingress-canary-rhxn6\" (UID: \"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf\") " pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.896279 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.896258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ptg\" (UniqueName: \"kubernetes.io/projected/a7907de3-9695-41df-85fc-b4de8d5d0e23-kube-api-access-r9ptg\") pod \"dns-default-cwcvm\" (UID: \"a7907de3-9695-41df-85fc-b4de8d5d0e23\") " pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:52.896429 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.896410    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvl5s\" (UniqueName: \"kubernetes.io/projected/73d2f7cf-c76e-40cc-859a-2ab76a8352af-kube-api-access-qvl5s\") pod \"insights-runtime-extractor-gkt4t\" (UID: \"73d2f7cf-c76e-40cc-859a-2ab76a8352af\") " pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.896537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.896519    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfd4n\" (UniqueName: \"kubernetes.io/projected/394ce1c2-7a5c-48c2-9da6-5d238b34d4cf-kube-api-access-wfd4n\") pod \"ingress-canary-rhxn6\" (UID: \"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf\") " pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.946489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.946460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rhxn6"
Sep 08 15:13:52.953671 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.953646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkt4t"
Sep 08 15:13:52.960805 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:52.960782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:53.021263 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.020024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:53.090566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.090328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:53.283725 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.283695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rhxn6"]
Sep 08 15:13:53.285990 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.285966    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkt4t"]
Sep 08 15:13:53.287303 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:53.287277    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394ce1c2_7a5c_48c2_9da6_5d238b34d4cf.slice/crio-5d59039f5bddafa4f4a849a166ee0538677996d98425d30fa7bba594b5af7cf6 WatchSource:0}: Error finding container 5d59039f5bddafa4f4a849a166ee0538677996d98425d30fa7bba594b5af7cf6: Status 404 returned error can't find the container with id 5d59039f5bddafa4f4a849a166ee0538677996d98425d30fa7bba594b5af7cf6
Sep 08 15:13:53.289050 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:53.289020    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d2f7cf_c76e_40cc_859a_2ab76a8352af.slice/crio-d521aa6d85ca380d2662905a2561e477aeb6c35075a00912097ee21a3754deed WatchSource:0}: Error finding container d521aa6d85ca380d2662905a2561e477aeb6c35075a00912097ee21a3754deed: Status 404 returned error can't find the container with id d521aa6d85ca380d2662905a2561e477aeb6c35075a00912097ee21a3754deed
Sep 08 15:13:53.298240 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.297913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cwcvm"]
Sep 08 15:13:53.301657 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:53.301637    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7907de3_9695_41df_85fc_b4de8d5d0e23.slice/crio-03872dfa44dd27b694d6d82096b85df680904ec8b1d98b0e03227804a6f49ee3 WatchSource:0}: Error finding container 03872dfa44dd27b694d6d82096b85df680904ec8b1d98b0e03227804a6f49ee3: Status 404 returned error can't find the container with id 03872dfa44dd27b694d6d82096b85df680904ec8b1d98b0e03227804a6f49ee3
Sep 08 15:13:53.643088 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.642987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:53.711810 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.711760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:53.821680 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.821648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:13:53.824395 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.824366    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:13:53.824628 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.824611    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:13:53.825215 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:53.825162    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dtm8b\""
Sep 08 15:13:54.040737 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:54.040702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwcvm" event={"ID":"a7907de3-9695-41df-85fc-b4de8d5d0e23","Type":"ContainerStarted","Data":"03872dfa44dd27b694d6d82096b85df680904ec8b1d98b0e03227804a6f49ee3"}
Sep 08 15:13:54.043038 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:54.042998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkt4t" event={"ID":"73d2f7cf-c76e-40cc-859a-2ab76a8352af","Type":"ContainerStarted","Data":"d9917feadc6ebae47f7a79977566ffab81f8b63eea89fe6471d268e0530e40f8"}
Sep 08 15:13:54.043171 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:54.043075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkt4t" event={"ID":"73d2f7cf-c76e-40cc-859a-2ab76a8352af","Type":"ContainerStarted","Data":"d521aa6d85ca380d2662905a2561e477aeb6c35075a00912097ee21a3754deed"}
Sep 08 15:13:54.044950 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:54.044923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rhxn6" event={"ID":"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf","Type":"ContainerStarted","Data":"5d59039f5bddafa4f4a849a166ee0538677996d98425d30fa7bba594b5af7cf6"}
Sep 08 15:13:55.050551 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.050519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkt4t" event={"ID":"73d2f7cf-c76e-40cc-859a-2ab76a8352af","Type":"ContainerStarted","Data":"cecf63954e06283be8bba1bd3569b4713346ef8e9b4cc32d70a72d659517529f"}
Sep 08 15:13:55.249045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.249009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:55.308351 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.308266    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"]
Sep 08 15:13:55.310382 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.310354    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.314260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.313896    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 15:13:55.314260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.313927    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 15:13:55.314260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.313946    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 15:13:55.314260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.313927    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 15:13:55.314260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.313896    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 15:13:55.314260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.314036    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v4lw5\""
Sep 08 15:13:55.320959 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.320935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"]
Sep 08 15:13:55.330055 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.330034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:55.409640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.409603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b27035c-4597-4cef-9326-35bc3e3bf201-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.409806 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.409667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b27035c-4597-4cef-9326-35bc3e3bf201-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.409806 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.409767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjmxv\" (UniqueName: \"kubernetes.io/projected/1b27035c-4597-4cef-9326-35bc3e3bf201-kube-api-access-zjmxv\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.409916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.409845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b27035c-4597-4cef-9326-35bc3e3bf201-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.508955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.508916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:55.510857 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.510836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjmxv\" (UniqueName: \"kubernetes.io/projected/1b27035c-4597-4cef-9326-35bc3e3bf201-kube-api-access-zjmxv\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.510955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.510894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b27035c-4597-4cef-9326-35bc3e3bf201-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.510955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.510921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b27035c-4597-4cef-9326-35bc3e3bf201-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.510955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.510945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b27035c-4597-4cef-9326-35bc3e3bf201-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.511758 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.511731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b27035c-4597-4cef-9326-35bc3e3bf201-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.515988 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.515967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b27035c-4597-4cef-9326-35bc3e3bf201-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.516085 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.516012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b27035c-4597-4cef-9326-35bc3e3bf201-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.519911 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.519890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjmxv\" (UniqueName: \"kubernetes.io/projected/1b27035c-4597-4cef-9326-35bc3e3bf201-kube-api-access-zjmxv\") pod \"prometheus-operator-6f4946db56-wjzbk\" (UID: \"1b27035c-4597-4cef-9326-35bc3e3bf201\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:55.620921 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:55.620833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"
Sep 08 15:13:56.059807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:56.058201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwcvm" event={"ID":"a7907de3-9695-41df-85fc-b4de8d5d0e23","Type":"ContainerStarted","Data":"3e064ed7658290eeb92801b60d00d3badd5a9f6b1feb2f70a9ae9a9593e77722"}
Sep 08 15:13:56.062206 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:56.062167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rhxn6" event={"ID":"394ce1c2-7a5c-48c2-9da6-5d238b34d4cf","Type":"ContainerStarted","Data":"87044fbdc32602924c33709a2de9c49ea745ced454cb1d227ef693462eb74d07"}
Sep 08 15:13:56.085010 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:56.084833    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rhxn6" podStartSLOduration=1.436538608 podStartE2EDuration="4.084811677s" totalImagesPullingTime="2.648273069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:56.082895023 +0000 UTC m=+56.742056147" watchObservedRunningTime="2026-09-08 15:13:56.084811677 +0000 UTC m=+56.743972805"
Sep 08 15:13:56.203386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:56.203356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wjzbk"]
Sep 08 15:13:56.206714 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:13:56.206682    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b27035c_4597_4cef_9326_35bc3e3bf201.slice/crio-e6d93125169b31c78ee5fb3d8aa47394946d42fecefc04f08198a87050d28b2e WatchSource:0}: Error finding container e6d93125169b31c78ee5fb3d8aa47394946d42fecefc04f08198a87050d28b2e: Status 404 returned error can't find the container with id e6d93125169b31c78ee5fb3d8aa47394946d42fecefc04f08198a87050d28b2e
Sep 08 15:13:57.066260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:57.066036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk" event={"ID":"1b27035c-4597-4cef-9326-35bc3e3bf201","Type":"ContainerStarted","Data":"e6d93125169b31c78ee5fb3d8aa47394946d42fecefc04f08198a87050d28b2e"}
Sep 08 15:13:57.068232 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:57.068199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwcvm" event={"ID":"a7907de3-9695-41df-85fc-b4de8d5d0e23","Type":"ContainerStarted","Data":"5e788645918ae657e647ab1c9b440670430fa1c6bc60d7e6bca68eb145b4f76c"}
Sep 08 15:13:57.085414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:57.085362    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cwcvm" podStartSLOduration=2.456262114 podStartE2EDuration="5.085343894s" totalImagesPullingTime="2.62908178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:57.084471948 +0000 UTC m=+57.743633079" watchObservedRunningTime="2026-09-08 15:13:57.085343894 +0000 UTC m=+57.744505022"
Sep 08 15:13:58.076146 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:58.076036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk" event={"ID":"1b27035c-4597-4cef-9326-35bc3e3bf201","Type":"ContainerStarted","Data":"7a0a2b44c94d20a7898c70c2b9938c1a24ddcfbfc464a630253b92225420555f"}
Sep 08 15:13:58.076146 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:58.076107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk" event={"ID":"1b27035c-4597-4cef-9326-35bc3e3bf201","Type":"ContainerStarted","Data":"b8985a8803c1a4437588da6d230073eec6d74d3982e0995b85c532e18f7a7a36"}
Sep 08 15:13:58.076689 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:58.076307    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:13:58.092465 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:58.092413    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-wjzbk" podStartSLOduration=1.690867816 podStartE2EDuration="3.092394184s" totalImagesPullingTime="1.401526368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:58.092045454 +0000 UTC m=+58.751206581" watchObservedRunningTime="2026-09-08 15:13:58.092394184 +0000 UTC m=+58.751555311"
Sep 08 15:13:58.212635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:58.212575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:58.313830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:58.313799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:59.081039 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.081007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkt4t" event={"ID":"73d2f7cf-c76e-40cc-859a-2ab76a8352af","Type":"ContainerStarted","Data":"e95afee8683f0c36c5e36f8d3d84306fa9f3ecdb0ebf71e60393eba8ec0d3dd2"}
Sep 08 15:13:59.100479 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.100436    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gkt4t" podStartSLOduration=2.524651756 podStartE2EDuration="7.100420354s" totalImagesPullingTime="4.575768598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:13:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:59.099646089 +0000 UTC m=+59.758807218" watchObservedRunningTime="2026-09-08 15:13:59.100420354 +0000 UTC m=+59.759581471"
Sep 08 15:13:59.438096 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.438017    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:59.695594 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.695503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:59.722218 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.722183    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"]
Sep 08 15:13:59.724961 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.724941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.727176 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.727156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 15:13:59.727457 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.727438    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 15:13:59.727743 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.727728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sf8x2\""
Sep 08 15:13:59.736004 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.735987    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"]
Sep 08 15:13:59.752768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.752737    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rkj7s"]
Sep 08 15:13:59.754968 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.754951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.757733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.757715    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 15:13:59.757949 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.757872    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 15:13:59.758312 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.758292    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 15:13:59.759509 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.759485    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"]
Sep 08 15:13:59.760454 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.760434    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9k4qk\""
Sep 08 15:13:59.761889 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.761870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.765475 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.765454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 08 15:13:59.765849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.765827    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 08 15:13:59.766614 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.766593    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 08 15:13:59.766769 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.766747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n7gsq\""
Sep 08 15:13:59.778409 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.778388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"]
Sep 08 15:13:59.799702 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.799670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:59.845086 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-tls\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-root\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6vct\" (UniqueName: \"kubernetes.io/projected/824e477f-3f4a-4984-9feb-8afc47e5124d-kube-api-access-p6vct\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.845246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.845373 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vshth\" (UniqueName: \"kubernetes.io/projected/6b2f5c00-c523-46a3-a27e-969931c52c0a-kube-api-access-vshth\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845373 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp7n7\" (UniqueName: \"kubernetes.io/projected/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-api-access-pp7n7\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.845373 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-sys\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-wtmp\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0e67c53-d908-4654-a4dc-7a88b3128a2f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.845489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.845489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.845665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/824e477f-3f4a-4984-9feb-8afc47e5124d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.845665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f0e67c53-d908-4654-a4dc-7a88b3128a2f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.845665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-textfile\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2f5c00-c523-46a3-a27e-969931c52c0a-metrics-client-ca\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/824e477f-3f4a-4984-9feb-8afc47e5124d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.845833 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845833 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.845833 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.845730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/824e477f-3f4a-4984-9feb-8afc47e5124d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.926742 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.926708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:13:59.946826 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.946797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.946974 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.946838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.946974 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.946873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/824e477f-3f4a-4984-9feb-8afc47e5124d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.947097 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.946978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f0e67c53-d908-4654-a4dc-7a88b3128a2f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.947097 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-textfile\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947097 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2f5c00-c523-46a3-a27e-969931c52c0a-metrics-client-ca\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/824e477f-3f4a-4984-9feb-8afc47e5124d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.947228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/824e477f-3f4a-4984-9feb-8afc47e5124d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.947228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-tls\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-root\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6vct\" (UniqueName: \"kubernetes.io/projected/824e477f-3f4a-4984-9feb-8afc47e5124d-kube-api-access-p6vct\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vshth\" (UniqueName: \"kubernetes.io/projected/6b2f5c00-c523-46a3-a27e-969931c52c0a-kube-api-access-vshth\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp7n7\" (UniqueName: \"kubernetes.io/projected/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-api-access-pp7n7\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-textfile\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-sys\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f0e67c53-d908-4654-a4dc-7a88b3128a2f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-wtmp\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-root\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.947961 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0e67c53-d908-4654-a4dc-7a88b3128a2f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.947961 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.947961 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.947879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-wtmp\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.948089 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.948058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b2f5c00-c523-46a3-a27e-969931c52c0a-sys\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.948179 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.948147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0e67c53-d908-4654-a4dc-7a88b3128a2f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.948453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.948424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/824e477f-3f4a-4984-9feb-8afc47e5124d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.948810 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.948785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2f5c00-c523-46a3-a27e-969931c52c0a-metrics-client-ca\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.948903 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.948849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.950363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.950336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.950453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.950378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.950453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.950437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/824e477f-3f4a-4984-9feb-8afc47e5124d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.950626 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.950608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.950829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.950810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b2f5c00-c523-46a3-a27e-969931c52c0a-node-exporter-tls\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.950972 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.950953    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/824e477f-3f4a-4984-9feb-8afc47e5124d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.957513 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.957486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6vct\" (UniqueName: \"kubernetes.io/projected/824e477f-3f4a-4984-9feb-8afc47e5124d-kube-api-access-p6vct\") pod \"openshift-state-metrics-657fd6c54-4bhtt\" (UID: \"824e477f-3f4a-4984-9feb-8afc47e5124d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:13:59.957874 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.957854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vshth\" (UniqueName: \"kubernetes.io/projected/6b2f5c00-c523-46a3-a27e-969931c52c0a-kube-api-access-vshth\") pod \"node-exporter-rkj7s\" (UID: \"6b2f5c00-c523-46a3-a27e-969931c52c0a\") " pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:13:59.958982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.958962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp7n7\" (UniqueName: \"kubernetes.io/projected/f0e67c53-d908-4654-a4dc-7a88b3128a2f-kube-api-access-pp7n7\") pod \"kube-state-metrics-74cb57df7-2t65l\" (UID: \"f0e67c53-d908-4654-a4dc-7a88b3128a2f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:13:59.981041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:13:59.981021    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bwml"
Sep 08 15:14:00.013711 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.013665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:00.033854 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.033823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"
Sep 08 15:14:00.067702 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.067668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rkj7s"
Sep 08 15:14:00.073307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.073282    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"
Sep 08 15:14:00.077075 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:00.077013    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2f5c00_c523_46a3_a27e_969931c52c0a.slice/crio-d3752577074c97c63f803211e3155180c03d1bffd304ebbb68ea17b282802690 WatchSource:0}: Error finding container d3752577074c97c63f803211e3155180c03d1bffd304ebbb68ea17b282802690: Status 404 returned error can't find the container with id d3752577074c97c63f803211e3155180c03d1bffd304ebbb68ea17b282802690
Sep 08 15:14:00.087032 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.086978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rkj7s" event={"ID":"6b2f5c00-c523-46a3-a27e-969931c52c0a","Type":"ContainerStarted","Data":"d3752577074c97c63f803211e3155180c03d1bffd304ebbb68ea17b282802690"}
Sep 08 15:14:00.164874 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.164843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:00.265084 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.265004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:00.304202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.304168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt"]
Sep 08 15:14:00.306809 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:00.306779    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824e477f_3f4a_4984_9feb_8afc47e5124d.slice/crio-134b229df32be9eb65514eca1338d2a10f98e21dd01518f1684e0ae622d166d7 WatchSource:0}: Error finding container 134b229df32be9eb65514eca1338d2a10f98e21dd01518f1684e0ae622d166d7: Status 404 returned error can't find the container with id 134b229df32be9eb65514eca1338d2a10f98e21dd01518f1684e0ae622d166d7
Sep 08 15:14:00.374609 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.374568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2t65l"]
Sep 08 15:14:00.377762 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:00.377722    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e67c53_d908_4654_a4dc_7a88b3128a2f.slice/crio-028cfd03709e183f1872a5b603538422e8026e4c676a524c9afcc9424841d2db WatchSource:0}: Error finding container 028cfd03709e183f1872a5b603538422e8026e4c676a524c9afcc9424841d2db: Status 404 returned error can't find the container with id 028cfd03709e183f1872a5b603538422e8026e4c676a524c9afcc9424841d2db
Sep 08 15:14:00.402199 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.402178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:00.661360 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.661279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:00.740342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.740307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:00.745616 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.745576    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:00.750935 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.750907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.753635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.753605    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 15:14:00.753799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.753611    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 15:14:00.753799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.753741    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 15:14:00.753799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.753762    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zjwbq\""
Sep 08 15:14:00.754004 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.753863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 15:14:00.754106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.754091    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 15:14:00.754228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.754199    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 15:14:00.754453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.754433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 15:14:00.754518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.754475    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 15:14:00.754752 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.754736    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 15:14:00.770768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.770748    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:00.854771 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a491b47-c0c4-45fa-828d-180476103cff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.854771 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rj5k\" (UniqueName: \"kubernetes.io/projected/9a491b47-c0c4-45fa-828d-180476103cff-kube-api-access-9rj5k\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.854982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-web-config\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.854982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.854982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.854982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a491b47-c0c4-45fa-828d-180476103cff-config-out\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.854982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.854982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.854971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.855193 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.855043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.855193 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.855059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.855193 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.855082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.855193 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.855099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.855193 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.855126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.862031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.862002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:00.955955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.955921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.955965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a491b47-c0c4-45fa-828d-180476103cff-config-out\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a491b47-c0c4-45fa-828d-180476103cff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rj5k\" (UniqueName: \"kubernetes.io/projected/9a491b47-c0c4-45fa-828d-180476103cff-kube-api-access-9rj5k\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956712 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-web-config\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.956712 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:14:00.956577    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-trusted-ca-bundle podName:9a491b47-c0c4-45fa-828d-180476103cff nodeName:}" failed. No retries permitted until 2026-09-08 15:14:01.456553128 +0000 UTC m=+62.115714249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9a491b47-c0c4-45fa-828d-180476103cff") : configmap references non-existent config key: ca-bundle.crt
Sep 08 15:14:00.957300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.956922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.957661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.957613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.959239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.959215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.959336 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.959238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-web-config\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.960112 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.960085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.960231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.960121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.960342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.960303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.960484 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.960461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a491b47-c0c4-45fa-828d-180476103cff-config-out\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.960813 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.960789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.961326 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.961303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a491b47-c0c4-45fa-828d-180476103cff-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.961549 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.961530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a491b47-c0c4-45fa-828d-180476103cff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:00.981528 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:00.981508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rj5k\" (UniqueName: \"kubernetes.io/projected/9a491b47-c0c4-45fa-828d-180476103cff-kube-api-access-9rj5k\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:01.091817 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.091775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l" event={"ID":"f0e67c53-d908-4654-a4dc-7a88b3128a2f","Type":"ContainerStarted","Data":"028cfd03709e183f1872a5b603538422e8026e4c676a524c9afcc9424841d2db"}
Sep 08 15:14:01.094066 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.094041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt" event={"ID":"824e477f-3f4a-4984-9feb-8afc47e5124d","Type":"ContainerStarted","Data":"809771cc6a4887829e4156dfc9016e8b2ec179eed7ea8db2f0b4e0dc4d4afc2e"}
Sep 08 15:14:01.094196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.094088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt" event={"ID":"824e477f-3f4a-4984-9feb-8afc47e5124d","Type":"ContainerStarted","Data":"d91a327e2dd7338d45babf1e1d4afdefce46a678f47b1a1c3becb5a0551a4836"}
Sep 08 15:14:01.094196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.094106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt" event={"ID":"824e477f-3f4a-4984-9feb-8afc47e5124d","Type":"ContainerStarted","Data":"134b229df32be9eb65514eca1338d2a10f98e21dd01518f1684e0ae622d166d7"}
Sep 08 15:14:01.460563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.460524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:01.461491 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.461465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a491b47-c0c4-45fa-828d-180476103cff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a491b47-c0c4-45fa-828d-180476103cff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:01.662022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.661986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:01.942834 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:01.942800    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:02.066276 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:02.066212    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a491b47_c0c4_45fa_828d_180476103cff.slice/crio-c26a6f53370f4045e34846a61a91b470b348edaa82b48f99e3df4ab83eff26b4 WatchSource:0}: Error finding container c26a6f53370f4045e34846a61a91b470b348edaa82b48f99e3df4ab83eff26b4: Status 404 returned error can't find the container with id c26a6f53370f4045e34846a61a91b470b348edaa82b48f99e3df4ab83eff26b4
Sep 08 15:14:02.100895 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.100868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt" event={"ID":"824e477f-3f4a-4984-9feb-8afc47e5124d","Type":"ContainerStarted","Data":"ae9636ff497f43b0f11210e5a18d6700797f3c0085a3ab56ae01b8694bc2e9cb"}
Sep 08 15:14:02.101990 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.101966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerStarted","Data":"c26a6f53370f4045e34846a61a91b470b348edaa82b48f99e3df4ab83eff26b4"}
Sep 08 15:14:02.118917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.118871    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4bhtt" podStartSLOduration=2.028288368 podStartE2EDuration="3.11885406s" totalImagesPullingTime="1.090565692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:02.118206148 +0000 UTC m=+62.777367275" watchObservedRunningTime="2026-09-08 15:14:02.11885406 +0000 UTC m=+62.778015186"
Sep 08 15:14:02.676824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.676761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:02.701575 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.701541    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6975cd5467-v8zg2"]
Sep 08 15:14:02.708080 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.707981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.710684 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.710654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 15:14:02.710814 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.710742    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 15:14:02.710883 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.710813    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w69fg\""
Sep 08 15:14:02.710883 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.710813    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8d4h9bta3gq76\""
Sep 08 15:14:02.710991 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.710883    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 15:14:02.710991 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.710949    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 15:14:02.711195 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.711013    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 15:14:02.716699 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.716656    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6975cd5467-v8zg2"]
Sep 08 15:14:02.806914 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.806854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:02.872991 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.872954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-grpc-tls\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.873139 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.873045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.873139 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.873093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-metrics-client-ca\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.873139 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.873132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.873307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.873159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.873307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.873183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.873307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.873256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-tls\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.873417 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.873308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk7ss\" (UniqueName: \"kubernetes.io/projected/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-kube-api-access-pk7ss\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974221 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-grpc-tls\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974420 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974420 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-metrics-client-ca\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974420 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974420 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974679 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974679 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-tls\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.974679 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.974509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk7ss\" (UniqueName: \"kubernetes.io/projected/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-kube-api-access-pk7ss\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.975427 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.975400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-metrics-client-ca\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.977478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.977456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-grpc-tls\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.977478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.977474    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.977834 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.977512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.977952 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.977937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.978654 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.978627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-tls\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.979243 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.979221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:02.983793 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:02.983765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk7ss\" (UniqueName: \"kubernetes.io/projected/8691c20a-3cf1-4bde-a77a-3ba9f53afbd7-kube-api-access-pk7ss\") pod \"thanos-querier-6975cd5467-v8zg2\" (UID: \"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7\") " pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:03.019751 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.019715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:03.108431 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.108390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l" event={"ID":"f0e67c53-d908-4654-a4dc-7a88b3128a2f","Type":"ContainerStarted","Data":"227e9e8f527c5eb71daa6c7dc012a4f6dba72e398a3c1efb1e1a84d45d92e89b"}
Sep 08 15:14:03.108909 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.108461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l" event={"ID":"f0e67c53-d908-4654-a4dc-7a88b3128a2f","Type":"ContainerStarted","Data":"8e3926049f63560b13cd9b16a1fc4b27a1d7446fd053948e8ca19589cb7c2663"}
Sep 08 15:14:03.108909 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.108502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l" event={"ID":"f0e67c53-d908-4654-a4dc-7a88b3128a2f","Type":"ContainerStarted","Data":"c9fc9fd269c0d98a388902366e2ee417fb4570629701166cf75523e1f4c50d93"}
Sep 08 15:14:03.129310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.129261    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2t65l" podStartSLOduration=2.417741992 podStartE2EDuration="4.129243086s" totalImagesPullingTime="1.711501094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:03.128130125 +0000 UTC m=+63.787291248" watchObservedRunningTime="2026-09-08 15:14:03.129243086 +0000 UTC m=+63.788404213"
Sep 08 15:14:03.192113 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.192081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:03.333100 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.333062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:03.490668 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.490635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:03.585056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:03.584985    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6975cd5467-v8zg2"]
Sep 08 15:14:03.588459 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:03.588433    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8691c20a_3cf1_4bde_a77a_3ba9f53afbd7.slice/crio-d2f678d9e55b4dfa88a44bfd016484ea3c5df1535a64f8e28707ef27ff190447 WatchSource:0}: Error finding container d2f678d9e55b4dfa88a44bfd016484ea3c5df1535a64f8e28707ef27ff190447: Status 404 returned error can't find the container with id d2f678d9e55b4dfa88a44bfd016484ea3c5df1535a64f8e28707ef27ff190447
Sep 08 15:14:04.094318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.094281    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76f59bc69c-rd9hn"]
Sep 08 15:14:04.096850 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.096826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.104812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.102951    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 15:14:04.104812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.103266    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 15:14:04.104812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.103497    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cph00lo1b62pf\""
Sep 08 15:14:04.104812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.104425    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 15:14:04.104812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.104529    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t7plj\""
Sep 08 15:14:04.105117 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.104845    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 15:14:04.110480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.110458    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76f59bc69c-rd9hn"]
Sep 08 15:14:04.114379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.114354    2578 generic.go:356] "Generic (PLEG): container finished" podID="9a491b47-c0c4-45fa-828d-180476103cff" containerID="36dc69bd5bc1e8a5359f3353405dfb1411d4418c20dd9a50c159bd66ea00a58d" exitCode=0
Sep 08 15:14:04.114475 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.114433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerDied","Data":"36dc69bd5bc1e8a5359f3353405dfb1411d4418c20dd9a50c159bd66ea00a58d"}
Sep 08 15:14:04.116318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.116297    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b2f5c00-c523-46a3-a27e-969931c52c0a" containerID="d4d36cce851094de273dccce1e30cc8a8d04538cf2dea48751a23f18b1ca0b0d" exitCode=0
Sep 08 15:14:04.116403 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.116376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rkj7s" event={"ID":"6b2f5c00-c523-46a3-a27e-969931c52c0a","Type":"ContainerDied","Data":"d4d36cce851094de273dccce1e30cc8a8d04538cf2dea48751a23f18b1ca0b0d"}
Sep 08 15:14:04.117802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.117776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" event={"ID":"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7","Type":"ContainerStarted","Data":"d2f678d9e55b4dfa88a44bfd016484ea3c5df1535a64f8e28707ef27ff190447"}
Sep 08 15:14:04.185524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.185500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-secret-metrics-server-client-certs\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.185665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.185534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-metrics-server-audit-profiles\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.185665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.185614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-secret-metrics-server-tls\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.185665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.185659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-audit-log\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.185812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.185711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-client-ca-bundle\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.185812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.185739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwzb\" (UniqueName: \"kubernetes.io/projected/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-kube-api-access-7jwzb\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.185812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.185771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.287126 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwzb\" (UniqueName: \"kubernetes.io/projected/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-kube-api-access-7jwzb\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.287296 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.287296 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-secret-metrics-server-client-certs\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.287296 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-metrics-server-audit-profiles\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.287460 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-secret-metrics-server-tls\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.288627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-audit-log\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.288627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.288627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.287939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-client-ca-bundle\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.288627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.288212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-metrics-server-audit-profiles\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.288914 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.288704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-audit-log\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.289904 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.289884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-secret-metrics-server-client-certs\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.290113 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.290093    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-secret-metrics-server-tls\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.290449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.290431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-client-ca-bundle\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.296422 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.296402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwzb\" (UniqueName: \"kubernetes.io/projected/5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65-kube-api-access-7jwzb\") pod \"metrics-server-76f59bc69c-rd9hn\" (UID: \"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65\") " pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.410979 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.410903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:04.451865 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.451818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:04.454558 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.454516    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"]
Sep 08 15:14:04.456865 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.456846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.459973 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.459948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 15:14:04.460109 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.459948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kw48w\""
Sep 08 15:14:04.473025 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.472446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"]
Sep 08 15:14:04.494562 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.494336    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bc89598bc-4httf"]
Sep 08 15:14:04.496631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.496611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.499267 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.499223    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 15:14:04.499364 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.499273    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 15:14:04.499478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.499461    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 15:14:04.499636 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.499614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p8lf5\""
Sep 08 15:14:04.499730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.499639    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 15:14:04.500074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.499974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 15:14:04.500074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.500025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 15:14:04.500074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.500063    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 15:14:04.504899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.504878    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 15:14:04.510910 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.510890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc89598bc-4httf"]
Sep 08 15:14:04.542488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.542452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:04.590516 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b27716fc-0402-4679-ac33-1c9e8bc9b507-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-nm8jq\" (UID: \"b27716fc-0402-4679-ac33-1c9e8bc9b507\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.590692 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-service-ca\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.590692 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcws8\" (UniqueName: \"kubernetes.io/projected/b27716fc-0402-4679-ac33-1c9e8bc9b507-kube-api-access-dcws8\") pod \"monitoring-plugin-85bbbbbf4-nm8jq\" (UID: \"b27716fc-0402-4679-ac33-1c9e8bc9b507\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.590692 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-serving-cert\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.590692 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-console-config\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.590880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-562bf\" (UniqueName: \"kubernetes.io/projected/a4c20f14-bf33-42ef-b048-993c7f141756-kube-api-access-562bf\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.590880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-oauth-config\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.590880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-trusted-ca-bundle\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.590992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.590871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-oauth-serving-cert\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.691815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.691648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcws8\" (UniqueName: \"kubernetes.io/projected/b27716fc-0402-4679-ac33-1c9e8bc9b507-kube-api-access-dcws8\") pod \"monitoring-plugin-85bbbbbf4-nm8jq\" (UID: \"b27716fc-0402-4679-ac33-1c9e8bc9b507\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.691815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.691704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-serving-cert\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.691815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.691747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-console-config\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.691815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.691774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-562bf\" (UniqueName: \"kubernetes.io/projected/a4c20f14-bf33-42ef-b048-993c7f141756-kube-api-access-562bf\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.693101 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.692850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-oauth-config\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.693250 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.693195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-console-config\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.693731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.693376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-trusted-ca-bundle\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.693731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.693480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-oauth-serving-cert\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.693731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.693561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76f59bc69c-rd9hn"]
Sep 08 15:14:04.693731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.693571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b27716fc-0402-4679-ac33-1c9e8bc9b507-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-nm8jq\" (UID: \"b27716fc-0402-4679-ac33-1c9e8bc9b507\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.693731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.693629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-service-ca\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.700566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.694670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-oauth-serving-cert\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.700566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.694854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-service-ca\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.700566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.699257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-oauth-config\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.700566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.699640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b27716fc-0402-4679-ac33-1c9e8bc9b507-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-nm8jq\" (UID: \"b27716fc-0402-4679-ac33-1c9e8bc9b507\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.700566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.699736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-serving-cert\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.700566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.700035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-trusted-ca-bundle\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.702985 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.702904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcws8\" (UniqueName: \"kubernetes.io/projected/b27716fc-0402-4679-ac33-1c9e8bc9b507-kube-api-access-dcws8\") pod \"monitoring-plugin-85bbbbbf4-nm8jq\" (UID: \"b27716fc-0402-4679-ac33-1c9e8bc9b507\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.702985 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:04.702926    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7e2b7a_f818_47ee_b43e_f3bf1c6bef65.slice/crio-d13b5510676e195a2c0622663e25ef496e2d9382330d0b5bd63ddfee7b3b7ded WatchSource:0}: Error finding container d13b5510676e195a2c0622663e25ef496e2d9382330d0b5bd63ddfee7b3b7ded: Status 404 returned error can't find the container with id d13b5510676e195a2c0622663e25ef496e2d9382330d0b5bd63ddfee7b3b7ded
Sep 08 15:14:04.703571 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.703506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-562bf\" (UniqueName: \"kubernetes.io/projected/a4c20f14-bf33-42ef-b048-993c7f141756-kube-api-access-562bf\") pod \"console-5bc89598bc-4httf\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") " pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:04.714572 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.714548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:04.777957 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.777862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:04.807669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:04.807613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:05.060983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.060884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"]
Sep 08 15:14:05.063889 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:05.063857    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27716fc_0402_4679_ac33_1c9e8bc9b507.slice/crio-4d42b53b1fd0658155f975d593a13c5351dd5cb8f5dcf8ce0bc5c69657f6956b WatchSource:0}: Error finding container 4d42b53b1fd0658155f975d593a13c5351dd5cb8f5dcf8ce0bc5c69657f6956b: Status 404 returned error can't find the container with id 4d42b53b1fd0658155f975d593a13c5351dd5cb8f5dcf8ce0bc5c69657f6956b
Sep 08 15:14:05.091044 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.091017    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc89598bc-4httf"]
Sep 08 15:14:05.094025 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:05.094001    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c20f14_bf33_42ef_b048_993c7f141756.slice/crio-9ad64c920a5dc134c58679d1eaf3a7a166d0e39f7357b8c412bab1a2ac35a0bd WatchSource:0}: Error finding container 9ad64c920a5dc134c58679d1eaf3a7a166d0e39f7357b8c412bab1a2ac35a0bd: Status 404 returned error can't find the container with id 9ad64c920a5dc134c58679d1eaf3a7a166d0e39f7357b8c412bab1a2ac35a0bd
Sep 08 15:14:05.122645 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.122608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn" event={"ID":"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65","Type":"ContainerStarted","Data":"d13b5510676e195a2c0622663e25ef496e2d9382330d0b5bd63ddfee7b3b7ded"}
Sep 08 15:14:05.124234 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.124205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq" event={"ID":"b27716fc-0402-4679-ac33-1c9e8bc9b507","Type":"ContainerStarted","Data":"4d42b53b1fd0658155f975d593a13c5351dd5cb8f5dcf8ce0bc5c69657f6956b"}
Sep 08 15:14:05.127195 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.127172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rkj7s" event={"ID":"6b2f5c00-c523-46a3-a27e-969931c52c0a","Type":"ContainerStarted","Data":"1f9e16e15dac2110176dd72554578aaf0f2769d6ace24a59d30b5e7359ff7c7a"}
Sep 08 15:14:05.127299 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.127217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rkj7s" event={"ID":"6b2f5c00-c523-46a3-a27e-969931c52c0a","Type":"ContainerStarted","Data":"cbae40f66298cb5e98a90133467d89872f30c22fa52c9fa3e883da2ee1f734b1"}
Sep 08 15:14:05.128621 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.128569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc89598bc-4httf" event={"ID":"a4c20f14-bf33-42ef-b048-993c7f141756","Type":"ContainerStarted","Data":"9ad64c920a5dc134c58679d1eaf3a7a166d0e39f7357b8c412bab1a2ac35a0bd"}
Sep 08 15:14:05.145486 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.145436    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rkj7s" podStartSLOduration=2.85010528 podStartE2EDuration="6.145420477s" totalImagesPullingTime="3.233812781s" totalInitContainerRuntime="61.502416ms" isStatefulPod=true podCreationTimestamp="2026-09-08 15:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:05.144379338 +0000 UTC m=+65.803540466" watchObservedRunningTime="2026-09-08 15:14:05.145420477 +0000 UTC m=+65.804581604"
Sep 08 15:14:05.601683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.601647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:14:05.602256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.601756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:14:05.602256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.601787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:14:05.604450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.604235    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:14:05.604768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.604715    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:14:05.605119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.605093    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:14:05.614677 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.614644    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:14:05.615662 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.615635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a5fa953-84c7-4b92-b1e0-b78a8d2ef623-original-pull-secret\") pod \"global-pull-secret-syncer-2qjpj\" (UID: \"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623\") " pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:14:05.615772 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.615642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a794bf5-8ad3-4021-bbef-ef64dd10cfaa-metrics-certs\") pod \"network-metrics-daemon-qrzdq\" (UID: \"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa\") " pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:14:05.628563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.628506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q54h2\" (UniqueName: \"kubernetes.io/projected/b3e698d3-ff4e-45ec-ab17-1b87cf823bb3-kube-api-access-q54h2\") pod \"network-check-target-8xphl\" (UID: \"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3\") " pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:14:05.731239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.731179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qjpj"
Sep 08 15:14:05.738153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.737936    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ws5f4\""
Sep 08 15:14:05.746157 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.746131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qrzdq"
Sep 08 15:14:05.835101 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.834975    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dtm8b\""
Sep 08 15:14:05.844040 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.843891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:14:05.893458 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.893071    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 15:14:05.913194 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.913145    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:05.915149 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.914368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 15:14:05.916915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.916107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 15:14:05.916915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.916613    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 15:14:05.916915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.916772    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.917762    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2btg8\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.918802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.919132    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.919327    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.919350    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ctaomh48pghbn\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.919504    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.919626    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.919752    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.919829    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.920022    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.920566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 15:14:05.921148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.920742    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 15:14:05.922040 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.922015    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 15:14:05.951780 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:05.951742    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:06.108199 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-web-config\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3adabfcf-4d8c-4501-9411-fa4d29367742-config-out\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108511 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108511 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108601 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108601 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108696 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3adabfcf-4d8c-4501-9411-fa4d29367742-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108696 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108696 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108700    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108845 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108923 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.108964 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.109015 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc4kp\" (UniqueName: \"kubernetes.io/projected/3adabfcf-4d8c-4501-9411-fa4d29367742-kube-api-access-cc4kp\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.109015 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.108988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.109015 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.109009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-config\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210071 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210071 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc4kp\" (UniqueName: \"kubernetes.io/projected/3adabfcf-4d8c-4501-9411-fa4d29367742-kube-api-access-cc4kp\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-config\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-web-config\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3adabfcf-4d8c-4501-9411-fa4d29367742-config-out\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.210620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.211484 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.211484 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3adabfcf-4d8c-4501-9411-fa4d29367742-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.211484 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.210912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.211484 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.211361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.211710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.211601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.211956 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.211931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.213467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.212479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.213467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.213148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.213634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.213494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.214942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.214297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adabfcf-4d8c-4501-9411-fa4d29367742-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.214942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.214822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-web-config\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.214942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.214831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-config\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.217147 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.217087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.217794 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.217747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.217901 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.217808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.218733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.218708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.220056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.219565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.220056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.220010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3adabfcf-4d8c-4501-9411-fa4d29367742-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.220198 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.220119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.220198 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.220124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3adabfcf-4d8c-4501-9411-fa4d29367742-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.220343 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.220310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3adabfcf-4d8c-4501-9411-fa4d29367742-config-out\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.222177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.222155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc4kp\" (UniqueName: \"kubernetes.io/projected/3adabfcf-4d8c-4501-9411-fa4d29367742-kube-api-access-cc4kp\") pod \"prometheus-k8s-0\" (UID: \"3adabfcf-4d8c-4501-9411-fa4d29367742\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.232171 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.232021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:06.522296 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.522190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:06.619036 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:06.618972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:08.029223 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:08.029147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2qjpj"]
Sep 08 15:14:08.035544 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:08.035407    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8xphl"]
Sep 08 15:14:08.040330 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:08.040308    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qrzdq"]
Sep 08 15:14:08.056189 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:08.056141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 15:14:08.083966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:08.083930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cwcvm"
Sep 08 15:14:08.857404 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:08.857373    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5fa953_84c7_4b92_b1e0_b78a8d2ef623.slice/crio-f656394e15a9afc26c205a7cf611f6788d55da64ddae20fc7242a29fb45a64d5 WatchSource:0}: Error finding container f656394e15a9afc26c205a7cf611f6788d55da64ddae20fc7242a29fb45a64d5: Status 404 returned error can't find the container with id f656394e15a9afc26c205a7cf611f6788d55da64ddae20fc7242a29fb45a64d5
Sep 08 15:14:08.858378 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:08.858358    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e698d3_ff4e_45ec_ab17_1b87cf823bb3.slice/crio-b0b9015e4c0a08b6cee2453a04e88399ed61bc7cc8302dadae2e5c301c847088 WatchSource:0}: Error finding container b0b9015e4c0a08b6cee2453a04e88399ed61bc7cc8302dadae2e5c301c847088: Status 404 returned error can't find the container with id b0b9015e4c0a08b6cee2453a04e88399ed61bc7cc8302dadae2e5c301c847088
Sep 08 15:14:08.859701 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:08.859671    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adabfcf_4d8c_4501_9411_fa4d29367742.slice/crio-c97f20d89e5981bd4a14c20ae780586505ab37141308d6a20499cd61206cfc81 WatchSource:0}: Error finding container c97f20d89e5981bd4a14c20ae780586505ab37141308d6a20499cd61206cfc81: Status 404 returned error can't find the container with id c97f20d89e5981bd4a14c20ae780586505ab37141308d6a20499cd61206cfc81
Sep 08 15:14:08.860322 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:14:08.860302    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a794bf5_8ad3_4021_bbef_ef64dd10cfaa.slice/crio-05709f93171260075223ec49a8e052fa09a2e821e287f02d143fd35466692b26 WatchSource:0}: Error finding container 05709f93171260075223ec49a8e052fa09a2e821e287f02d143fd35466692b26: Status 404 returned error can't find the container with id 05709f93171260075223ec49a8e052fa09a2e821e287f02d143fd35466692b26
Sep 08 15:14:09.148478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.148394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" event={"ID":"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7","Type":"ContainerStarted","Data":"cb73e8b851d1601c0a623f43f149b96375a9bc0f9728ddb55c46783c10e1b019"}
Sep 08 15:14:09.148916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.148485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" event={"ID":"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7","Type":"ContainerStarted","Data":"5c364de43e66aeb2b4a92668a7bb44ecaf15cdd613d93ac1634c912b17d78ee4"}
Sep 08 15:14:09.148916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.148513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" event={"ID":"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7","Type":"ContainerStarted","Data":"c9ea29fcd01a7f4fed2d714d0fa01be84701e81f38a9fc73ab069292b0636fe7"}
Sep 08 15:14:09.150648 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.150528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc89598bc-4httf" event={"ID":"a4c20f14-bf33-42ef-b048-993c7f141756","Type":"ContainerStarted","Data":"f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69"}
Sep 08 15:14:09.151996 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.151962    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8xphl" event={"ID":"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3","Type":"ContainerStarted","Data":"b0b9015e4c0a08b6cee2453a04e88399ed61bc7cc8302dadae2e5c301c847088"}
Sep 08 15:14:09.153727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.153701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn" event={"ID":"5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65","Type":"ContainerStarted","Data":"c7ec578608f04bb085f9ff78ab598f03903fadca95ed4f91b355794dcbcd4d4f"}
Sep 08 15:14:09.156789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.156766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerStarted","Data":"2ac004d9af382b70aea3883022cf6b596607d7908837589530af86a5caef9d3f"}
Sep 08 15:14:09.156875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.156847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerStarted","Data":"ac5c313cc1378aff8e941bd3371134986d0bec06a3ec8e0ba3ef885bdd3e824a"}
Sep 08 15:14:09.158657 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.158629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq" event={"ID":"b27716fc-0402-4679-ac33-1c9e8bc9b507","Type":"ContainerStarted","Data":"de32ad695def88609724750596b85df3e3ef0a7a6347baed016806ca864ea80d"}
Sep 08 15:14:09.158793 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.158772    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:09.161287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.161259    2578 generic.go:356] "Generic (PLEG): container finished" podID="3adabfcf-4d8c-4501-9411-fa4d29367742" containerID="9c9aa060fecec80131df134f85122c4f5579c4a07e6e405e9922689fe49ad066" exitCode=0
Sep 08 15:14:09.161380 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.161332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerDied","Data":"9c9aa060fecec80131df134f85122c4f5579c4a07e6e405e9922689fe49ad066"}
Sep 08 15:14:09.161431 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.161387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerStarted","Data":"c97f20d89e5981bd4a14c20ae780586505ab37141308d6a20499cd61206cfc81"}
Sep 08 15:14:09.162866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.162788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2qjpj" event={"ID":"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623","Type":"ContainerStarted","Data":"f656394e15a9afc26c205a7cf611f6788d55da64ddae20fc7242a29fb45a64d5"}
Sep 08 15:14:09.164655 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.164624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qrzdq" event={"ID":"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa","Type":"ContainerStarted","Data":"05709f93171260075223ec49a8e052fa09a2e821e287f02d143fd35466692b26"}
Sep 08 15:14:09.164720 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.164704    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq"
Sep 08 15:14:09.183461 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.183418    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bc89598bc-4httf" podStartSLOduration=1.386968483 podStartE2EDuration="5.183405613s" totalImagesPullingTime="3.79643713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:09.182193806 +0000 UTC m=+69.841354934" watchObservedRunningTime="2026-09-08 15:14:09.183405613 +0000 UTC m=+69.842566739"
Sep 08 15:14:09.199561 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.199512    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nm8jq" podStartSLOduration=1.38559046 podStartE2EDuration="5.199495932s" totalImagesPullingTime="3.813905472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:09.198407466 +0000 UTC m=+69.857568594" watchObservedRunningTime="2026-09-08 15:14:09.199495932 +0000 UTC m=+69.858657056"
Sep 08 15:14:09.253478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.253408    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn" podStartSLOduration=2.19835825 podStartE2EDuration="5.253384861s" totalImagesPullingTime="3.055026611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:09.251267701 +0000 UTC m=+69.910428829" watchObservedRunningTime="2026-09-08 15:14:09.253384861 +0000 UTC m=+69.912545989"
Sep 08 15:14:09.267020 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.266985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:09.368133 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.368051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:09.505027 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.504992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:09.607206 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.607091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:09.866152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.866084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:09.932674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:09.932605    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:10.179001 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:10.178890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerStarted","Data":"04a194872aafe443a9617a0ef2a8e74b84f68b91bbe1d1da9d00c9dbf259db32"}
Sep 08 15:14:10.179458 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:10.179028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerStarted","Data":"90dda012f88bb3308edfd5e94a4e1f0f5eff22af45dc642524030fa08efda9c5"}
Sep 08 15:14:10.179458 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:10.179079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerStarted","Data":"08649f7ec237f3686d7a7339d66e1c86925b94c149caab0982f0494d45d5802e"}
Sep 08 15:14:10.747697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:10.747665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:10.852641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:10.852606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:10.957368 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:10.957330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:11.190489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.190329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a491b47-c0c4-45fa-828d-180476103cff","Type":"ContainerStarted","Data":"2964e292cf0504b0ad713baa7e409a41ab55c99bcfd44677b7759dc5301da72e"}
Sep 08 15:14:11.193200 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.193169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qrzdq" event={"ID":"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa","Type":"ContainerStarted","Data":"263d68e788c49c8000a6e0c8d9ff8ec996ab467ba17bf8202fbc4281e5667430"}
Sep 08 15:14:11.193318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.193228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qrzdq" event={"ID":"7a794bf5-8ad3-4021-bbef-ef64dd10cfaa","Type":"ContainerStarted","Data":"7828cb6d4f73ed64d01db9ecc3a8d0ce8cb0ad5f4a549900480b7a1793573278"}
Sep 08 15:14:11.198836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.198615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" event={"ID":"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7","Type":"ContainerStarted","Data":"ea8cf803ab8ec868f4eec67f747c221868008226fa6f9b4bfd7c25fca5549893"}
Sep 08 15:14:11.198836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.198688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" event={"ID":"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7","Type":"ContainerStarted","Data":"c12e80943bfea60df285b3fd4c210f5a21f2c56b6751bcf12ee31171c3025883"}
Sep 08 15:14:11.198836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.198783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" event={"ID":"8691c20a-3cf1-4bde-a77a-3ba9f53afbd7","Type":"ContainerStarted","Data":"f21d3c535587f3b088882e96ad47661ce8f4d85ab9b7187acfbdb1d68d2ac561"}
Sep 08 15:14:11.226170 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.226118    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.156104575 podStartE2EDuration="11.22609878s" totalImagesPullingTime="7.052620456s" totalInitContainerRuntime="17.373749ms" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:11.223021102 +0000 UTC m=+71.882182235" watchObservedRunningTime="2026-09-08 15:14:11.22609878 +0000 UTC m=+71.885259909"
Sep 08 15:14:11.256080 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.252481    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2" podStartSLOduration=3.838668614 podStartE2EDuration="9.252459956s" totalImagesPullingTime="5.413791342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:11.250132393 +0000 UTC m=+71.909293520" watchObservedRunningTime="2026-09-08 15:14:11.252459956 +0000 UTC m=+71.911621085"
Sep 08 15:14:11.276231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.276169    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qrzdq" podStartSLOduration=70.801070633 podStartE2EDuration="1m12.276147772s" totalImagesPullingTime="1.475077139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:11.273551756 +0000 UTC m=+71.932712884" watchObservedRunningTime="2026-09-08 15:14:11.276147772 +0000 UTC m=+71.935308900"
Sep 08 15:14:11.379441 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.379351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:11.449774 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:11.446223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:12.204346 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:12.204317    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:12.929525 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:12.929488    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:13.029641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:13.029607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:13.094325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:13.094286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:14.807734 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:14.807687    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:14.808214 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:14.807763    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:14.813206 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:14.813179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:15.224538 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.224437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8xphl" event={"ID":"b3e698d3-ff4e-45ec-ab17-1b87cf823bb3","Type":"ContainerStarted","Data":"a9a7529755bc0e7c97f21c109ec79ff4a904af159788e0067c142aacd253beb4"}
Sep 08 15:14:15.224799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.224735    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:14:15.243806 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.243689    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8xphl" podStartSLOduration=70.144323868 podStartE2EDuration="1m16.243667704s" totalImagesPullingTime="6.099343836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:15.242934797 +0000 UTC m=+75.902095926" watchObservedRunningTime="2026-09-08 15:14:15.243667704 +0000 UTC m=+75.902828831"
Sep 08 15:14:15.244501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.244465    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerStarted","Data":"5d7b2c11b718ace33f299b515953516ab915d2c368e332edbde2a4c87a1a9485"}
Sep 08 15:14:15.244640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.244547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerStarted","Data":"82c17d1189e3b172ccbab392546d3a84633d67b72eb107cf7407c4abf0bb6003"}
Sep 08 15:14:15.244640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.244607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerStarted","Data":"8cfd822aa0794f492f7fc3bb92c4ba664abc6aee99060dbcb4e91743bbcffd92"}
Sep 08 15:14:15.248933 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.248905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2qjpj" event={"ID":"7a5fa953-84c7-4b92-b1e0-b78a8d2ef623","Type":"ContainerStarted","Data":"86079a29ed6b69c6ca3e1d153b3d707b96921722860fd2bfedf237d020eeea42"}
Sep 08 15:14:15.256033 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.255993    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:14:15.265613 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.265436    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2qjpj" podStartSLOduration=70.136563954 podStartE2EDuration="1m16.265417648s" totalImagesPullingTime="6.128853694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:15.264691104 +0000 UTC m=+75.923852231" watchObservedRunningTime="2026-09-08 15:14:15.265417648 +0000 UTC m=+75.924578776"
Sep 08 15:14:15.444636 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.444609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:15.544703 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.544671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:15.603719 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:15.603635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:16.243004 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:16.242956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:16.253824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:16.253791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerStarted","Data":"c647204910326ab9d213fc74f1a686a1872eb2424b3dea4557f097a83a83efab"}
Sep 08 15:14:16.253976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:16.253872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerStarted","Data":"019775a1b2e67d9344474b4f6372134a1afeb9ae4dd9a7d7afce58e744220b15"}
Sep 08 15:14:16.253976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:16.253912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3adabfcf-4d8c-4501-9411-fa4d29367742","Type":"ContainerStarted","Data":"b40760d761fa88f26a86326d5dbe7a7e9ef362d1898b7da6ebdcb1afc0661349"}
Sep 08 15:14:16.284885 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:16.284817    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.419723881 podStartE2EDuration="11.284796823s" totalImagesPullingTime="5.815917745s" totalInitContainerRuntime="49.155197ms" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:16.2834945 +0000 UTC m=+76.942655650" watchObservedRunningTime="2026-09-08 15:14:16.284796823 +0000 UTC m=+76.943957950"
Sep 08 15:14:16.343769 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:16.343734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:18.213147 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:18.213118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6975cd5467-v8zg2"
Sep 08 15:14:18.240012 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:18.239979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:18.340554 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:18.340523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:21.233095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:21.233052    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:14:22.101657 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:22.101506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:22.520829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:22.520799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:23.678306 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:23.678274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:23.785528 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:23.785497    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:24.411837 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:24.411804    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:24.412016 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:24.411882    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:38.263021 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:38.262983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:38.660936 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:38.660847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:38.718966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:38.718943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:42.413091 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:42.413052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:44.417177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:44.417146    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:44.421135 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:44.421110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76f59bc69c-rd9hn"
Sep 08 15:14:45.847341 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:45.847310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:45.948980 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:45.948950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:46.048822 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:46.048794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:46.256686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:46.256653    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8xphl"
Sep 08 15:14:53.650794 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:53.650762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:14:53.705628 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:14:53.705577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:06.232795 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:06.232739    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:15:06.257449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:06.257141    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:15:06.477387 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:06.477355    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 15:15:18.887645 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:18.887609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:19.008782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:19.008745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:23.981175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.981142    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-775c88466f-w9xqc"]
Sep 08 15:15:23.983700 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.983680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:23.986191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.986166    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 15:15:23.986605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.986573    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 15:15:23.986761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.986613    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-96sf5\""
Sep 08 15:15:23.986905 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.986635    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 15:15:23.987001 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.986663    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 15:15:23.987125 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.986674    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 15:15:23.991243 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.991220    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 15:15:23.996303 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:23.996281    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775c88466f-w9xqc"]
Sep 08 15:15:24.105297 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-secret-telemeter-client\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.105489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.105489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8m2l\" (UniqueName: \"kubernetes.io/projected/7ca62860-7275-4e1a-b339-3d6b3c7bea44-kube-api-access-b8m2l\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.105489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-telemeter-client-tls\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.105489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-metrics-client-ca\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.105650 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-federate-client-tls\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.105650 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-serving-certs-ca-bundle\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.105650 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.105613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.206781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.206740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-telemeter-client-tls\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.206930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.206797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-metrics-client-ca\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.206930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.206834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-federate-client-tls\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.206930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.206859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-serving-certs-ca-bundle\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.206930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.206907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.207095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.206937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-secret-telemeter-client\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.207095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.207008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.207095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.207053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8m2l\" (UniqueName: \"kubernetes.io/projected/7ca62860-7275-4e1a-b339-3d6b3c7bea44-kube-api-access-b8m2l\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.207742 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.207715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-metrics-client-ca\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.207943 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.207799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-serving-certs-ca-bundle\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.208083 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.208032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca62860-7275-4e1a-b339-3d6b3c7bea44-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.209519 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.209488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.209644 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.209620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-federate-client-tls\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.209809 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.209794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-secret-telemeter-client\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.209846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.209808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7ca62860-7275-4e1a-b339-3d6b3c7bea44-telemeter-client-tls\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.214794 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.214769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8m2l\" (UniqueName: \"kubernetes.io/projected/7ca62860-7275-4e1a-b339-3d6b3c7bea44-kube-api-access-b8m2l\") pod \"telemeter-client-775c88466f-w9xqc\" (UID: \"7ca62860-7275-4e1a-b339-3d6b3c7bea44\") " pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.294275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.294198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc"
Sep 08 15:15:24.571832 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:24.571807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775c88466f-w9xqc"]
Sep 08 15:15:24.573646 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:15:24.573621    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca62860_7275_4e1a_b339_3d6b3c7bea44.slice/crio-f10ea44438cd9b2e4f1d5ffcb92659a6522e0e6f106fd333fb0b93b6ff2f0c15 WatchSource:0}: Error finding container f10ea44438cd9b2e4f1d5ffcb92659a6522e0e6f106fd333fb0b93b6ff2f0c15: Status 404 returned error can't find the container with id f10ea44438cd9b2e4f1d5ffcb92659a6522e0e6f106fd333fb0b93b6ff2f0c15
Sep 08 15:15:25.536813 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:25.536772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc" event={"ID":"7ca62860-7275-4e1a-b339-3d6b3c7bea44","Type":"ContainerStarted","Data":"f10ea44438cd9b2e4f1d5ffcb92659a6522e0e6f106fd333fb0b93b6ff2f0c15"}
Sep 08 15:15:27.548471 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:27.548432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc" event={"ID":"7ca62860-7275-4e1a-b339-3d6b3c7bea44","Type":"ContainerStarted","Data":"75f52e9af50b42b7cec083653cf8cc892194c12974ece257246d9f3c2101212e"}
Sep 08 15:15:27.548847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:27.548497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc" event={"ID":"7ca62860-7275-4e1a-b339-3d6b3c7bea44","Type":"ContainerStarted","Data":"9a5a7d981935d508877b5fb26fcda45e5f0e1890cc741d18beb55f4936e5c739"}
Sep 08 15:15:27.548847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:27.548517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc" event={"ID":"7ca62860-7275-4e1a-b339-3d6b3c7bea44","Type":"ContainerStarted","Data":"61c8c6fab23efc8b71654f09fa0554215bf8c048389e7a1ec4ff8348302c57b6"}
Sep 08 15:15:27.572476 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:27.572421    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-775c88466f-w9xqc" podStartSLOduration=2.214601831 podStartE2EDuration="4.57240343s" totalImagesPullingTime="2.357801599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:27.570642627 +0000 UTC m=+148.229803754" watchObservedRunningTime="2026-09-08 15:15:27.57240343 +0000 UTC m=+148.231564557"
Sep 08 15:15:27.706056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:27.706020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:34.091468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:34.091430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:34.274828 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:34.274794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:38.593209 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:38.593173    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc89598bc-4httf"]
Sep 08 15:15:38.736833 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:38.736800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:39.264716 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:39.264680    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:39.331928 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:39.331896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:39.644744 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:39.644658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:39.697168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:39.697129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:40.446729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:40.446697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:40.548211 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:40.548163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:46.027713 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:46.027674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:46.080025 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:46.079990    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:49.745360 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:49.745316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:49.845766 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:49.845740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:49.908655 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:49.908602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:53.687356 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:53.687271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:53.788900 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:53.788858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:15:53.848391 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:15:53.848353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:03.613033 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.612970    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bc89598bc-4httf" podUID="a4c20f14-bf33-42ef-b048-993c7f141756" containerName="console" containerID="cri-o://f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69" gracePeriod=15
Sep 08 15:16:03.851989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.851965    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:16:03.958225 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958186    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-oauth-serving-cert\") pod \"a4c20f14-bf33-42ef-b048-993c7f141756\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") "
Sep 08 15:16:03.958405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-console-config\") pod \"a4c20f14-bf33-42ef-b048-993c7f141756\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") "
Sep 08 15:16:03.958405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958300    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-oauth-config\") pod \"a4c20f14-bf33-42ef-b048-993c7f141756\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") "
Sep 08 15:16:03.958405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958320    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-trusted-ca-bundle\") pod \"a4c20f14-bf33-42ef-b048-993c7f141756\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") "
Sep 08 15:16:03.958405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958346    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-service-ca\") pod \"a4c20f14-bf33-42ef-b048-993c7f141756\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") "
Sep 08 15:16:03.958405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-serving-cert\") pod \"a4c20f14-bf33-42ef-b048-993c7f141756\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") "
Sep 08 15:16:03.958405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-562bf\" (UniqueName: \"kubernetes.io/projected/a4c20f14-bf33-42ef-b048-993c7f141756-kube-api-access-562bf\") pod \"a4c20f14-bf33-42ef-b048-993c7f141756\" (UID: \"a4c20f14-bf33-42ef-b048-993c7f141756\") "
Sep 08 15:16:03.958828 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a4c20f14-bf33-42ef-b048-993c7f141756" (UID: "a4c20f14-bf33-42ef-b048-993c7f141756"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:03.958945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958824    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a4c20f14-bf33-42ef-b048-993c7f141756" (UID: "a4c20f14-bf33-42ef-b048-993c7f141756"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:03.958945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958800    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-console-config" (OuterVolumeSpecName: "console-config") pod "a4c20f14-bf33-42ef-b048-993c7f141756" (UID: "a4c20f14-bf33-42ef-b048-993c7f141756"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:03.958945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.958910    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-service-ca" (OuterVolumeSpecName: "service-ca") pod "a4c20f14-bf33-42ef-b048-993c7f141756" (UID: "a4c20f14-bf33-42ef-b048-993c7f141756"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:03.960899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.960865    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a4c20f14-bf33-42ef-b048-993c7f141756" (UID: "a4c20f14-bf33-42ef-b048-993c7f141756"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:16:03.960899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.960890    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c20f14-bf33-42ef-b048-993c7f141756-kube-api-access-562bf" (OuterVolumeSpecName: "kube-api-access-562bf") pod "a4c20f14-bf33-42ef-b048-993c7f141756" (UID: "a4c20f14-bf33-42ef-b048-993c7f141756"). InnerVolumeSpecName "kube-api-access-562bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:16:03.961031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:03.960917    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a4c20f14-bf33-42ef-b048-993c7f141756" (UID: "a4c20f14-bf33-42ef-b048-993c7f141756"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:16:04.059688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.059639    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-console-config\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:16:04.059688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.059681    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-oauth-config\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:16:04.059688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.059694    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-trusted-ca-bundle\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:16:04.059688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.059702    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:16:04.059958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.059712    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4c20f14-bf33-42ef-b048-993c7f141756-console-serving-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:16:04.059958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.059720    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-562bf\" (UniqueName: \"kubernetes.io/projected/a4c20f14-bf33-42ef-b048-993c7f141756-kube-api-access-562bf\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:16:04.059958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.059729    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4c20f14-bf33-42ef-b048-993c7f141756-oauth-serving-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:16:04.692687 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.692648    2578 generic.go:356] "Generic (PLEG): container finished" podID="a4c20f14-bf33-42ef-b048-993c7f141756" containerID="f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69" exitCode=0
Sep 08 15:16:04.693072 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.692697    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc89598bc-4httf"
Sep 08 15:16:04.693072 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.692697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc89598bc-4httf" event={"ID":"a4c20f14-bf33-42ef-b048-993c7f141756","Type":"ContainerDied","Data":"f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69"}
Sep 08 15:16:04.693072 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.692750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc89598bc-4httf" event={"ID":"a4c20f14-bf33-42ef-b048-993c7f141756","Type":"ContainerDied","Data":"9ad64c920a5dc134c58679d1eaf3a7a166d0e39f7357b8c412bab1a2ac35a0bd"}
Sep 08 15:16:04.693072 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.692794    2578 scope.go:117] "RemoveContainer" containerID="f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69"
Sep 08 15:16:04.701634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.701614    2578 scope.go:117] "RemoveContainer" containerID="f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69"
Sep 08 15:16:04.701926 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:16:04.701906    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69\": container with ID starting with f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69 not found: ID does not exist" containerID="f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69"
Sep 08 15:16:04.701979 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.701934    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69"} err="failed to get container status \"f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69\": rpc error: code = NotFound desc = could not find container \"f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69\": container with ID starting with f6a81fcc0138c70c090d5531c0fa56a54a0873b341a57d603f2f5cff07c5fc69 not found: ID does not exist"
Sep 08 15:16:04.718609 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.718566    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc89598bc-4httf"]
Sep 08 15:16:04.722382 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:04.722359    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bc89598bc-4httf"]
Sep 08 15:16:05.825848 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:05.825814    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c20f14-bf33-42ef-b048-993c7f141756" path="/var/lib/kubelet/pods/a4c20f14-bf33-42ef-b048-993c7f141756/volumes"
Sep 08 15:16:07.193225 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:07.193191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:08.787405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:08.787367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:23.206362 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:23.206321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:23.302696 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:23.302667    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:28.981278 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:28.981240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:29.078785 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:29.078742    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:48.017420 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:48.017389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:55.788957 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:55.788923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:56.578599 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:56.578554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:59.414652 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:59.414610    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:16:59.513838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:16:59.513808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:01.293225 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.293188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:01.427971 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.427936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:01.725000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.724968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:01.841768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.841730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:01.902064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.902030    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k8cvx"]
Sep 08 15:17:01.902366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.902353    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c20f14-bf33-42ef-b048-993c7f141756" containerName="console"
Sep 08 15:17:01.902411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.902366    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c20f14-bf33-42ef-b048-993c7f141756" containerName="console"
Sep 08 15:17:01.902450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.902419    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c20f14-bf33-42ef-b048-993c7f141756" containerName="console"
Sep 08 15:17:01.906106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.906088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:01.908840 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.908815    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 15:17:01.908840 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.908832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 15:17:01.914694 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:01.914674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k8cvx"]
Sep 08 15:17:02.053010 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.052924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj5gd\" (UniqueName: \"kubernetes.io/projected/be289593-8f5c-4c25-9951-aaaacab6f9ea-kube-api-access-bj5gd\") pod \"cert-manager-webhook-6486ffd997-k8cvx\" (UID: \"be289593-8f5c-4c25-9951-aaaacab6f9ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:02.053010 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.052993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be289593-8f5c-4c25-9951-aaaacab6f9ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k8cvx\" (UID: \"be289593-8f5c-4c25-9951-aaaacab6f9ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:02.153701 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.153667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be289593-8f5c-4c25-9951-aaaacab6f9ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k8cvx\" (UID: \"be289593-8f5c-4c25-9951-aaaacab6f9ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:02.153896 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.153724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj5gd\" (UniqueName: \"kubernetes.io/projected/be289593-8f5c-4c25-9951-aaaacab6f9ea-kube-api-access-bj5gd\") pod \"cert-manager-webhook-6486ffd997-k8cvx\" (UID: \"be289593-8f5c-4c25-9951-aaaacab6f9ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:02.163192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.163157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be289593-8f5c-4c25-9951-aaaacab6f9ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k8cvx\" (UID: \"be289593-8f5c-4c25-9951-aaaacab6f9ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:02.163603 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.163571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj5gd\" (UniqueName: \"kubernetes.io/projected/be289593-8f5c-4c25-9951-aaaacab6f9ea-kube-api-access-bj5gd\") pod \"cert-manager-webhook-6486ffd997-k8cvx\" (UID: \"be289593-8f5c-4c25-9951-aaaacab6f9ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:02.228512 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.228473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:02.500600 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.500558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k8cvx"]
Sep 08 15:17:02.503383 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:17:02.503357    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe289593_8f5c_4c25_9951_aaaacab6f9ea.slice/crio-79df3f315bfd7cfb5b9c41be23414ea6e231f7c26baeafc6bacec4c429d7188f WatchSource:0}: Error finding container 79df3f315bfd7cfb5b9c41be23414ea6e231f7c26baeafc6bacec4c429d7188f: Status 404 returned error can't find the container with id 79df3f315bfd7cfb5b9c41be23414ea6e231f7c26baeafc6bacec4c429d7188f
Sep 08 15:17:02.922177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:02.922097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx" event={"ID":"be289593-8f5c-4c25-9951-aaaacab6f9ea","Type":"ContainerStarted","Data":"79df3f315bfd7cfb5b9c41be23414ea6e231f7c26baeafc6bacec4c429d7188f"}
Sep 08 15:17:03.505553 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:03.505517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:04.094361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:04.094286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:05.937648 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:05.937534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx" event={"ID":"be289593-8f5c-4c25-9951-aaaacab6f9ea","Type":"ContainerStarted","Data":"6ea1811c808dd039454bfaf395a68a5eec999dbf1ed7993793ea81ab55e5e053"}
Sep 08 15:17:05.937648 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:05.937615    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:05.953695 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:05.953644    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx" podStartSLOduration=1.927490068 podStartE2EDuration="4.953627755s" totalImagesPullingTime="3.026137687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:17:05.952279527 +0000 UTC m=+246.611440654" watchObservedRunningTime="2026-09-08 15:17:05.953627755 +0000 UTC m=+246.612788882"
Sep 08 15:17:06.396195 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:06.396163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:06.496851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:06.496816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:11.943919 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:11.943881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k8cvx"
Sep 08 15:17:12.895092 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:12.895053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:13.945277 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:13.945248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:14.004024 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:14.003987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:15.601947 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.601911    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"]
Sep 08 15:17:15.605516 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.605495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:15.608796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.608775    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rxh6m\""
Sep 08 15:17:15.608796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.608793    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 15:17:15.608796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.608777    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:17:15.623468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.623447    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"]
Sep 08 15:17:15.668712 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.668676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2b896c-a082-470f-92bb-644484219ba8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vt87z\" (UID: \"0f2b896c-a082-470f-92bb-644484219ba8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:15.668860 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.668727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4z7k\" (UniqueName: \"kubernetes.io/projected/0f2b896c-a082-470f-92bb-644484219ba8-kube-api-access-m4z7k\") pod \"openshift-lws-operator-fd8ccff4c-vt87z\" (UID: \"0f2b896c-a082-470f-92bb-644484219ba8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:15.769599 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.769541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2b896c-a082-470f-92bb-644484219ba8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vt87z\" (UID: \"0f2b896c-a082-470f-92bb-644484219ba8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:15.769762 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.769614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4z7k\" (UniqueName: \"kubernetes.io/projected/0f2b896c-a082-470f-92bb-644484219ba8-kube-api-access-m4z7k\") pod \"openshift-lws-operator-fd8ccff4c-vt87z\" (UID: \"0f2b896c-a082-470f-92bb-644484219ba8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:15.769958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.769939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2b896c-a082-470f-92bb-644484219ba8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vt87z\" (UID: \"0f2b896c-a082-470f-92bb-644484219ba8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:15.778433 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.778403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4z7k\" (UniqueName: \"kubernetes.io/projected/0f2b896c-a082-470f-92bb-644484219ba8-kube-api-access-m4z7k\") pod \"openshift-lws-operator-fd8ccff4c-vt87z\" (UID: \"0f2b896c-a082-470f-92bb-644484219ba8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:15.915256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:15.915173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"
Sep 08 15:17:16.189703 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:16.189679    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z"]
Sep 08 15:17:16.191891 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:17:16.191862    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f2b896c_a082_470f_92bb_644484219ba8.slice/crio-15bef8638d549bf7b88464c57d5f5928817c709719f71a968d3915353f1cf2ab WatchSource:0}: Error finding container 15bef8638d549bf7b88464c57d5f5928817c709719f71a968d3915353f1cf2ab: Status 404 returned error can't find the container with id 15bef8638d549bf7b88464c57d5f5928817c709719f71a968d3915353f1cf2ab
Sep 08 15:17:16.989225 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:16.989184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z" event={"ID":"0f2b896c-a082-470f-92bb-644484219ba8","Type":"ContainerStarted","Data":"15bef8638d549bf7b88464c57d5f5928817c709719f71a968d3915353f1cf2ab"}
Sep 08 15:17:17.650149 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:17.650100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:17.749296 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:17.749261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:19.005511 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:19.005471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z" event={"ID":"0f2b896c-a082-470f-92bb-644484219ba8","Type":"ContainerStarted","Data":"1344bf019b484e6cb456138c7e5cd7c2d533354cd876c02ab7bfd1087a68f3da"}
Sep 08 15:17:19.024323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:19.024277    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vt87z" podStartSLOduration=1.743066078 podStartE2EDuration="4.024262277s" totalImagesPullingTime="2.281196199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:17:19.023990764 +0000 UTC m=+259.683151892" watchObservedRunningTime="2026-09-08 15:17:19.024262277 +0000 UTC m=+259.683423404"
Sep 08 15:17:19.760108 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:19.760074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:19.861882 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:19.861843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:21.438497 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:21.438467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:37.701788 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:37.701696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:38.641841 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:38.641789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:38.737745 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:38.737711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:38.856529 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:38.856498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:38.957747 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:38.957720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:39.001050 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.001016    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"]
Sep 08 15:17:39.006398 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.006372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.009496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.009473    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 15:17:39.009705 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.009686    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xw2jq\""
Sep 08 15:17:39.009782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.009760    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 15:17:39.009877 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.009859    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 15:17:39.009937 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.009860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 15:17:39.033824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.033788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"]
Sep 08 15:17:39.074490 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.074456    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wbhv\" (UniqueName: \"kubernetes.io/projected/70527504-0fe4-4a88-a1f4-2c006cba6f67-kube-api-access-5wbhv\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.074669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.074509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70527504-0fe4-4a88-a1f4-2c006cba6f67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.074669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.074557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70527504-0fe4-4a88-a1f4-2c006cba6f67-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.074669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.074609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70527504-0fe4-4a88-a1f4-2c006cba6f67-tmp\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.074669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.074625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70527504-0fe4-4a88-a1f4-2c006cba6f67-manifests\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.175277 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.175238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70527504-0fe4-4a88-a1f4-2c006cba6f67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.175277 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.175275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70527504-0fe4-4a88-a1f4-2c006cba6f67-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.175485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.175318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70527504-0fe4-4a88-a1f4-2c006cba6f67-tmp\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.175485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.175338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70527504-0fe4-4a88-a1f4-2c006cba6f67-manifests\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.175485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.175398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wbhv\" (UniqueName: \"kubernetes.io/projected/70527504-0fe4-4a88-a1f4-2c006cba6f67-kube-api-access-5wbhv\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.175819 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.175798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70527504-0fe4-4a88-a1f4-2c006cba6f67-manifests\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.177659 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.177637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70527504-0fe4-4a88-a1f4-2c006cba6f67-tmp\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.177986 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.177963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70527504-0fe4-4a88-a1f4-2c006cba6f67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.178085 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.177963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70527504-0fe4-4a88-a1f4-2c006cba6f67-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.194807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.194781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wbhv\" (UniqueName: \"kubernetes.io/projected/70527504-0fe4-4a88-a1f4-2c006cba6f67-kube-api-access-5wbhv\") pod \"opendatahub-operator-controller-manager-68dbb6d945-q42jc\" (UID: \"70527504-0fe4-4a88-a1f4-2c006cba6f67\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.251455 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.251374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:39.316514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.316477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:39.460799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.460768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:39.568239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.568157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:39.591299 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.591277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"]
Sep 08 15:17:39.594018 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:17:39.593991    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70527504_0fe4_4a88_a1f4_2c006cba6f67.slice/crio-11260d2314d891686fa1b3bde167f1681849a85b03aaed07c3fa2011fb3fd72c WatchSource:0}: Error finding container 11260d2314d891686fa1b3bde167f1681849a85b03aaed07c3fa2011fb3fd72c: Status 404 returned error can't find the container with id 11260d2314d891686fa1b3bde167f1681849a85b03aaed07c3fa2011fb3fd72c
Sep 08 15:17:39.647327 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.647302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:39.746150 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.746117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:39.850210 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:39.850130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:40.089127 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:40.089096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc" event={"ID":"70527504-0fe4-4a88-a1f4-2c006cba6f67","Type":"ContainerStarted","Data":"11260d2314d891686fa1b3bde167f1681849a85b03aaed07c3fa2011fb3fd72c"}
Sep 08 15:17:43.105887 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:43.105854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc" event={"ID":"70527504-0fe4-4a88-a1f4-2c006cba6f67","Type":"ContainerStarted","Data":"534337eab5727ea5becbf5c2cb122ca9ecae47d0ea95e7b5f231672987d9a668"}
Sep 08 15:17:44.111643 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:44.111545    2578 generic.go:356] "Generic (PLEG): container finished" podID="70527504-0fe4-4a88-a1f4-2c006cba6f67" containerID="534337eab5727ea5becbf5c2cb122ca9ecae47d0ea95e7b5f231672987d9a668" exitCode=0
Sep 08 15:17:44.111643 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:44.111617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc" event={"ID":"70527504-0fe4-4a88-a1f4-2c006cba6f67","Type":"ContainerDied","Data":"534337eab5727ea5becbf5c2cb122ca9ecae47d0ea95e7b5f231672987d9a668"}
Sep 08 15:17:45.118908 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:45.118869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc" event={"ID":"70527504-0fe4-4a88-a1f4-2c006cba6f67","Type":"ContainerStarted","Data":"74cec5a600e1bf4dbb6906f0a2303f866b69fd8a0fc56ae16d74605a745216e3"}
Sep 08 15:17:45.119297 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:45.118984    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:45.148032 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:45.147980    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc" podStartSLOduration=2.725364694 podStartE2EDuration="7.14796431s" totalImagesPullingTime="3.348475668s" totalInitContainerRuntime="1.074123948s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:17:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:17:45.146008662 +0000 UTC m=+285.805169826" watchObservedRunningTime="2026-09-08 15:17:45.14796431 +0000 UTC m=+285.807125437"
Sep 08 15:17:47.756247 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:47.756211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:51.478228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:51.478195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:17:56.125931 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:56.125895    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-q42jc"
Sep 08 15:17:59.733877 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:17:59.733848    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 15:18:00.699952 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:00.699918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:00.870209 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:00.870179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:01.832401 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:01.832361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:01.994670 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:01.994630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:03.053307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:03.053272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:03.119293 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:03.119262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:03.997589 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:03.997559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:08.034311 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.034277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:08.134375 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.134337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:08.232109 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.232077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:08.488875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.488841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:08.536076 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.536043    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"]
Sep 08 15:18:08.538383 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.538367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.541041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.541009    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:18:08.541170 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.541070    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 15:18:08.541170 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.541015    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wv5cn\""
Sep 08 15:18:08.541897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.541882    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 15:18:08.551013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.550988    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"]
Sep 08 15:18:08.570301 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.570270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:08.634248 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnttb\" (UniqueName: \"kubernetes.io/projected/6d7ed442-43a6-461d-baf8-7f35dfe3e120-kube-api-access-nnttb\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634658 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.634658 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.634453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735219 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735219 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnttb\" (UniqueName: \"kubernetes.io/projected/6d7ed442-43a6-461d-baf8-7f35dfe3e120-kube-api-access-nnttb\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.735958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.735801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.736111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.736003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.736111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.736046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.737682 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.737655    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.737915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.737898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.744527 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.744473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7ed442-43a6-461d-baf8-7f35dfe3e120-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.745384 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.745362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnttb\" (UniqueName: \"kubernetes.io/projected/6d7ed442-43a6-461d-baf8-7f35dfe3e120-kube-api-access-nnttb\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr\" (UID: \"6d7ed442-43a6-461d-baf8-7f35dfe3e120\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:08.849129 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:08.849093    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:09.121336 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:09.121312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"]
Sep 08 15:18:09.123789 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:18:09.123764    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7ed442_43a6_461d_baf8_7f35dfe3e120.slice/crio-c251dc60a533b1e3d67387256ed4b38d403a86624551cdb6a82729426a85a2b1 WatchSource:0}: Error finding container c251dc60a533b1e3d67387256ed4b38d403a86624551cdb6a82729426a85a2b1: Status 404 returned error can't find the container with id c251dc60a533b1e3d67387256ed4b38d403a86624551cdb6a82729426a85a2b1
Sep 08 15:18:09.126065 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:09.126045    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:18:09.229686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:09.229650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr" event={"ID":"6d7ed442-43a6-461d-baf8-7f35dfe3e120","Type":"ContainerStarted","Data":"c251dc60a533b1e3d67387256ed4b38d403a86624551cdb6a82729426a85a2b1"}
Sep 08 15:18:11.805158 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:11.805114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:11.902335 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:11.902297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:11.954701 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:11.954662    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:18:11.954835 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:11.954747    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:18:11.954835 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:11.954789    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:18:12.247899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.247865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr" event={"ID":"6d7ed442-43a6-461d-baf8-7f35dfe3e120","Type":"ContainerStarted","Data":"94e9624ce7decd8d6663b01ba9c0dae67726a5b190f59c41756c8b16232cfe1d"}
Sep 08 15:18:12.263905 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.263875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:12.309760 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.309688    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr" podStartSLOduration=1.481465812 podStartE2EDuration="4.309665638s" totalImagesPullingTime="2.828199826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:12.268689394 +0000 UTC m=+312.927850539" watchObservedRunningTime="2026-09-08 15:18:12.309665638 +0000 UTC m=+312.968826770"
Sep 08 15:18:12.310353 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.310329    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k6wlp"]
Sep 08 15:18:12.313379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.313355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:12.315895 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.315875    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 15:18:12.315996 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.315927    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nvc5s\""
Sep 08 15:18:12.324639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.324611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k6wlp"]
Sep 08 15:18:12.368558 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.368529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjpz\" (UniqueName: \"kubernetes.io/projected/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-kube-api-access-zwjpz\") pod \"model-serving-api-54d89bd5fc-k6wlp\" (UID: \"e0fb3cbe-f0d2-4a2a-804c-c02202baa614\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:12.368780 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.368609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6wlp\" (UID: \"e0fb3cbe-f0d2-4a2a-804c-c02202baa614\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:12.469686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.469641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6wlp\" (UID: \"e0fb3cbe-f0d2-4a2a-804c-c02202baa614\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:12.469870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.469752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjpz\" (UniqueName: \"kubernetes.io/projected/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-kube-api-access-zwjpz\") pod \"model-serving-api-54d89bd5fc-k6wlp\" (UID: \"e0fb3cbe-f0d2-4a2a-804c-c02202baa614\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:12.469870 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:18:12.469786    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 08 15:18:12.469870 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:18:12.469854    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-tls-certs podName:e0fb3cbe-f0d2-4a2a-804c-c02202baa614 nodeName:}" failed. No retries permitted until 2026-09-08 15:18:12.969838276 +0000 UTC m=+313.628999381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-tls-certs") pod "model-serving-api-54d89bd5fc-k6wlp" (UID: "e0fb3cbe-f0d2-4a2a-804c-c02202baa614") : secret "model-serving-api-tls" not found
Sep 08 15:18:12.481183 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.481145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjpz\" (UniqueName: \"kubernetes.io/projected/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-kube-api-access-zwjpz\") pod \"model-serving-api-54d89bd5fc-k6wlp\" (UID: \"e0fb3cbe-f0d2-4a2a-804c-c02202baa614\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:12.849573 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.849538    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:12.976152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.976114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6wlp\" (UID: \"e0fb3cbe-f0d2-4a2a-804c-c02202baa614\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:12.978606 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:12.978567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0fb3cbe-f0d2-4a2a-804c-c02202baa614-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6wlp\" (UID: \"e0fb3cbe-f0d2-4a2a-804c-c02202baa614\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:13.226817 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:13.226770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:13.498004 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:13.497925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k6wlp"]
Sep 08 15:18:13.501491 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:18:13.501461    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fb3cbe_f0d2_4a2a_804c_c02202baa614.slice/crio-84df482061a86447c7fec88d9af2b7dcdf12a48d00dceba54c3595e58927e436 WatchSource:0}: Error finding container 84df482061a86447c7fec88d9af2b7dcdf12a48d00dceba54c3595e58927e436: Status 404 returned error can't find the container with id 84df482061a86447c7fec88d9af2b7dcdf12a48d00dceba54c3595e58927e436
Sep 08 15:18:13.854893 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:13.854820    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:14.261742 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:14.261665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp" event={"ID":"e0fb3cbe-f0d2-4a2a-804c-c02202baa614","Type":"ContainerStarted","Data":"84df482061a86447c7fec88d9af2b7dcdf12a48d00dceba54c3595e58927e436"}
Sep 08 15:18:14.263344 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:14.262440    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:14.263955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:14.263750    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr"
Sep 08 15:18:14.292124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:14.292052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:14.387866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:14.387832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:16.280245 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:16.280206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp" event={"ID":"e0fb3cbe-f0d2-4a2a-804c-c02202baa614","Type":"ContainerStarted","Data":"459e76b2b10fe8d8416d7a9d85cc125d30ac0ff692331c8f335e847e8148123e"}
Sep 08 15:18:16.280673 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:16.280315    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:16.298320 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:16.298271    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp" podStartSLOduration=1.683488413 podStartE2EDuration="4.298255217s" totalImagesPullingTime="2.614766804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:16.296367917 +0000 UTC m=+316.955529046" watchObservedRunningTime="2026-09-08 15:18:16.298255217 +0000 UTC m=+316.957416344"
Sep 08 15:18:21.723425 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.723388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:21.782308 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.782271    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"]
Sep 08 15:18:21.784815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.784794    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:21.788228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.788167    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8spvq\""
Sep 08 15:18:21.788353 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.788245    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 15:18:21.789398 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.789379    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"]
Sep 08 15:18:21.791804 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.791783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:21.793782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.793756    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"]
Sep 08 15:18:21.794438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.794419    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 15:18:21.794984 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.794961    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7lkdh\""
Sep 08 15:18:21.808752 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.808729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"]
Sep 08 15:18:21.811366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.811346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:21.856449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.856411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7459a629-a3cb-405e-9714-de32ecc35e6c-cert\") pod \"kserve-controller-manager-d6f4b65b8-h7c66\" (UID: \"7459a629-a3cb-405e-9714-de32ecc35e6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:21.856659 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.856455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sngnq\" (UniqueName: \"kubernetes.io/projected/c1bb4d86-9bfe-4878-8d6e-2caa24911179-kube-api-access-sngnq\") pod \"llmisvc-controller-manager-777c6bd7d5-dt25d\" (UID: \"c1bb4d86-9bfe-4878-8d6e-2caa24911179\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:21.856659 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.856547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bb4d86-9bfe-4878-8d6e-2caa24911179-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dt25d\" (UID: \"c1bb4d86-9bfe-4878-8d6e-2caa24911179\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:21.856659 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.856628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjp6\" (UniqueName: \"kubernetes.io/projected/7459a629-a3cb-405e-9714-de32ecc35e6c-kube-api-access-9rjp6\") pod \"kserve-controller-manager-d6f4b65b8-h7c66\" (UID: \"7459a629-a3cb-405e-9714-de32ecc35e6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:21.958078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.958045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bb4d86-9bfe-4878-8d6e-2caa24911179-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dt25d\" (UID: \"c1bb4d86-9bfe-4878-8d6e-2caa24911179\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:21.958243 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.958091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjp6\" (UniqueName: \"kubernetes.io/projected/7459a629-a3cb-405e-9714-de32ecc35e6c-kube-api-access-9rjp6\") pod \"kserve-controller-manager-d6f4b65b8-h7c66\" (UID: \"7459a629-a3cb-405e-9714-de32ecc35e6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:21.958243 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.958144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7459a629-a3cb-405e-9714-de32ecc35e6c-cert\") pod \"kserve-controller-manager-d6f4b65b8-h7c66\" (UID: \"7459a629-a3cb-405e-9714-de32ecc35e6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:21.958243 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.958165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sngnq\" (UniqueName: \"kubernetes.io/projected/c1bb4d86-9bfe-4878-8d6e-2caa24911179-kube-api-access-sngnq\") pod \"llmisvc-controller-manager-777c6bd7d5-dt25d\" (UID: \"c1bb4d86-9bfe-4878-8d6e-2caa24911179\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:21.958243 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:18:21.958197    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 15:18:21.958377 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:18:21.958268    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bb4d86-9bfe-4878-8d6e-2caa24911179-cert podName:c1bb4d86-9bfe-4878-8d6e-2caa24911179 nodeName:}" failed. No retries permitted until 2026-09-08 15:18:22.458246015 +0000 UTC m=+323.117407138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c1bb4d86-9bfe-4878-8d6e-2caa24911179-cert") pod "llmisvc-controller-manager-777c6bd7d5-dt25d" (UID: "c1bb4d86-9bfe-4878-8d6e-2caa24911179") : secret "llmisvc-webhook-server-cert" not found
Sep 08 15:18:21.958377 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:18:21.958273    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 08 15:18:21.958377 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:18:21.958320    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7459a629-a3cb-405e-9714-de32ecc35e6c-cert podName:7459a629-a3cb-405e-9714-de32ecc35e6c nodeName:}" failed. No retries permitted until 2026-09-08 15:18:22.458309167 +0000 UTC m=+323.117470285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7459a629-a3cb-405e-9714-de32ecc35e6c-cert") pod "kserve-controller-manager-d6f4b65b8-h7c66" (UID: "7459a629-a3cb-405e-9714-de32ecc35e6c") : secret "kserve-webhook-server-cert" not found
Sep 08 15:18:21.980765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.980702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sngnq\" (UniqueName: \"kubernetes.io/projected/c1bb4d86-9bfe-4878-8d6e-2caa24911179-kube-api-access-sngnq\") pod \"llmisvc-controller-manager-777c6bd7d5-dt25d\" (UID: \"c1bb4d86-9bfe-4878-8d6e-2caa24911179\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:21.980765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:21.980748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjp6\" (UniqueName: \"kubernetes.io/projected/7459a629-a3cb-405e-9714-de32ecc35e6c-kube-api-access-9rjp6\") pod \"kserve-controller-manager-d6f4b65b8-h7c66\" (UID: \"7459a629-a3cb-405e-9714-de32ecc35e6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:22.065929 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.065891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:22.239606 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.239517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:22.364915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.364875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:18:22.463699 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.463662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7459a629-a3cb-405e-9714-de32ecc35e6c-cert\") pod \"kserve-controller-manager-d6f4b65b8-h7c66\" (UID: \"7459a629-a3cb-405e-9714-de32ecc35e6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:22.463879 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.463747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bb4d86-9bfe-4878-8d6e-2caa24911179-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dt25d\" (UID: \"c1bb4d86-9bfe-4878-8d6e-2caa24911179\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:22.466195 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.466170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7459a629-a3cb-405e-9714-de32ecc35e6c-cert\") pod \"kserve-controller-manager-d6f4b65b8-h7c66\" (UID: \"7459a629-a3cb-405e-9714-de32ecc35e6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:22.466270 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.466238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bb4d86-9bfe-4878-8d6e-2caa24911179-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dt25d\" (UID: \"c1bb4d86-9bfe-4878-8d6e-2caa24911179\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:22.697323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.697290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:22.705359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.705325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:22.989916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.989890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"]
Sep 08 15:18:22.991903 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:18:22.991877    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7459a629_a3cb_405e_9714_de32ecc35e6c.slice/crio-0657c64ea27e237d686bf66009f76c6620394d37918b6e088a4b1fcf2750e556 WatchSource:0}: Error finding container 0657c64ea27e237d686bf66009f76c6620394d37918b6e088a4b1fcf2750e556: Status 404 returned error can't find the container with id 0657c64ea27e237d686bf66009f76c6620394d37918b6e088a4b1fcf2750e556
Sep 08 15:18:22.995811 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:22.995790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"]
Sep 08 15:18:22.998248 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:18:22.998223    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc1bb4d86_9bfe_4878_8d6e_2caa24911179.slice/crio-0ddc8fd38de0bbb2b63fb6172daa16358d5399c1c052032a6b54e937d4a8180d WatchSource:0}: Error finding container 0ddc8fd38de0bbb2b63fb6172daa16358d5399c1c052032a6b54e937d4a8180d: Status 404 returned error can't find the container with id 0ddc8fd38de0bbb2b63fb6172daa16358d5399c1c052032a6b54e937d4a8180d
Sep 08 15:18:23.256426 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.256346    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"]
Sep 08 15:18:23.259697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.259673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.263594 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.263558    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 15:18:23.263733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.263626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lzgpf\""
Sep 08 15:18:23.263733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.263642    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 15:18:23.263733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.263636    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 15:18:23.270353 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.270329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"]
Sep 08 15:18:23.319465 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.319428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d" event={"ID":"c1bb4d86-9bfe-4878-8d6e-2caa24911179","Type":"ContainerStarted","Data":"0ddc8fd38de0bbb2b63fb6172daa16358d5399c1c052032a6b54e937d4a8180d"}
Sep 08 15:18:23.320775 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.320748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66" event={"ID":"7459a629-a3cb-405e-9714-de32ecc35e6c","Type":"ContainerStarted","Data":"0657c64ea27e237d686bf66009f76c6620394d37918b6e088a4b1fcf2750e556"}
Sep 08 15:18:23.372442 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.372407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-metrics-cert\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.372442 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.372449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-cert\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.372646 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.372476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-manager-config\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.372646 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.372549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2qgb\" (UniqueName: \"kubernetes.io/projected/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-kube-api-access-l2qgb\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.473875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.473838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-metrics-cert\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.473875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.473878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-cert\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.474092 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.473900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-manager-config\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.474092 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.473925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2qgb\" (UniqueName: \"kubernetes.io/projected/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-kube-api-access-l2qgb\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.474628 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.474573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-manager-config\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.476342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.476314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-metrics-cert\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.476522 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.476499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-cert\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.483730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.483708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2qgb\" (UniqueName: \"kubernetes.io/projected/f97947c0-e98f-48bd-9d96-7bf1ecf43c1c-kube-api-access-l2qgb\") pod \"lws-controller-manager-7c78744898-d8r86\" (UID: \"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c\") " pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.570649 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.570559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:23.839480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:23.839338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"]
Sep 08 15:18:23.918195 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:18:23.918164    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf97947c0_e98f_48bd_9d96_7bf1ecf43c1c.slice/crio-5837a6a448fdbc1ee672ed23dd65d5cc99b7b5845ea0346d67a8fca220eed478 WatchSource:0}: Error finding container 5837a6a448fdbc1ee672ed23dd65d5cc99b7b5845ea0346d67a8fca220eed478: Status 404 returned error can't find the container with id 5837a6a448fdbc1ee672ed23dd65d5cc99b7b5845ea0346d67a8fca220eed478
Sep 08 15:18:24.328611 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:24.328560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86" event={"ID":"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c","Type":"ContainerStarted","Data":"5837a6a448fdbc1ee672ed23dd65d5cc99b7b5845ea0346d67a8fca220eed478"}
Sep 08 15:18:27.290985 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.290956    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-k6wlp"
Sep 08 15:18:27.348343 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.348307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86" event={"ID":"f97947c0-e98f-48bd-9d96-7bf1ecf43c1c","Type":"ContainerStarted","Data":"a144c7f41b790e64a971a028c06e69741362987f6c71a5546951621de290cd98"}
Sep 08 15:18:27.348516 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.348480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:27.350214 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.350185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d" event={"ID":"c1bb4d86-9bfe-4878-8d6e-2caa24911179","Type":"ContainerStarted","Data":"c88cc0efe3cfdf25b27e30ab85f82da64779194a55a860efd55f68a7204eaaaa"}
Sep 08 15:18:27.350351 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.350278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:27.351819 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.351796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66" event={"ID":"7459a629-a3cb-405e-9714-de32ecc35e6c","Type":"ContainerStarted","Data":"80314ff6ac7b04c78b418dd1d3bb4d22d3674f3e55185df3212949442d633123"}
Sep 08 15:18:27.351923 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.351870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:18:27.365084 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.365022    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86" podStartSLOduration=1.572070439 podStartE2EDuration="4.365005905s" totalImagesPullingTime="2.792935466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:27.364373049 +0000 UTC m=+328.023534200" watchObservedRunningTime="2026-09-08 15:18:27.365005905 +0000 UTC m=+328.024167030"
Sep 08 15:18:27.381598 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.381502    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66" podStartSLOduration=2.6634218179999998 podStartE2EDuration="6.381476966s" totalImagesPullingTime="3.718055148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:27.381222001 +0000 UTC m=+328.040383129" watchObservedRunningTime="2026-09-08 15:18:27.381476966 +0000 UTC m=+328.040638096"
Sep 08 15:18:27.398495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:27.398442    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d" podStartSLOduration=2.677269033 podStartE2EDuration="6.398429898s" totalImagesPullingTime="3.721160865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:27.39651367 +0000 UTC m=+328.055674811" watchObservedRunningTime="2026-09-08 15:18:27.398429898 +0000 UTC m=+328.057591026"
Sep 08 15:18:38.358975 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:38.358942    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c78744898-d8r86"
Sep 08 15:18:58.358783 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:58.358753    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dt25d"
Sep 08 15:18:58.361863 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:18:58.361840    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h7c66"
Sep 08 15:19:12.820396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:12.820347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:12.925519 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:12.925489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:22.213327 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.213293    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c9967445-rbzbz"]
Sep 08 15:19:22.218363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.218341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.221374 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.221348    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 15:19:22.221374 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.221353    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 15:19:22.222050 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.222035    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 15:19:22.222102 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.222088    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 15:19:22.222351 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.222303    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p8lf5\""
Sep 08 15:19:22.222548 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.222534    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 15:19:22.222673 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.222655    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 15:19:22.223123 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.223108    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 15:19:22.230025 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.229996    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 15:19:22.231606 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.231568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9967445-rbzbz"]
Sep 08 15:19:22.280091 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.280060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:22.313332 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.313300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-config\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.313332 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.313333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-service-ca\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.313526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.313362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-oauth-serving-cert\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.313526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.313392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-oauth-config\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.313526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.313414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-trusted-ca-bundle\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.313526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.313441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-serving-cert\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.313686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.313520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxhns\" (UniqueName: \"kubernetes.io/projected/6ae80fee-24f5-44b9-9e7a-900e7afc725b-kube-api-access-lxhns\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.362110 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.362080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:22.414453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.414420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-config\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.414453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.414454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-service-ca\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.414726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.414477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-oauth-serving-cert\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.414726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.414504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-oauth-config\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.414726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.414531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-trusted-ca-bundle\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.414726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.414556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-serving-cert\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.414726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.414634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxhns\" (UniqueName: \"kubernetes.io/projected/6ae80fee-24f5-44b9-9e7a-900e7afc725b-kube-api-access-lxhns\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.415294 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.415269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-oauth-serving-cert\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.415388 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.415275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-service-ca\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.415388 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.415330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-config\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.415536 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.415517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ae80fee-24f5-44b9-9e7a-900e7afc725b-trusted-ca-bundle\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.417250 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.417227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-oauth-config\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.417339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.417286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ae80fee-24f5-44b9-9e7a-900e7afc725b-console-serving-cert\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.423047 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.423023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxhns\" (UniqueName: \"kubernetes.io/projected/6ae80fee-24f5-44b9-9e7a-900e7afc725b-kube-api-access-lxhns\") pod \"console-7c9967445-rbzbz\" (UID: \"6ae80fee-24f5-44b9-9e7a-900e7afc725b\") " pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.528337 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.528248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:22.798963 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:22.798935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9967445-rbzbz"]
Sep 08 15:19:22.800937 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:19:22.800903    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae80fee_24f5_44b9_9e7a_900e7afc725b.slice/crio-13a3b9cc7b47f798ccd0bb371100986bd225b375e3c36491d581fde49de4ec14 WatchSource:0}: Error finding container 13a3b9cc7b47f798ccd0bb371100986bd225b375e3c36491d581fde49de4ec14: Status 404 returned error can't find the container with id 13a3b9cc7b47f798ccd0bb371100986bd225b375e3c36491d581fde49de4ec14
Sep 08 15:19:23.618670 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:23.618635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9967445-rbzbz" event={"ID":"6ae80fee-24f5-44b9-9e7a-900e7afc725b","Type":"ContainerStarted","Data":"d3140cb74904a31485fb388628140d35ab104d0cc4eca33ef51a74bc4227c520"}
Sep 08 15:19:23.619098 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:23.618696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9967445-rbzbz" event={"ID":"6ae80fee-24f5-44b9-9e7a-900e7afc725b","Type":"ContainerStarted","Data":"13a3b9cc7b47f798ccd0bb371100986bd225b375e3c36491d581fde49de4ec14"}
Sep 08 15:19:23.640296 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:23.640243    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c9967445-rbzbz" podStartSLOduration=1.640228413 podStartE2EDuration="1.640228413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:23.638203369 +0000 UTC m=+384.297364495" watchObservedRunningTime="2026-09-08 15:19:23.640228413 +0000 UTC m=+384.299389537"
Sep 08 15:19:26.427264 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:26.427226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:29.249987 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:29.249955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:31.041787 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:31.041744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:31.490709 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:31.490679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:31.710514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:31.710484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:31.841487 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:31.841406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:32.528908 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:32.528868    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:32.529351 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:32.528930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:32.533949 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:32.533928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:32.664562 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:32.664528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c9967445-rbzbz"
Sep 08 15:19:32.821426 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:32.821321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:32.921805 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:32.921765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:33.045137 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:33.045100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:33.140769 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:33.140689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:34.183601 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:34.183544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:34.286557 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:34.286519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:35.025613 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.025566    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"]
Sep 08 15:19:35.028099 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.028081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.034286 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.034263    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g2gcd\""
Sep 08 15:19:35.035432 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.035057    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:19:35.035432 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.035340    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:19:35.046065 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.046043    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"]
Sep 08 15:19:35.050516 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.050493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:35.129325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.129292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.129502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.129370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kztmd\" (UniqueName: \"kubernetes.io/projected/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-kube-api-access-kztmd\") pod \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.230432 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.230398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kztmd\" (UniqueName: \"kubernetes.io/projected/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-kube-api-access-kztmd\") pod \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.230838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.230477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.230838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.230829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.242627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.242564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kztmd\" (UniqueName: \"kubernetes.io/projected/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-kube-api-access-kztmd\") pod \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.339306 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.339213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:35.429557 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.429524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:35.638429 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.638405    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"]
Sep 08 15:19:35.640202 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:19:35.640176    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f59d5c9_9e0b_4a82_a3c9_6eaf408d2348.slice/crio-e7fd1f0b16478650229bd8aa46e8dbef7cde6a92d3634f74e7bbf73d2b49e8a6 WatchSource:0}: Error finding container e7fd1f0b16478650229bd8aa46e8dbef7cde6a92d3634f74e7bbf73d2b49e8a6: Status 404 returned error can't find the container with id e7fd1f0b16478650229bd8aa46e8dbef7cde6a92d3634f74e7bbf73d2b49e8a6
Sep 08 15:19:35.675746 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.675713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf" event={"ID":"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348","Type":"ContainerStarted","Data":"e7fd1f0b16478650229bd8aa46e8dbef7cde6a92d3634f74e7bbf73d2b49e8a6"}
Sep 08 15:19:35.811419 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:35.811383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:38.851256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:38.851215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:38.977927 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:38.977879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:39.423800 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:39.423765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:40.707651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:40.707567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf" event={"ID":"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348","Type":"ContainerStarted","Data":"45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f"}
Sep 08 15:19:40.708386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:40.707732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:40.740905 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:40.740845    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf" podStartSLOduration=1.263591365 podStartE2EDuration="5.740824944s" totalImagesPullingTime="4.477233579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:40.739036394 +0000 UTC m=+401.398197520" watchObservedRunningTime="2026-09-08 15:19:40.740824944 +0000 UTC m=+401.399986073"
Sep 08 15:19:41.925126 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:41.925090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:42.024575 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:42.024540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:42.702220 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:42.702181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:42.964275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:42.964194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:46.592733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:46.592696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:46.691380 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:46.691352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:46.761122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:46.761093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:51.714591 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:51.714555    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:53.563853 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.563819    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"]
Sep 08 15:19:53.566302 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.566285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.590291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.590264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"]
Sep 08 15:19:53.610661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.610632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxlp\" (UniqueName: \"kubernetes.io/projected/ce8b26f2-3943-405f-bd52-4c05620cfc6e-kube-api-access-kbxlp\") pod \"kuadrant-operator-controller-manager-68cf589589-zspz2\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.610811 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.610695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce8b26f2-3943-405f-bd52-4c05620cfc6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zspz2\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.711267 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.711215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxlp\" (UniqueName: \"kubernetes.io/projected/ce8b26f2-3943-405f-bd52-4c05620cfc6e-kube-api-access-kbxlp\") pod \"kuadrant-operator-controller-manager-68cf589589-zspz2\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.711478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.711301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce8b26f2-3943-405f-bd52-4c05620cfc6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zspz2\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.711772 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.711749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce8b26f2-3943-405f-bd52-4c05620cfc6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zspz2\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.725831 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.725805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxlp\" (UniqueName: \"kubernetes.io/projected/ce8b26f2-3943-405f-bd52-4c05620cfc6e-kube-api-access-kbxlp\") pod \"kuadrant-operator-controller-manager-68cf589589-zspz2\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.876482 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.876388    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:53.994756 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.994722    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"]
Sep 08 15:19:53.994962 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:53.994920    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" containerName="manager" containerID="cri-o://45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f" gracePeriod=2
Sep 08 15:19:54.005520 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.005475    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-94bnf\": pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.006856 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.006824    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"]
Sep 08 15:19:54.019930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.019894    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"]
Sep 08 15:19:54.022111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.022085    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"]
Sep 08 15:19:54.022513 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.022496    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" containerName="manager"
Sep 08 15:19:54.022602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.022516    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" containerName="manager"
Sep 08 15:19:54.022663 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.022630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" containerName="manager"
Sep 08 15:19:54.024849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.024827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.028806 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.028784    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"]
Sep 08 15:19:54.039854 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.039826    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"]
Sep 08 15:19:54.057220 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.057193    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"]
Sep 08 15:19:54.060066 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.060039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.064006 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.063975    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.066178 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.066146    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.077395 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.077352    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"]
Sep 08 15:19:54.114846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.114820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z56vz\" (UniqueName: \"kubernetes.io/projected/8209800e-36a0-410d-9c68-1c1c588bc366-kube-api-access-z56vz\") pod \"kuadrant-operator-controller-manager-58fc56757c-ldtxf\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.114976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.114866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8533230-799a-4086-a22f-b9665055d29b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zldzw\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.114976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.114918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtcbx\" (UniqueName: \"kubernetes.io/projected/d8533230-799a-4086-a22f-b9665055d29b-kube-api-access-xtcbx\") pod \"kuadrant-operator-controller-manager-68cf589589-zldzw\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.114976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.114949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209800e-36a0-410d-9c68-1c1c588bc366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ldtxf\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.216034 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.215978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z56vz\" (UniqueName: \"kubernetes.io/projected/8209800e-36a0-410d-9c68-1c1c588bc366-kube-api-access-z56vz\") pod \"kuadrant-operator-controller-manager-58fc56757c-ldtxf\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.216126 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.216034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8533230-799a-4086-a22f-b9665055d29b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zldzw\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.216126 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.216090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtcbx\" (UniqueName: \"kubernetes.io/projected/d8533230-799a-4086-a22f-b9665055d29b-kube-api-access-xtcbx\") pod \"kuadrant-operator-controller-manager-68cf589589-zldzw\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.216126 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.216121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209800e-36a0-410d-9c68-1c1c588bc366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ldtxf\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.216464 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.216411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8533230-799a-4086-a22f-b9665055d29b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zldzw\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.216570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.216536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209800e-36a0-410d-9c68-1c1c588bc366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ldtxf\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.230727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.230702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtcbx\" (UniqueName: \"kubernetes.io/projected/d8533230-799a-4086-a22f-b9665055d29b-kube-api-access-xtcbx\") pod \"kuadrant-operator-controller-manager-68cf589589-zldzw\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.230828 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.230793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z56vz\" (UniqueName: \"kubernetes.io/projected/8209800e-36a0-410d-9c68-1c1c588bc366-kube-api-access-z56vz\") pod \"kuadrant-operator-controller-manager-58fc56757c-ldtxf\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.236381 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.236363    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.238930 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.238898    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.276361 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.276325    2578 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 08 15:19:54.276361 ip-10-0-129-54 kubenswrapper[2578]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-68cf589589-zspz2_kuadrant-system_ce8b26f2-3943-405f-bd52-4c05620cfc6e_0(966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae): error adding pod kuadrant-system_kuadrant-operator-controller-manager-68cf589589-zspz2 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae" Netns:"/var/run/netns/a22a055b-a51e-453f-b142-c8db2d4289ad" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-68cf589589-zspz2;K8S_POD_INFRA_CONTAINER_ID=966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae;K8S_POD_UID=ce8b26f2-3943-405f-bd52-4c05620cfc6e" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2] networking: [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2/ce8b26f2-3943-405f-bd52-4c05620cfc6e:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2 966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:1d [10.134.0.29/23]
Sep 08 15:19:54.276361 ip-10-0-129-54 kubenswrapper[2578]:         '
Sep 08 15:19:54.276361 ip-10-0-129-54 kubenswrapper[2578]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 08 15:19:54.276361 ip-10-0-129-54 kubenswrapper[2578]:  >
Sep 08 15:19:54.276565 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.276405    2578 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 08 15:19:54.276565 ip-10-0-129-54 kubenswrapper[2578]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-68cf589589-zspz2_kuadrant-system_ce8b26f2-3943-405f-bd52-4c05620cfc6e_0(966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae): error adding pod kuadrant-system_kuadrant-operator-controller-manager-68cf589589-zspz2 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae" Netns:"/var/run/netns/a22a055b-a51e-453f-b142-c8db2d4289ad" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-68cf589589-zspz2;K8S_POD_INFRA_CONTAINER_ID=966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae;K8S_POD_UID=ce8b26f2-3943-405f-bd52-4c05620cfc6e" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2] networking: [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2/ce8b26f2-3943-405f-bd52-4c05620cfc6e:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2 966c031fec08bc9b13821357bc549aa743a27421b907a9c057d1024e93923bae network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:1d [10.134.0.29/23]
Sep 08 15:19:54.276565 ip-10-0-129-54 kubenswrapper[2578]:         '
Sep 08 15:19:54.276565 ip-10-0-129-54 kubenswrapper[2578]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 08 15:19:54.276565 ip-10-0-129-54 kubenswrapper[2578]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:54.316971 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.316944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-extensions-socket-volume\") pod \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") "
Sep 08 15:19:54.317130 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.316996    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kztmd\" (UniqueName: \"kubernetes.io/projected/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-kube-api-access-kztmd\") pod \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\" (UID: \"0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348\") "
Sep 08 15:19:54.317424 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.317397    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" (UID: "0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:54.319224 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.319202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-kube-api-access-kztmd" (OuterVolumeSpecName: "kube-api-access-kztmd") pod "0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" (UID: "0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348"). InnerVolumeSpecName "kube-api-access-kztmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:54.375476 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.375445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.382250 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.382231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.418483 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.418389    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-extensions-socket-volume\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.418483 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.418422    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kztmd\" (UniqueName: \"kubernetes.io/projected/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348-kube-api-access-kztmd\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.659243 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.659217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"]
Sep 08 15:19:54.661597 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:19:54.661548    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8209800e_36a0_410d_9c68_1c1c588bc366.slice/crio-c4efb7b9bfde12c050bc8c8ae3ad9bd304e20a962850ee7cbb972268240cbcf9 WatchSource:0}: Error finding container c4efb7b9bfde12c050bc8c8ae3ad9bd304e20a962850ee7cbb972268240cbcf9: Status 404 returned error can't find the container with id c4efb7b9bfde12c050bc8c8ae3ad9bd304e20a962850ee7cbb972268240cbcf9
Sep 08 15:19:54.662934 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.662908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"]
Sep 08 15:19:54.664916 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:19:54.664895    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8533230_799a_4086_a22f_b9665055d29b.slice/crio-6e69b323a72faf42f77ba6008d779ca8cd00652342199cb02657dd41875753f9 WatchSource:0}: Error finding container 6e69b323a72faf42f77ba6008d779ca8cd00652342199cb02657dd41875753f9: Status 404 returned error can't find the container with id 6e69b323a72faf42f77ba6008d779ca8cd00652342199cb02657dd41875753f9
Sep 08 15:19:54.774175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.774137    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" containerID="45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f" exitCode=0
Sep 08 15:19:54.774373 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.774182    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.774373 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.774236    2578 scope.go:117] "RemoveContainer" containerID="45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f"
Sep 08 15:19:54.776774 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.776741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf" event={"ID":"8209800e-36a0-410d-9c68-1c1c588bc366","Type":"ContainerStarted","Data":"8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb"}
Sep 08 15:19:54.776927 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.776803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf" event={"ID":"8209800e-36a0-410d-9c68-1c1c588bc366","Type":"ContainerStarted","Data":"c4efb7b9bfde12c050bc8c8ae3ad9bd304e20a962850ee7cbb972268240cbcf9"}
Sep 08 15:19:54.776927 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.776834    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:19:54.777254 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.777225    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.778865 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.778764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw" event={"ID":"d8533230-799a-4086-a22f-b9665055d29b","Type":"ContainerStarted","Data":"4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad"}
Sep 08 15:19:54.778865 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.778826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:54.779232 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.778829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw" event={"ID":"d8533230-799a-4086-a22f-b9665055d29b","Type":"ContainerStarted","Data":"6e69b323a72faf42f77ba6008d779ca8cd00652342199cb02657dd41875753f9"}
Sep 08 15:19:54.779232 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.779003    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:19:54.779232 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.779209    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.785208 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.785195    2578 scope.go:117] "RemoveContainer" containerID="45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f"
Sep 08 15:19:54.785444 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.785428    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f\": container with ID starting with 45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f not found: ID does not exist" containerID="45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f"
Sep 08 15:19:54.785498 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.785450    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f"} err="failed to get container status \"45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f\": rpc error: code = NotFound desc = could not find container \"45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f\": container with ID starting with 45c72e1d43da971674c7be9ea12e63f04a1bbd3f0f55644ca4b6b7e875b9237f not found: ID does not exist"
Sep 08 15:19:54.786050 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.786036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:54.801876 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.801833    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf" podStartSLOduration=1.801821838 podStartE2EDuration="1.801821838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:54.800508914 +0000 UTC m=+415.459670054" watchObservedRunningTime="2026-09-08 15:19:54.801821838 +0000 UTC m=+415.460982964"
Sep 08 15:19:54.802636 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.802615    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:54.804558 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:54.804536    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-zspz2\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="ce8b26f2-3943-405f-bd52-4c05620cfc6e" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:54.834971 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.834928    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw" podStartSLOduration=0.834907359 podStartE2EDuration="834.907359ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:54.832921093 +0000 UTC m=+415.492082220" watchObservedRunningTime="2026-09-08 15:19:54.834907359 +0000 UTC m=+415.494068486"
Sep 08 15:19:54.922191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.922106    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbxlp\" (UniqueName: \"kubernetes.io/projected/ce8b26f2-3943-405f-bd52-4c05620cfc6e-kube-api-access-kbxlp\") pod \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") "
Sep 08 15:19:54.922191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.922144    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce8b26f2-3943-405f-bd52-4c05620cfc6e-extensions-socket-volume\") pod \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\" (UID: \"ce8b26f2-3943-405f-bd52-4c05620cfc6e\") "
Sep 08 15:19:54.922439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.922416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce8b26f2-3943-405f-bd52-4c05620cfc6e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ce8b26f2-3943-405f-bd52-4c05620cfc6e" (UID: "ce8b26f2-3943-405f-bd52-4c05620cfc6e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:54.924353 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:54.924310    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce8b26f2-3943-405f-bd52-4c05620cfc6e-kube-api-access-kbxlp" (OuterVolumeSpecName: "kube-api-access-kbxlp") pod "ce8b26f2-3943-405f-bd52-4c05620cfc6e" (UID: "ce8b26f2-3943-405f-bd52-4c05620cfc6e"). InnerVolumeSpecName "kube-api-access-kbxlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:55.022882 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:55.022841    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce8b26f2-3943-405f-bd52-4c05620cfc6e-extensions-socket-volume\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.022882 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:55.022870    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbxlp\" (UniqueName: \"kubernetes.io/projected/ce8b26f2-3943-405f-bd52-4c05620cfc6e-kube-api-access-kbxlp\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.462823 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:55.462786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:55.583294 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:55.583261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:55.788868 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:55.788769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:55.791143 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:55.791105    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:55.793138 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:55.793111    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-zspz2\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="ce8b26f2-3943-405f-bd52-4c05620cfc6e" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:55.798481 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:55.798457    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94bnf\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94bnf"
Sep 08 15:19:55.800444 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:19:55.800421    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-zspz2\" is forbidden: User \"system:node:ip-10-0-129-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-54.ec2.internal' and this object" podUID="ce8b26f2-3943-405f-bd52-4c05620cfc6e" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zspz2"
Sep 08 15:19:55.832457 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:55.832415    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348" path="/var/lib/kubelet/pods/0f59d5c9-9e0b-4a82-a3c9-6eaf408d2348/volumes"
Sep 08 15:19:55.832876 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:55.832856    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce8b26f2-3943-405f-bd52-4c05620cfc6e" path="/var/lib/kubelet/pods/ce8b26f2-3943-405f-bd52-4c05620cfc6e/volumes"
Sep 08 15:19:59.453300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:59.453259    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:19:59.555476 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:19:59.555445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:01.044516 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:01.044477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:01.144175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:01.144144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:05.791215 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:05.791184    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:20:05.791694 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:05.791265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:20:05.796764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:05.796738    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:05.875800 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:05.875768    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"]
Sep 08 15:20:05.875998 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:05.875948    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf" podUID="8209800e-36a0-410d-9c68-1c1c588bc366" containerName="manager" containerID="cri-o://8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb" gracePeriod=10
Sep 08 15:20:06.121660 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.121634    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:20:06.146632 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.146603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:06.232780 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.232748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209800e-36a0-410d-9c68-1c1c588bc366-extensions-socket-volume\") pod \"8209800e-36a0-410d-9c68-1c1c588bc366\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") "
Sep 08 15:20:06.232967 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.232810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z56vz\" (UniqueName: \"kubernetes.io/projected/8209800e-36a0-410d-9c68-1c1c588bc366-kube-api-access-z56vz\") pod \"8209800e-36a0-410d-9c68-1c1c588bc366\" (UID: \"8209800e-36a0-410d-9c68-1c1c588bc366\") "
Sep 08 15:20:06.233203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.233166    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8209800e-36a0-410d-9c68-1c1c588bc366-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8209800e-36a0-410d-9c68-1c1c588bc366" (UID: "8209800e-36a0-410d-9c68-1c1c588bc366"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:06.234852 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.234830    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8209800e-36a0-410d-9c68-1c1c588bc366-kube-api-access-z56vz" (OuterVolumeSpecName: "kube-api-access-z56vz") pod "8209800e-36a0-410d-9c68-1c1c588bc366" (UID: "8209800e-36a0-410d-9c68-1c1c588bc366"). InnerVolumeSpecName "kube-api-access-z56vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:06.333636 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.333571    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z56vz\" (UniqueName: \"kubernetes.io/projected/8209800e-36a0-410d-9c68-1c1c588bc366-kube-api-access-z56vz\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:20:06.333636 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.333628    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209800e-36a0-410d-9c68-1c1c588bc366-extensions-socket-volume\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:20:06.688830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.688786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:06.768934 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.768900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:06.842199 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.842164    2578 generic.go:356] "Generic (PLEG): container finished" podID="8209800e-36a0-410d-9c68-1c1c588bc366" containerID="8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb" exitCode=0
Sep 08 15:20:06.842638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.842214    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"
Sep 08 15:20:06.842638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.842242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf" event={"ID":"8209800e-36a0-410d-9c68-1c1c588bc366","Type":"ContainerDied","Data":"8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb"}
Sep 08 15:20:06.842638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.842295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf" event={"ID":"8209800e-36a0-410d-9c68-1c1c588bc366","Type":"ContainerDied","Data":"c4efb7b9bfde12c050bc8c8ae3ad9bd304e20a962850ee7cbb972268240cbcf9"}
Sep 08 15:20:06.842638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.842319    2578 scope.go:117] "RemoveContainer" containerID="8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb"
Sep 08 15:20:06.850908 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.850888    2578 scope.go:117] "RemoveContainer" containerID="8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb"
Sep 08 15:20:06.851192 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:20:06.851173    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb\": container with ID starting with 8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb not found: ID does not exist" containerID="8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb"
Sep 08 15:20:06.851227 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.851201    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb"} err="failed to get container status \"8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb\": rpc error: code = NotFound desc = could not find container \"8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb\": container with ID starting with 8189e1565243a5a9e16d230ae2a7819585132ceef04e845f601c9f5a18bf7fdb not found: ID does not exist"
Sep 08 15:20:06.865135 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.865113    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"]
Sep 08 15:20:06.881125 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:06.881097    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ldtxf"]
Sep 08 15:20:07.673134 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:07.673100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:07.827096 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:07.827062    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8209800e-36a0-410d-9c68-1c1c588bc366" path="/var/lib/kubelet/pods/8209800e-36a0-410d-9c68-1c1c588bc366/volumes"
Sep 08 15:20:07.836196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:07.836165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:14.651445 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:14.651407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:14.746504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:14.746453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:22.033805 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.033729    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"]
Sep 08 15:20:22.034215 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.033939    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw" podUID="d8533230-799a-4086-a22f-b9665055d29b" containerName="manager" containerID="cri-o://4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad" gracePeriod=10
Sep 08 15:20:22.229850 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.229811    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"]
Sep 08 15:20:22.230358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.230337    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8209800e-36a0-410d-9c68-1c1c588bc366" containerName="manager"
Sep 08 15:20:22.230358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.230359    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8209800e-36a0-410d-9c68-1c1c588bc366" containerName="manager"
Sep 08 15:20:22.230542 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.230462    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8209800e-36a0-410d-9c68-1c1c588bc366" containerName="manager"
Sep 08 15:20:22.232631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.232611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.235549 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.235521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qqlpx\""
Sep 08 15:20:22.254106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.254080    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"]
Sep 08 15:20:22.275269 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5052582-58a3-474a-903a-c670e32346f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275374 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275374 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275451 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5052582-58a3-474a-903a-c670e32346f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275451 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275516 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5052582-58a3-474a-903a-c670e32346f9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275549 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275601 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9hw\" (UniqueName: \"kubernetes.io/projected/b5052582-58a3-474a-903a-c670e32346f9-kube-api-access-bt9hw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.275635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.275609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.285844 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.285790    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:20:22.376265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5052582-58a3-474a-903a-c670e32346f9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376503 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376503 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9hw\" (UniqueName: \"kubernetes.io/projected/b5052582-58a3-474a-903a-c670e32346f9-kube-api-access-bt9hw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376503 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5052582-58a3-474a-903a-c670e32346f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376841 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5052582-58a3-474a-903a-c670e32346f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376841 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376754    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.376944 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.376872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.377056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.377029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.377124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.377063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.377325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.377308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5052582-58a3-474a-903a-c670e32346f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.378563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.378545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5052582-58a3-474a-903a-c670e32346f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.378883 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.378863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5052582-58a3-474a-903a-c670e32346f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.385033 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.385010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt9hw\" (UniqueName: \"kubernetes.io/projected/b5052582-58a3-474a-903a-c670e32346f9-kube-api-access-bt9hw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.385120 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.385013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5052582-58a3-474a-903a-c670e32346f9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-gr8lt\" (UID: \"b5052582-58a3-474a-903a-c670e32346f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.477485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.477443    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtcbx\" (UniqueName: \"kubernetes.io/projected/d8533230-799a-4086-a22f-b9665055d29b-kube-api-access-xtcbx\") pod \"d8533230-799a-4086-a22f-b9665055d29b\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") "
Sep 08 15:20:22.477701 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.477529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8533230-799a-4086-a22f-b9665055d29b-extensions-socket-volume\") pod \"d8533230-799a-4086-a22f-b9665055d29b\" (UID: \"d8533230-799a-4086-a22f-b9665055d29b\") "
Sep 08 15:20:22.477908 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.477882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8533230-799a-4086-a22f-b9665055d29b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d8533230-799a-4086-a22f-b9665055d29b" (UID: "d8533230-799a-4086-a22f-b9665055d29b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:22.479554 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.479533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8533230-799a-4086-a22f-b9665055d29b-kube-api-access-xtcbx" (OuterVolumeSpecName: "kube-api-access-xtcbx") pod "d8533230-799a-4086-a22f-b9665055d29b" (UID: "d8533230-799a-4086-a22f-b9665055d29b"). InnerVolumeSpecName "kube-api-access-xtcbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:22.543787 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.543701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:22.578605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.578543    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtcbx\" (UniqueName: \"kubernetes.io/projected/d8533230-799a-4086-a22f-b9665055d29b-kube-api-access-xtcbx\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:20:22.578605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.578599    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8533230-799a-4086-a22f-b9665055d29b-extensions-socket-volume\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:20:22.817807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.817779    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"]
Sep 08 15:20:22.819970 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:20:22.819944    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5052582_58a3_474a_903a_c670e32346f9.slice/crio-95fa32a95a692ea0bb3f6f5ea1366a4b46e8fecdea30198bd5caace7ce2017ce WatchSource:0}: Error finding container 95fa32a95a692ea0bb3f6f5ea1366a4b46e8fecdea30198bd5caace7ce2017ce: Status 404 returned error can't find the container with id 95fa32a95a692ea0bb3f6f5ea1366a4b46e8fecdea30198bd5caace7ce2017ce
Sep 08 15:20:22.822128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.822095    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:20:22.822233 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.822170    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:20:22.822233 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.822213    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:20:22.936485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.936379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" event={"ID":"b5052582-58a3-474a-903a-c670e32346f9","Type":"ContainerStarted","Data":"fd92f9179a3672ef8be9c3e422b47a13d96fb78574476d164eb6c102a4b69393"}
Sep 08 15:20:22.936485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.936470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" event={"ID":"b5052582-58a3-474a-903a-c670e32346f9","Type":"ContainerStarted","Data":"95fa32a95a692ea0bb3f6f5ea1366a4b46e8fecdea30198bd5caace7ce2017ce"}
Sep 08 15:20:22.937940 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.937913    2578 generic.go:356] "Generic (PLEG): container finished" podID="d8533230-799a-4086-a22f-b9665055d29b" containerID="4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad" exitCode=0
Sep 08 15:20:22.938078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.937969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw" event={"ID":"d8533230-799a-4086-a22f-b9665055d29b","Type":"ContainerDied","Data":"4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad"}
Sep 08 15:20:22.938078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.937972    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"
Sep 08 15:20:22.938078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.938003    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw" event={"ID":"d8533230-799a-4086-a22f-b9665055d29b","Type":"ContainerDied","Data":"6e69b323a72faf42f77ba6008d779ca8cd00652342199cb02657dd41875753f9"}
Sep 08 15:20:22.938078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.938025    2578 scope.go:117] "RemoveContainer" containerID="4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad"
Sep 08 15:20:22.948184 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.948163    2578 scope.go:117] "RemoveContainer" containerID="4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad"
Sep 08 15:20:22.948476 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:20:22.948457    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad\": container with ID starting with 4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad not found: ID does not exist" containerID="4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad"
Sep 08 15:20:22.948542 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.948484    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad"} err="failed to get container status \"4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad\": rpc error: code = NotFound desc = could not find container \"4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad\": container with ID starting with 4000e284cac86711b720db8fe9debdf9083f77b6da78bf7d867f9ce4d63c7bad not found: ID does not exist"
Sep 08 15:20:22.957412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.957369    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" podStartSLOduration=0.957354828 podStartE2EDuration="957.354828ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:22.955675394 +0000 UTC m=+443.614836528" watchObservedRunningTime="2026-09-08 15:20:22.957354828 +0000 UTC m=+443.616515955"
Sep 08 15:20:22.979821 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.979786    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"]
Sep 08 15:20:22.985377 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:22.985348    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zldzw"]
Sep 08 15:20:23.245387 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:23.245355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:23.347364 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:23.347332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:23.544103 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:23.544022    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:23.548923 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:23.548898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:23.827408 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:23.827312    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8533230-799a-4086-a22f-b9665055d29b" path="/var/lib/kubelet/pods/d8533230-799a-4086-a22f-b9665055d29b/volumes"
Sep 08 15:20:23.944307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:23.944279    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:23.945153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:23.945136    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:20:33.307822 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:33.307788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:33.382379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:33.382345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:41.608321 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.608280    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"]
Sep 08 15:20:41.608942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.608921    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8533230-799a-4086-a22f-b9665055d29b" containerName="manager"
Sep 08 15:20:41.608942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.608944    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8533230-799a-4086-a22f-b9665055d29b" containerName="manager"
Sep 08 15:20:41.609082 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.609058    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8533230-799a-4086-a22f-b9665055d29b" containerName="manager"
Sep 08 15:20:41.613128 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.613099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:41.613300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.613284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:41.615807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.615782    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:20:41.616691 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.616668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gsk2s\""
Sep 08 15:20:41.616691 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.616671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:20:41.616864 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.616673    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 15:20:41.619067 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.619029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"]
Sep 08 15:20:41.648074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.648048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5706aec7-ef3c-4ae8-9804-ada1754497b2-config-file\") pod \"limitador-limitador-859c4d96d6-9lvfb\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:41.648217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.648097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9wxb\" (UniqueName: \"kubernetes.io/projected/5706aec7-ef3c-4ae8-9804-ada1754497b2-kube-api-access-l9wxb\") pod \"limitador-limitador-859c4d96d6-9lvfb\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:41.708781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.708747    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"]
Sep 08 15:20:41.719547 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.719520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:41.748825 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.748791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5706aec7-ef3c-4ae8-9804-ada1754497b2-config-file\") pod \"limitador-limitador-859c4d96d6-9lvfb\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:41.748970 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.748846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9wxb\" (UniqueName: \"kubernetes.io/projected/5706aec7-ef3c-4ae8-9804-ada1754497b2-kube-api-access-l9wxb\") pod \"limitador-limitador-859c4d96d6-9lvfb\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:41.749419 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.749399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5706aec7-ef3c-4ae8-9804-ada1754497b2-config-file\") pod \"limitador-limitador-859c4d96d6-9lvfb\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:41.759695 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.759669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9wxb\" (UniqueName: \"kubernetes.io/projected/5706aec7-ef3c-4ae8-9804-ada1754497b2-kube-api-access-l9wxb\") pod \"limitador-limitador-859c4d96d6-9lvfb\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:41.821682 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.821647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:41.923822 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:41.923732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:42.195929 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.195904    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"]
Sep 08 15:20:42.197985 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:20:42.197958    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5706aec7_ef3c_4ae8_9804_ada1754497b2.slice/crio-b0fa996a7dfd72c175c9e77d79c836d68ce39f4f9909482083644603cfb0d41a WatchSource:0}: Error finding container b0fa996a7dfd72c175c9e77d79c836d68ce39f4f9909482083644603cfb0d41a: Status 404 returned error can't find the container with id b0fa996a7dfd72c175c9e77d79c836d68ce39f4f9909482083644603cfb0d41a
Sep 08 15:20:42.403744 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.403704    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-tfrjg"]
Sep 08 15:20:42.409995 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.409964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-tfrjg"
Sep 08 15:20:42.413272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.413241    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bm7bp\""
Sep 08 15:20:42.415792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.415770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-tfrjg"]
Sep 08 15:20:42.454381 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.454346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtss2\" (UniqueName: \"kubernetes.io/projected/c8d10438-dd74-40fa-853d-6a82f814030f-kube-api-access-jtss2\") pod \"authorino-b54df94b4-tfrjg\" (UID: \"c8d10438-dd74-40fa-853d-6a82f814030f\") " pod="kuadrant-system/authorino-b54df94b4-tfrjg"
Sep 08 15:20:42.504649 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.504617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:42.555918 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.555884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtss2\" (UniqueName: \"kubernetes.io/projected/c8d10438-dd74-40fa-853d-6a82f814030f-kube-api-access-jtss2\") pod \"authorino-b54df94b4-tfrjg\" (UID: \"c8d10438-dd74-40fa-853d-6a82f814030f\") " pod="kuadrant-system/authorino-b54df94b4-tfrjg"
Sep 08 15:20:42.603631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.603594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtss2\" (UniqueName: \"kubernetes.io/projected/c8d10438-dd74-40fa-853d-6a82f814030f-kube-api-access-jtss2\") pod \"authorino-b54df94b4-tfrjg\" (UID: \"c8d10438-dd74-40fa-853d-6a82f814030f\") " pod="kuadrant-system/authorino-b54df94b4-tfrjg"
Sep 08 15:20:42.672466 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.672433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:42.720062 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.719986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-tfrjg"
Sep 08 15:20:42.990083 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:42.989998    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-tfrjg"]
Sep 08 15:20:42.992937 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:20:42.992901    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8d10438_dd74_40fa_853d_6a82f814030f.slice/crio-d69c68928ff0cb86bb411a958b7a9c5d6f89756f70aa56280755b53119dde8d9 WatchSource:0}: Error finding container d69c68928ff0cb86bb411a958b7a9c5d6f89756f70aa56280755b53119dde8d9: Status 404 returned error can't find the container with id d69c68928ff0cb86bb411a958b7a9c5d6f89756f70aa56280755b53119dde8d9
Sep 08 15:20:43.042560 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:43.042527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-tfrjg" event={"ID":"c8d10438-dd74-40fa-853d-6a82f814030f","Type":"ContainerStarted","Data":"d69c68928ff0cb86bb411a958b7a9c5d6f89756f70aa56280755b53119dde8d9"}
Sep 08 15:20:43.043725 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:43.043703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb" event={"ID":"5706aec7-ef3c-4ae8-9804-ada1754497b2","Type":"ContainerStarted","Data":"b0fa996a7dfd72c175c9e77d79c836d68ce39f4f9909482083644603cfb0d41a"}
Sep 08 15:20:44.050641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:44.050608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb" event={"ID":"5706aec7-ef3c-4ae8-9804-ada1754497b2","Type":"ContainerStarted","Data":"167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c"}
Sep 08 15:20:44.051052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:44.050711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:44.068939 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:44.068889    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb" podStartSLOduration=1.6565196530000001 podStartE2EDuration="3.068873991s" totalImagesPullingTime="1.412354338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:44.066973414 +0000 UTC m=+464.726134545" watchObservedRunningTime="2026-09-08 15:20:44.068873991 +0000 UTC m=+464.728035118"
Sep 08 15:20:46.133281 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:46.133254    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-tfrjg"]
Sep 08 15:20:47.070185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:47.070148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-tfrjg" event={"ID":"c8d10438-dd74-40fa-853d-6a82f814030f","Type":"ContainerStarted","Data":"f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0"}
Sep 08 15:20:47.070377 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:47.070205    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-tfrjg" podUID="c8d10438-dd74-40fa-853d-6a82f814030f" containerName="authorino" containerID="cri-o://f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0" gracePeriod=30
Sep 08 15:20:47.086394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:47.086338    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-tfrjg" podStartSLOduration=1.953297114 podStartE2EDuration="5.086321979s" totalImagesPullingTime="3.133024865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:47.084240402 +0000 UTC m=+467.743401529" watchObservedRunningTime="2026-09-08 15:20:47.086321979 +0000 UTC m=+467.745483105"
Sep 08 15:20:47.318268 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:47.318235    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-tfrjg"
Sep 08 15:20:47.405739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:47.405652    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtss2\" (UniqueName: \"kubernetes.io/projected/c8d10438-dd74-40fa-853d-6a82f814030f-kube-api-access-jtss2\") pod \"c8d10438-dd74-40fa-853d-6a82f814030f\" (UID: \"c8d10438-dd74-40fa-853d-6a82f814030f\") "
Sep 08 15:20:47.407818 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:47.407787    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8d10438-dd74-40fa-853d-6a82f814030f-kube-api-access-jtss2" (OuterVolumeSpecName: "kube-api-access-jtss2") pod "c8d10438-dd74-40fa-853d-6a82f814030f" (UID: "c8d10438-dd74-40fa-853d-6a82f814030f"). InnerVolumeSpecName "kube-api-access-jtss2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:47.507378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:47.507345    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtss2\" (UniqueName: \"kubernetes.io/projected/c8d10438-dd74-40fa-853d-6a82f814030f-kube-api-access-jtss2\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:20:48.076616 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.076564    2578 generic.go:356] "Generic (PLEG): container finished" podID="c8d10438-dd74-40fa-853d-6a82f814030f" containerID="f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0" exitCode=0
Sep 08 15:20:48.076764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.076637    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-tfrjg"
Sep 08 15:20:48.076764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.076646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-tfrjg" event={"ID":"c8d10438-dd74-40fa-853d-6a82f814030f","Type":"ContainerDied","Data":"f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0"}
Sep 08 15:20:48.076764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.076691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-tfrjg" event={"ID":"c8d10438-dd74-40fa-853d-6a82f814030f","Type":"ContainerDied","Data":"d69c68928ff0cb86bb411a958b7a9c5d6f89756f70aa56280755b53119dde8d9"}
Sep 08 15:20:48.076764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.076709    2578 scope.go:117] "RemoveContainer" containerID="f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0"
Sep 08 15:20:48.085295 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.085277    2578 scope.go:117] "RemoveContainer" containerID="f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0"
Sep 08 15:20:48.085569 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:20:48.085549    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0\": container with ID starting with f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0 not found: ID does not exist" containerID="f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0"
Sep 08 15:20:48.085635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.085592    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0"} err="failed to get container status \"f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0\": rpc error: code = NotFound desc = could not find container \"f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0\": container with ID starting with f7fd889a7e8332bbdc59851a91ce0c25f573e3a3a36c0367293f088f6d333fc0 not found: ID does not exist"
Sep 08 15:20:48.093040 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.092986    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-tfrjg"]
Sep 08 15:20:48.096787 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.096766    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-tfrjg"]
Sep 08 15:20:48.987768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:48.987732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:49.827272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:49.827237    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8d10438-dd74-40fa-853d-6a82f814030f" path="/var/lib/kubelet/pods/c8d10438-dd74-40fa-853d-6a82f814030f/volumes"
Sep 08 15:20:55.059211 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:55.059177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:57.140305 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.140273    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"]
Sep 08 15:20:57.140815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.140445    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb" podUID="5706aec7-ef3c-4ae8-9804-ada1754497b2" containerName="limitador" containerID="cri-o://167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c" gracePeriod=30
Sep 08 15:20:57.693987 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.693961    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:57.804710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.804611    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9wxb\" (UniqueName: \"kubernetes.io/projected/5706aec7-ef3c-4ae8-9804-ada1754497b2-kube-api-access-l9wxb\") pod \"5706aec7-ef3c-4ae8-9804-ada1754497b2\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") "
Sep 08 15:20:57.804710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.804685    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5706aec7-ef3c-4ae8-9804-ada1754497b2-config-file\") pod \"5706aec7-ef3c-4ae8-9804-ada1754497b2\" (UID: \"5706aec7-ef3c-4ae8-9804-ada1754497b2\") "
Sep 08 15:20:57.805047 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.805020    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5706aec7-ef3c-4ae8-9804-ada1754497b2-config-file" (OuterVolumeSpecName: "config-file") pod "5706aec7-ef3c-4ae8-9804-ada1754497b2" (UID: "5706aec7-ef3c-4ae8-9804-ada1754497b2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:57.806870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.806837    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5706aec7-ef3c-4ae8-9804-ada1754497b2-kube-api-access-l9wxb" (OuterVolumeSpecName: "kube-api-access-l9wxb") pod "5706aec7-ef3c-4ae8-9804-ada1754497b2" (UID: "5706aec7-ef3c-4ae8-9804-ada1754497b2"). InnerVolumeSpecName "kube-api-access-l9wxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:57.906002 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.905970    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5706aec7-ef3c-4ae8-9804-ada1754497b2-config-file\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:20:57.906002 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:57.905996    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9wxb\" (UniqueName: \"kubernetes.io/projected/5706aec7-ef3c-4ae8-9804-ada1754497b2-kube-api-access-l9wxb\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:20:58.127062 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.126968    2578 generic.go:356] "Generic (PLEG): container finished" podID="5706aec7-ef3c-4ae8-9804-ada1754497b2" containerID="167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c" exitCode=0
Sep 08 15:20:58.127062 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.127013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"
Sep 08 15:20:58.127247 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.127060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb" event={"ID":"5706aec7-ef3c-4ae8-9804-ada1754497b2","Type":"ContainerDied","Data":"167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c"}
Sep 08 15:20:58.127247 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.127114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-9lvfb" event={"ID":"5706aec7-ef3c-4ae8-9804-ada1754497b2","Type":"ContainerDied","Data":"b0fa996a7dfd72c175c9e77d79c836d68ce39f4f9909482083644603cfb0d41a"}
Sep 08 15:20:58.127247 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.127137    2578 scope.go:117] "RemoveContainer" containerID="167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c"
Sep 08 15:20:58.135786 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.135770    2578 scope.go:117] "RemoveContainer" containerID="167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c"
Sep 08 15:20:58.136049 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:20:58.136034    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c\": container with ID starting with 167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c not found: ID does not exist" containerID="167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c"
Sep 08 15:20:58.136094 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.136056    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c"} err="failed to get container status \"167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c\": rpc error: code = NotFound desc = could not find container \"167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c\": container with ID starting with 167db3892708a184c86707c5d56d16314482fb902149a45df5ef5b93a055025c not found: ID does not exist"
Sep 08 15:20:58.145631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.145609    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"]
Sep 08 15:20:58.152788 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.152768    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-9lvfb"]
Sep 08 15:20:58.483640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.483607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:58.585167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:58.585125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:20:59.826829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:20:59.826793    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5706aec7-ef3c-4ae8-9804-ada1754497b2" path="/var/lib/kubelet/pods/5706aec7-ef3c-4ae8-9804-ada1754497b2/volumes"
Sep 08 15:21:00.634181 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:00.634149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:00.734397 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:00.734364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:01.119175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.119138    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"]
Sep 08 15:21:01.119754 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.119737    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5706aec7-ef3c-4ae8-9804-ada1754497b2" containerName="limitador"
Sep 08 15:21:01.119816 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.119756    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5706aec7-ef3c-4ae8-9804-ada1754497b2" containerName="limitador"
Sep 08 15:21:01.119816 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.119773    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d10438-dd74-40fa-853d-6a82f814030f" containerName="authorino"
Sep 08 15:21:01.119816 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.119783    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d10438-dd74-40fa-853d-6a82f814030f" containerName="authorino"
Sep 08 15:21:01.119903 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.119871    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5706aec7-ef3c-4ae8-9804-ada1754497b2" containerName="limitador"
Sep 08 15:21:01.119903 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.119885    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d10438-dd74-40fa-853d-6a82f814030f" containerName="authorino"
Sep 08 15:21:01.124846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.124825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.129773 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.129743    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:21:01.130089 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.130065    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 15:21:01.130536 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.130514    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 15:21:01.130927 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.130888    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-trrj6\""
Sep 08 15:21:01.131519 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.131495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"]
Sep 08 15:21:01.153326 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.153294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:01.234917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.234877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpwsm\" (UniqueName: \"kubernetes.io/projected/844d0811-1d0d-41b2-a87c-f1a19f5a0d48-kube-api-access-vpwsm\") pod \"postgres-69fb4594cf-dpr5b\" (UID: \"844d0811-1d0d-41b2-a87c-f1a19f5a0d48\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.235086 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.235018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/844d0811-1d0d-41b2-a87c-f1a19f5a0d48-data\") pod \"postgres-69fb4594cf-dpr5b\" (UID: \"844d0811-1d0d-41b2-a87c-f1a19f5a0d48\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.335902 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.335863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/844d0811-1d0d-41b2-a87c-f1a19f5a0d48-data\") pod \"postgres-69fb4594cf-dpr5b\" (UID: \"844d0811-1d0d-41b2-a87c-f1a19f5a0d48\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.336083 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.335969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpwsm\" (UniqueName: \"kubernetes.io/projected/844d0811-1d0d-41b2-a87c-f1a19f5a0d48-kube-api-access-vpwsm\") pod \"postgres-69fb4594cf-dpr5b\" (UID: \"844d0811-1d0d-41b2-a87c-f1a19f5a0d48\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.336228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.336207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/844d0811-1d0d-41b2-a87c-f1a19f5a0d48-data\") pod \"postgres-69fb4594cf-dpr5b\" (UID: \"844d0811-1d0d-41b2-a87c-f1a19f5a0d48\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.343471 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.343453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpwsm\" (UniqueName: \"kubernetes.io/projected/844d0811-1d0d-41b2-a87c-f1a19f5a0d48-kube-api-access-vpwsm\") pod \"postgres-69fb4594cf-dpr5b\" (UID: \"844d0811-1d0d-41b2-a87c-f1a19f5a0d48\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.437088 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.436999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:01.710485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:01.710453    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"]
Sep 08 15:21:01.713258 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:21:01.713227    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844d0811_1d0d_41b2_a87c_f1a19f5a0d48.slice/crio-48b300bf6e933a585f3cc1416ce98044c3c2ec935d6bf253fd9fd7a42213f4a0 WatchSource:0}: Error finding container 48b300bf6e933a585f3cc1416ce98044c3c2ec935d6bf253fd9fd7a42213f4a0: Status 404 returned error can't find the container with id 48b300bf6e933a585f3cc1416ce98044c3c2ec935d6bf253fd9fd7a42213f4a0
Sep 08 15:21:02.148837 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:02.148753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b" event={"ID":"844d0811-1d0d-41b2-a87c-f1a19f5a0d48","Type":"ContainerStarted","Data":"48b300bf6e933a585f3cc1416ce98044c3c2ec935d6bf253fd9fd7a42213f4a0"}
Sep 08 15:21:09.192095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:09.192051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b" event={"ID":"844d0811-1d0d-41b2-a87c-f1a19f5a0d48","Type":"ContainerStarted","Data":"e4a949aa8410ec817db35f88fc72e91c432168c6834ca93f05ca6c747db987e4"}
Sep 08 15:21:09.192626 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:09.192127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:09.209795 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:09.209750    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b" podStartSLOduration=1.770992209 podStartE2EDuration="8.209736043s" totalImagesPullingTime="6.438743834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:09.207872703 +0000 UTC m=+489.867033831" watchObservedRunningTime="2026-09-08 15:21:09.209736043 +0000 UTC m=+489.868897220"
Sep 08 15:21:15.226603 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.226560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpr5b"
Sep 08 15:21:15.540363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.540265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:15.774759 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.774729    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-56q9p"]
Sep 08 15:21:15.785113 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.785083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p"
Sep 08 15:21:15.785391 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.785359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-56q9p"]
Sep 08 15:21:15.787453 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.787433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:21:15.788233 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.788214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:21:15.788326 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.788297    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bm7bp\""
Sep 08 15:21:15.871505 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.871472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp7wh\" (UniqueName: \"kubernetes.io/projected/c926ffa5-573a-4091-9a9f-78b80611a50f-kube-api-access-xp7wh\") pod \"authorino-5dc7ccb5f-56q9p\" (UID: \"c926ffa5-573a-4091-9a9f-78b80611a50f\") " pod="kuadrant-system/authorino-5dc7ccb5f-56q9p"
Sep 08 15:21:15.972681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.972636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp7wh\" (UniqueName: \"kubernetes.io/projected/c926ffa5-573a-4091-9a9f-78b80611a50f-kube-api-access-xp7wh\") pod \"authorino-5dc7ccb5f-56q9p\" (UID: \"c926ffa5-573a-4091-9a9f-78b80611a50f\") " pod="kuadrant-system/authorino-5dc7ccb5f-56q9p"
Sep 08 15:21:15.983213 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:15.983184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp7wh\" (UniqueName: \"kubernetes.io/projected/c926ffa5-573a-4091-9a9f-78b80611a50f-kube-api-access-xp7wh\") pod \"authorino-5dc7ccb5f-56q9p\" (UID: \"c926ffa5-573a-4091-9a9f-78b80611a50f\") " pod="kuadrant-system/authorino-5dc7ccb5f-56q9p"
Sep 08 15:21:16.013309 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.013275    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-56q9p"]
Sep 08 15:21:16.013567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.013555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p"
Sep 08 15:21:16.058074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.058003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:16.127887 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.127856    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cd4d79fd8-hccsj"]
Sep 08 15:21:16.132897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.132878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.135164 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.135144    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 08 15:21:16.140297 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.140276    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd4d79fd8-hccsj"]
Sep 08 15:21:16.174605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.174553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e55e037-1691-46b0-99f3-bb3551c64fca-tls-cert\") pod \"authorino-cd4d79fd8-hccsj\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") " pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.174787 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.174721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x8zj\" (UniqueName: \"kubernetes.io/projected/7e55e037-1691-46b0-99f3-bb3551c64fca-kube-api-access-9x8zj\") pod \"authorino-cd4d79fd8-hccsj\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") " pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.276248 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.276220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x8zj\" (UniqueName: \"kubernetes.io/projected/7e55e037-1691-46b0-99f3-bb3551c64fca-kube-api-access-9x8zj\") pod \"authorino-cd4d79fd8-hccsj\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") " pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.276615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.276278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e55e037-1691-46b0-99f3-bb3551c64fca-tls-cert\") pod \"authorino-cd4d79fd8-hccsj\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") " pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.278699 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.278670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e55e037-1691-46b0-99f3-bb3551c64fca-tls-cert\") pod \"authorino-cd4d79fd8-hccsj\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") " pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.284218 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.284196    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-56q9p"]
Sep 08 15:21:16.286093 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.286060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x8zj\" (UniqueName: \"kubernetes.io/projected/7e55e037-1691-46b0-99f3-bb3551c64fca-kube-api-access-9x8zj\") pod \"authorino-cd4d79fd8-hccsj\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") " pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.286554 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:21:16.286527    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc926ffa5_573a_4091_9a9f_78b80611a50f.slice/crio-0fcb0f5e805b5f85756c230747d894ff61796006a4368ba03fbd306599e4cf1a WatchSource:0}: Error finding container 0fcb0f5e805b5f85756c230747d894ff61796006a4368ba03fbd306599e4cf1a: Status 404 returned error can't find the container with id 0fcb0f5e805b5f85756c230747d894ff61796006a4368ba03fbd306599e4cf1a
Sep 08 15:21:16.442722 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.442635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:21:16.715962 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:16.715926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd4d79fd8-hccsj"]
Sep 08 15:21:16.718796 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:21:16.718764    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e55e037_1691_46b0_99f3_bb3551c64fca.slice/crio-695530b705923a6f6b24933038cc600a713af1ff002f97df82f56aba9fef830a WatchSource:0}: Error finding container 695530b705923a6f6b24933038cc600a713af1ff002f97df82f56aba9fef830a: Status 404 returned error can't find the container with id 695530b705923a6f6b24933038cc600a713af1ff002f97df82f56aba9fef830a
Sep 08 15:21:17.232862 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.232752    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p" event={"ID":"c926ffa5-573a-4091-9a9f-78b80611a50f","Type":"ContainerStarted","Data":"9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670"}
Sep 08 15:21:17.232862 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.232809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p" event={"ID":"c926ffa5-573a-4091-9a9f-78b80611a50f","Type":"ContainerStarted","Data":"0fcb0f5e805b5f85756c230747d894ff61796006a4368ba03fbd306599e4cf1a"}
Sep 08 15:21:17.232862 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.232817    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p" podUID="c926ffa5-573a-4091-9a9f-78b80611a50f" containerName="authorino" containerID="cri-o://9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670" gracePeriod=30
Sep 08 15:21:17.234119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.234081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd4d79fd8-hccsj" event={"ID":"7e55e037-1691-46b0-99f3-bb3551c64fca","Type":"ContainerStarted","Data":"695530b705923a6f6b24933038cc600a713af1ff002f97df82f56aba9fef830a"}
Sep 08 15:21:17.249494 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.249440    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p" podStartSLOduration=1.592594042 podStartE2EDuration="2.249418372s" totalImagesPullingTime="656.82433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:17.248344807 +0000 UTC m=+497.907505932" watchObservedRunningTime="2026-09-08 15:21:17.249418372 +0000 UTC m=+497.908579528"
Sep 08 15:21:17.489236 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.489158    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p"
Sep 08 15:21:17.587726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.587694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp7wh\" (UniqueName: \"kubernetes.io/projected/c926ffa5-573a-4091-9a9f-78b80611a50f-kube-api-access-xp7wh\") pod \"c926ffa5-573a-4091-9a9f-78b80611a50f\" (UID: \"c926ffa5-573a-4091-9a9f-78b80611a50f\") "
Sep 08 15:21:17.589759 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.589726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c926ffa5-573a-4091-9a9f-78b80611a50f-kube-api-access-xp7wh" (OuterVolumeSpecName: "kube-api-access-xp7wh") pod "c926ffa5-573a-4091-9a9f-78b80611a50f" (UID: "c926ffa5-573a-4091-9a9f-78b80611a50f"). InnerVolumeSpecName "kube-api-access-xp7wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:21:17.688710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:17.688676    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp7wh\" (UniqueName: \"kubernetes.io/projected/c926ffa5-573a-4091-9a9f-78b80611a50f-kube-api-access-xp7wh\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:21:18.240836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.240800    2578 generic.go:356] "Generic (PLEG): container finished" podID="c926ffa5-573a-4091-9a9f-78b80611a50f" containerID="9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670" exitCode=0
Sep 08 15:21:18.241022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.240850    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p"
Sep 08 15:21:18.241022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.240884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p" event={"ID":"c926ffa5-573a-4091-9a9f-78b80611a50f","Type":"ContainerDied","Data":"9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670"}
Sep 08 15:21:18.241022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.240926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-56q9p" event={"ID":"c926ffa5-573a-4091-9a9f-78b80611a50f","Type":"ContainerDied","Data":"0fcb0f5e805b5f85756c230747d894ff61796006a4368ba03fbd306599e4cf1a"}
Sep 08 15:21:18.241022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.240949    2578 scope.go:117] "RemoveContainer" containerID="9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670"
Sep 08 15:21:18.242676 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.242643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd4d79fd8-hccsj" event={"ID":"7e55e037-1691-46b0-99f3-bb3551c64fca","Type":"ContainerStarted","Data":"9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181"}
Sep 08 15:21:18.249916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.249898    2578 scope.go:117] "RemoveContainer" containerID="9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670"
Sep 08 15:21:18.250204 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:18.250181    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670\": container with ID starting with 9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670 not found: ID does not exist" containerID="9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670"
Sep 08 15:21:18.250269 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.250211    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670"} err="failed to get container status \"9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670\": rpc error: code = NotFound desc = could not find container \"9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670\": container with ID starting with 9608f19d4d2c7332f8115a84bb877dc33956a56c2cac15cecd7d7b63f6750670 not found: ID does not exist"
Sep 08 15:21:18.257827 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.257805    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-56q9p"]
Sep 08 15:21:18.261443 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.261424    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-56q9p"]
Sep 08 15:21:18.275019 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:18.274976    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cd4d79fd8-hccsj" podStartSLOduration=1.6544929929999999 podStartE2EDuration="2.274964027s" totalImagesPullingTime="620.471034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:18.272660859 +0000 UTC m=+498.931821987" watchObservedRunningTime="2026-09-08 15:21:18.274964027 +0000 UTC m=+498.934125154"
Sep 08 15:21:19.831658 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:19.831614    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c926ffa5-573a-4091-9a9f-78b80611a50f" path="/var/lib/kubelet/pods/c926ffa5-573a-4091-9a9f-78b80611a50f/volumes"
Sep 08 15:21:23.059525 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.059483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:23.088808 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.088777    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c4c7d676f-7rj2p"]
Sep 08 15:21:23.089177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.089164    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c926ffa5-573a-4091-9a9f-78b80611a50f" containerName="authorino"
Sep 08 15:21:23.089230 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.089178    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c926ffa5-573a-4091-9a9f-78b80611a50f" containerName="authorino"
Sep 08 15:21:23.089264 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.089238    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c926ffa5-573a-4091-9a9f-78b80611a50f" containerName="authorino"
Sep 08 15:21:23.107655 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.107628    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c4c7d676f-7rj2p"]
Sep 08 15:21:23.107819 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.107740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.110990 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.110963    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:21:23.111132 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.111046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9xvpg\""
Sep 08 15:21:23.111944 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.111916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:21:23.111944 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.111936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:21:23.134968 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.134943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:23.138207 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.138185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.138307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.138226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wzx\" (UniqueName: \"kubernetes.io/projected/6baabe88-1a9d-4745-a931-f0052e6dca5b-kube-api-access-b5wzx\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.138307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.138259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.195824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.195781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:23.239352 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.239325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.239501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.239358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wzx\" (UniqueName: \"kubernetes.io/projected/6baabe88-1a9d-4745-a931-f0052e6dca5b-kube-api-access-b5wzx\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.239501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.239383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.239501 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.239473    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 08 15:21:23.239699 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.239508    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 15:21:23.239699 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.239540    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs podName:6baabe88-1a9d-4745-a931-f0052e6dca5b nodeName:}" failed. No retries permitted until 2026-09-08 15:21:23.739523981 +0000 UTC m=+504.398685091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs") pod "maas-controller-7c4c7d676f-7rj2p" (UID: "6baabe88-1a9d-4745-a931-f0052e6dca5b") : secret "maas-controller-metrics-tls" not found
Sep 08 15:21:23.239699 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.239556    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert podName:6baabe88-1a9d-4745-a931-f0052e6dca5b nodeName:}" failed. No retries permitted until 2026-09-08 15:21:23.739549968 +0000 UTC m=+504.398711073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert") pod "maas-controller-7c4c7d676f-7rj2p" (UID: "6baabe88-1a9d-4745-a931-f0052e6dca5b") : secret "maas-controller-webhook-cert" not found
Sep 08 15:21:23.249973 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.249950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wzx\" (UniqueName: \"kubernetes.io/projected/6baabe88-1a9d-4745-a931-f0052e6dca5b-kube-api-access-b5wzx\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.263443 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.263421    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55dd7bb999-8z9mg"]
Sep 08 15:21:23.266624 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.266603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.276095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.276074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-8z9mg"]
Sep 08 15:21:23.340918 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.340824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.340918 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.340912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.341111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.340978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h55m\" (UniqueName: \"kubernetes.io/projected/2a02f0d4-c47c-406b-b363-051839207940-kube-api-access-4h55m\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.441943 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.441903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.442124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.441972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.442124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.442031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h55m\" (UniqueName: \"kubernetes.io/projected/2a02f0d4-c47c-406b-b363-051839207940-kube-api-access-4h55m\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.442124 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.442052    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 08 15:21:23.442124 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.442118    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 15:21:23.442276 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.442120    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs podName:2a02f0d4-c47c-406b-b363-051839207940 nodeName:}" failed. No retries permitted until 2026-09-08 15:21:23.942101043 +0000 UTC m=+504.601262173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs") pod "maas-controller-55dd7bb999-8z9mg" (UID: "2a02f0d4-c47c-406b-b363-051839207940") : secret "maas-controller-metrics-tls" not found
Sep 08 15:21:23.442276 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.442182    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert podName:2a02f0d4-c47c-406b-b363-051839207940 nodeName:}" failed. No retries permitted until 2026-09-08 15:21:23.942167592 +0000 UTC m=+504.601328701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert") pod "maas-controller-55dd7bb999-8z9mg" (UID: "2a02f0d4-c47c-406b-b363-051839207940") : secret "maas-controller-webhook-cert" not found
Sep 08 15:21:23.450919 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.450885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h55m\" (UniqueName: \"kubernetes.io/projected/2a02f0d4-c47c-406b-b363-051839207940-kube-api-access-4h55m\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.504524 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.504495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:23.744683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.744628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.744683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.744688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.744904 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.744889    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 15:21:23.744962 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:23.744953    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert podName:6baabe88-1a9d-4745-a931-f0052e6dca5b nodeName:}" failed. No retries permitted until 2026-09-08 15:21:24.744934716 +0000 UTC m=+505.404096044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert") pod "maas-controller-7c4c7d676f-7rj2p" (UID: "6baabe88-1a9d-4745-a931-f0052e6dca5b") : secret "maas-controller-webhook-cert" not found
Sep 08 15:21:23.747222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.747189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:23.803059 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.803033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:23.946735 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.946702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.946970 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.946783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.949323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.949295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:23.949400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:23.949323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert\") pod \"maas-controller-55dd7bb999-8z9mg\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") " pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:24.179488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:24.179402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:24.448247 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:24.448145    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-8z9mg"]
Sep 08 15:21:24.450476 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:21:24.450442    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a02f0d4_c47c_406b_b363_051839207940.slice/crio-024bb58c9ca0dd619477ad8f625dda9f3b6e754a380a16d6d5562a991fb17741 WatchSource:0}: Error finding container 024bb58c9ca0dd619477ad8f625dda9f3b6e754a380a16d6d5562a991fb17741: Status 404 returned error can't find the container with id 024bb58c9ca0dd619477ad8f625dda9f3b6e754a380a16d6d5562a991fb17741
Sep 08 15:21:24.754242 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:24.753526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:24.760015 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:24.757097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert\") pod \"maas-controller-7c4c7d676f-7rj2p\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") " pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:24.919217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:24.919183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:25.190050 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:25.190024    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c4c7d676f-7rj2p"]
Sep 08 15:21:25.191969 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:21:25.191942    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6baabe88_1a9d_4745_a931_f0052e6dca5b.slice/crio-fb6b21deb502f3d505f56f637b7ea3e79a0fe44e66b645cb7e260b8d2293968d WatchSource:0}: Error finding container fb6b21deb502f3d505f56f637b7ea3e79a0fe44e66b645cb7e260b8d2293968d: Status 404 returned error can't find the container with id fb6b21deb502f3d505f56f637b7ea3e79a0fe44e66b645cb7e260b8d2293968d
Sep 08 15:21:25.281775 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:25.281739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p" event={"ID":"6baabe88-1a9d-4745-a931-f0052e6dca5b","Type":"ContainerStarted","Data":"fb6b21deb502f3d505f56f637b7ea3e79a0fe44e66b645cb7e260b8d2293968d"}
Sep 08 15:21:25.285734 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:25.283757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-8z9mg" event={"ID":"2a02f0d4-c47c-406b-b363-051839207940","Type":"ContainerStarted","Data":"024bb58c9ca0dd619477ad8f625dda9f3b6e754a380a16d6d5562a991fb17741"}
Sep 08 15:21:27.827838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:27.827804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:27.926406 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:27.926329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:21:28.304309 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:28.304271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-8z9mg" event={"ID":"2a02f0d4-c47c-406b-b363-051839207940","Type":"ContainerStarted","Data":"8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5"}
Sep 08 15:21:28.304485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:28.304334    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:28.305710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:28.305683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p" event={"ID":"6baabe88-1a9d-4745-a931-f0052e6dca5b","Type":"ContainerStarted","Data":"39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb"}
Sep 08 15:21:28.305848 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:28.305735    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:28.332060 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:28.332012    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55dd7bb999-8z9mg" podStartSLOduration=2.13195542 podStartE2EDuration="5.331997342s" totalImagesPullingTime="3.200041922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:28.33076513 +0000 UTC m=+508.989926272" watchObservedRunningTime="2026-09-08 15:21:28.331997342 +0000 UTC m=+508.991158465"
Sep 08 15:21:28.369708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:28.369655    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p" podStartSLOduration=2.900066581 podStartE2EDuration="5.369639964s" totalImagesPullingTime="2.469573383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:28.368153988 +0000 UTC m=+509.027315116" watchObservedRunningTime="2026-09-08 15:21:28.369639964 +0000 UTC m=+509.028801091"
Sep 08 15:21:39.313251 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.313220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:21:39.313771 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.313379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:39.361415 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.361378    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c4c7d676f-7rj2p"]
Sep 08 15:21:39.361660 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.361630    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p" podUID="6baabe88-1a9d-4745-a931-f0052e6dca5b" containerName="manager" containerID="cri-o://39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb" gracePeriod=30
Sep 08 15:21:39.613702 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.612816    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:39.703345 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.703311    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs\") pod \"6baabe88-1a9d-4745-a931-f0052e6dca5b\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") "
Sep 08 15:21:39.703345 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.703353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert\") pod \"6baabe88-1a9d-4745-a931-f0052e6dca5b\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") "
Sep 08 15:21:39.703557 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.703459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5wzx\" (UniqueName: \"kubernetes.io/projected/6baabe88-1a9d-4745-a931-f0052e6dca5b-kube-api-access-b5wzx\") pod \"6baabe88-1a9d-4745-a931-f0052e6dca5b\" (UID: \"6baabe88-1a9d-4745-a931-f0052e6dca5b\") "
Sep 08 15:21:39.705546 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.705518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6baabe88-1a9d-4745-a931-f0052e6dca5b" (UID: "6baabe88-1a9d-4745-a931-f0052e6dca5b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:21:39.705744 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.705619    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6baabe88-1a9d-4745-a931-f0052e6dca5b" (UID: "6baabe88-1a9d-4745-a931-f0052e6dca5b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:21:39.705744 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.705688    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6baabe88-1a9d-4745-a931-f0052e6dca5b-kube-api-access-b5wzx" (OuterVolumeSpecName: "kube-api-access-b5wzx") pod "6baabe88-1a9d-4745-a931-f0052e6dca5b" (UID: "6baabe88-1a9d-4745-a931-f0052e6dca5b"). InnerVolumeSpecName "kube-api-access-b5wzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:21:39.804532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.804491    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:21:39.804532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.804524    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6baabe88-1a9d-4745-a931-f0052e6dca5b-webhook-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:21:39.804532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:39.804537    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5wzx\" (UniqueName: \"kubernetes.io/projected/6baabe88-1a9d-4745-a931-f0052e6dca5b-kube-api-access-b5wzx\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:21:40.367631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.367574    2578 generic.go:356] "Generic (PLEG): container finished" podID="6baabe88-1a9d-4745-a931-f0052e6dca5b" containerID="39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb" exitCode=0
Sep 08 15:21:40.367631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.367629    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p"
Sep 08 15:21:40.368142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.367686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p" event={"ID":"6baabe88-1a9d-4745-a931-f0052e6dca5b","Type":"ContainerDied","Data":"39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb"}
Sep 08 15:21:40.368142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.367749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c4c7d676f-7rj2p" event={"ID":"6baabe88-1a9d-4745-a931-f0052e6dca5b","Type":"ContainerDied","Data":"fb6b21deb502f3d505f56f637b7ea3e79a0fe44e66b645cb7e260b8d2293968d"}
Sep 08 15:21:40.368142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.367784    2578 scope.go:117] "RemoveContainer" containerID="39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb"
Sep 08 15:21:40.376429 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.376402    2578 scope.go:117] "RemoveContainer" containerID="39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb"
Sep 08 15:21:40.376711 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:21:40.376690    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb\": container with ID starting with 39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb not found: ID does not exist" containerID="39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb"
Sep 08 15:21:40.376767 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.376723    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb"} err="failed to get container status \"39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb\": rpc error: code = NotFound desc = could not find container \"39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb\": container with ID starting with 39b41b975c985ebf547a1abe42b922c35a2b5af07a743b8ce07f68dc115f1dbb not found: ID does not exist"
Sep 08 15:21:40.385483 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.385459    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c4c7d676f-7rj2p"]
Sep 08 15:21:40.388739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:40.388719    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c4c7d676f-7rj2p"]
Sep 08 15:21:41.827868 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:21:41.827836    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6baabe88-1a9d-4745-a931-f0052e6dca5b" path="/var/lib/kubelet/pods/6baabe88-1a9d-4745-a931-f0052e6dca5b/volumes"
Sep 08 15:22:00.332105 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:00.332067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:00.432765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:00.432689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:00.857176 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:00.857142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:00.966027 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:00.965992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:01.006680 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.006646    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"]
Sep 08 15:22:01.007082 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.007054    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6baabe88-1a9d-4745-a931-f0052e6dca5b" containerName="manager"
Sep 08 15:22:01.007082 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.007072    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6baabe88-1a9d-4745-a931-f0052e6dca5b" containerName="manager"
Sep 08 15:22:01.007283 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.007168    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6baabe88-1a9d-4745-a931-f0052e6dca5b" containerName="manager"
Sep 08 15:22:01.013600 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.013563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.017016 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.016989    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:22:01.017163 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.017074    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4m2fn\""
Sep 08 15:22:01.017163 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.017032    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 15:22:01.020300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.020275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"]
Sep 08 15:22:01.057215 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.057183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:01.093652 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.093617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.093819 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.093711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-metrics-certs\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.093819 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.093786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa63b385-4211-4aba-901c-da72a8de7343-openshift-service-ca\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.093906 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.093852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k25hv\" (UniqueName: \"kubernetes.io/projected/aa63b385-4211-4aba-901c-da72a8de7343-kube-api-access-k25hv\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.194378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.194302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-metrics-certs\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.194378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.194364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa63b385-4211-4aba-901c-da72a8de7343-openshift-service-ca\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.194617 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.194414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k25hv\" (UniqueName: \"kubernetes.io/projected/aa63b385-4211-4aba-901c-da72a8de7343-kube-api-access-k25hv\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.194617 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.194462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.194748 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:22:01.194662    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 08 15:22:01.194748 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:22:01.194737    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls podName:aa63b385-4211-4aba-901c-da72a8de7343 nodeName:}" failed. No retries permitted until 2026-09-08 15:22:01.694713976 +0000 UTC m=+542.353875092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls") pod "maas-api-8b8df4f6-dgmkc" (UID: "aa63b385-4211-4aba-901c-da72a8de7343") : secret "maas-api-serving-cert" not found
Sep 08 15:22:01.195223 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.195197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa63b385-4211-4aba-901c-da72a8de7343-openshift-service-ca\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.197112 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.197093    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-metrics-certs\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.203526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.203495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k25hv\" (UniqueName: \"kubernetes.io/projected/aa63b385-4211-4aba-901c-da72a8de7343-kube-api-access-k25hv\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.396942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.396899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:01.496148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.496103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:01.544608 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.544561    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5w58s"]
Sep 08 15:22:01.547829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.547812    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.550775 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.550756    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 15:22:01.551040 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.551021    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2vd6p\""
Sep 08 15:22:01.558966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.558935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5w58s"]
Sep 08 15:22:01.600041 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.600006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e83bc787-cf0d-45f8-b5bf-acec97385865-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5w58s\" (UID: \"e83bc787-cf0d-45f8-b5bf-acec97385865\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.600221 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.600172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww6fl\" (UniqueName: \"kubernetes.io/projected/e83bc787-cf0d-45f8-b5bf-acec97385865-kube-api-access-ww6fl\") pod \"payload-processing-5b54b7fbb7-5w58s\" (UID: \"e83bc787-cf0d-45f8-b5bf-acec97385865\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.701306 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.701273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e83bc787-cf0d-45f8-b5bf-acec97385865-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5w58s\" (UID: \"e83bc787-cf0d-45f8-b5bf-acec97385865\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.701488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.701326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.701488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.701378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww6fl\" (UniqueName: \"kubernetes.io/projected/e83bc787-cf0d-45f8-b5bf-acec97385865-kube-api-access-ww6fl\") pod \"payload-processing-5b54b7fbb7-5w58s\" (UID: \"e83bc787-cf0d-45f8-b5bf-acec97385865\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.702378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.702332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e83bc787-cf0d-45f8-b5bf-acec97385865-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5w58s\" (UID: \"e83bc787-cf0d-45f8-b5bf-acec97385865\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.703973 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.703946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls\") pod \"maas-api-8b8df4f6-dgmkc\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") " pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:01.710203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.710175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww6fl\" (UniqueName: \"kubernetes.io/projected/e83bc787-cf0d-45f8-b5bf-acec97385865-kube-api-access-ww6fl\") pod \"payload-processing-5b54b7fbb7-5w58s\" (UID: \"e83bc787-cf0d-45f8-b5bf-acec97385865\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.859192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.859100    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:01.925391 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:01.925345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:02.137551 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:02.137525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5w58s"]
Sep 08 15:22:02.139495 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:22:02.139463    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83bc787_cf0d_45f8_b5bf_acec97385865.slice/crio-16b1f8edf98611461b18dde7cb6f61ab5b932bd2622063528d5bd0d42d5b3f02 WatchSource:0}: Error finding container 16b1f8edf98611461b18dde7cb6f61ab5b932bd2622063528d5bd0d42d5b3f02: Status 404 returned error can't find the container with id 16b1f8edf98611461b18dde7cb6f61ab5b932bd2622063528d5bd0d42d5b3f02
Sep 08 15:22:02.229571 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:02.229552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"]
Sep 08 15:22:02.231823 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:22:02.231793    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa63b385_4211_4aba_901c_da72a8de7343.slice/crio-9a881459c9fac24822fc2325b0420b511b57cdac4983558c5c872d3f1c5bb68f WatchSource:0}: Error finding container 9a881459c9fac24822fc2325b0420b511b57cdac4983558c5c872d3f1c5bb68f: Status 404 returned error can't find the container with id 9a881459c9fac24822fc2325b0420b511b57cdac4983558c5c872d3f1c5bb68f
Sep 08 15:22:02.485379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:02.485343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s" event={"ID":"e83bc787-cf0d-45f8-b5bf-acec97385865","Type":"ContainerStarted","Data":"16b1f8edf98611461b18dde7cb6f61ab5b932bd2622063528d5bd0d42d5b3f02"}
Sep 08 15:22:02.488939 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:02.488856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc" event={"ID":"aa63b385-4211-4aba-901c-da72a8de7343","Type":"ContainerStarted","Data":"9a881459c9fac24822fc2325b0420b511b57cdac4983558c5c872d3f1c5bb68f"}
Sep 08 15:22:06.514830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:06.514786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s" event={"ID":"e83bc787-cf0d-45f8-b5bf-acec97385865","Type":"ContainerStarted","Data":"e3bd111948f561a72c3344a0d3218c5ad9faae760a7e5090154b35d80f72d1a7"}
Sep 08 15:22:06.515297 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:06.514876    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:06.533901 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:06.533842    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s" podStartSLOduration=1.940727112 podStartE2EDuration="5.533821544s" totalImagesPullingTime="3.593094432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:06.532395542 +0000 UTC m=+547.191556671" watchObservedRunningTime="2026-09-08 15:22:06.533821544 +0000 UTC m=+547.192982673"
Sep 08 15:22:07.521005 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:07.520963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc" event={"ID":"aa63b385-4211-4aba-901c-da72a8de7343","Type":"ContainerStarted","Data":"b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac"}
Sep 08 15:22:07.542338 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:07.542286    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc" podStartSLOduration=3.105819 podStartE2EDuration="7.542269026s" totalImagesPullingTime="4.436450026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:07.54106018 +0000 UTC m=+548.200221306" watchObservedRunningTime="2026-09-08 15:22:07.542269026 +0000 UTC m=+548.201430153"
Sep 08 15:22:08.526740 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:08.526707    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:09.987764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:09.987725    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-gr8lt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:22:09.988115 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:09.987806    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" podUID="b5052582-58a3-474a-903a-c670e32346f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:22:11.543597 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:11.543544    2578 generic.go:356] "Generic (PLEG): container finished" podID="b5052582-58a3-474a-903a-c670e32346f9" containerID="fd92f9179a3672ef8be9c3e422b47a13d96fb78574476d164eb6c102a4b69393" exitCode=0
Sep 08 15:22:11.544124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:11.543633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" event={"ID":"b5052582-58a3-474a-903a-c670e32346f9","Type":"ContainerDied","Data":"fd92f9179a3672ef8be9c3e422b47a13d96fb78574476d164eb6c102a4b69393"}
Sep 08 15:22:11.544227 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:11.544208    2578 scope.go:117] "RemoveContainer" containerID="fd92f9179a3672ef8be9c3e422b47a13d96fb78574476d164eb6c102a4b69393"
Sep 08 15:22:11.545399 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:11.545368    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:22:11.545570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:11.545454    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:22:11.545570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:11.545504    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:22:12.550678 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:12.550637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" event={"ID":"b5052582-58a3-474a-903a-c670e32346f9","Type":"ContainerStarted","Data":"cd6753cbebf44a6ff3d278180132875c5be8bb1a4d036d2a2ab0d6caaab82f6e"}
Sep 08 15:22:13.544533 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:13.544494    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:22:13.544778 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:13.544753    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-gr8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 15:22:13.544833 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:13.544806    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" podUID="b5052582-58a3-474a-903a-c670e32346f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 15:22:14.536082 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:14.536054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:22:14.544976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:14.544946    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-gr8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 15:22:14.545141 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:14.545013    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" podUID="b5052582-58a3-474a-903a-c670e32346f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 15:22:15.544725 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:15.544687    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-gr8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 15:22:15.545181 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:15.544761    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" podUID="b5052582-58a3-474a-903a-c670e32346f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 15:22:15.557885 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:15.557851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:15.912276 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:15.912162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:16.544108 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:16.544070    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-gr8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 15:22:16.544292 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:16.544134    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" podUID="b5052582-58a3-474a-903a-c670e32346f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 15:22:17.523617 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:17.523565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5w58s"
Sep 08 15:22:17.544263 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:17.544233    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-gr8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 15:22:17.544407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:17.544282    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt" podUID="b5052582-58a3-474a-903a-c670e32346f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 15:22:18.547670 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:18.547634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:22:18.548031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:18.547936    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:22:18.548665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:18.548648    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt"
Sep 08 15:22:24.123030 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.122993    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"]
Sep 08 15:22:24.126118 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.126098    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.130048 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.130023    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8qwbs\""
Sep 08 15:22:24.130159 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.130027    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 08 15:22:24.130159 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.130063    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 15:22:24.130159 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.130036    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 15:22:24.135030 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.135007    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"]
Sep 08 15:22:24.151477 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.151441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:24.247238 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.247205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfltf\" (UniqueName: \"kubernetes.io/projected/3f49d979-5964-4584-90f2-a4784fa0ae51-kube-api-access-pfltf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.247407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.247268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f49d979-5964-4584-90f2-a4784fa0ae51-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.247407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.247333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.247407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.247355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.247407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.247381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.247407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.247398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.348957 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.348923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f49d979-5964-4584-90f2-a4784fa0ae51-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.348999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.349022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.349043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.349062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.349118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfltf\" (UniqueName: \"kubernetes.io/projected/3f49d979-5964-4584-90f2-a4784fa0ae51-kube-api-access-pfltf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349553 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.349531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349654 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.349553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.349654 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.349560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.351316 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.351296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f49d979-5964-4584-90f2-a4784fa0ae51-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.351569 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.351552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f49d979-5964-4584-90f2-a4784fa0ae51-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.357367 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.357344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfltf\" (UniqueName: \"kubernetes.io/projected/3f49d979-5964-4584-90f2-a4784fa0ae51-kube-api-access-pfltf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc\" (UID: \"3f49d979-5964-4584-90f2-a4784fa0ae51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.436755 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.436674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:24.715104 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:24.715079    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"]
Sep 08 15:22:24.716465 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:22:24.716440    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f49d979_5964_4584_90f2_a4784fa0ae51.slice/crio-3ac7a5a0e596a391ba46a06050a1bb93e3912c81372532c529d83cbb994d7428 WatchSource:0}: Error finding container 3ac7a5a0e596a391ba46a06050a1bb93e3912c81372532c529d83cbb994d7428: Status 404 returned error can't find the container with id 3ac7a5a0e596a391ba46a06050a1bb93e3912c81372532c529d83cbb994d7428
Sep 08 15:22:25.624408 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:25.624364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc" event={"ID":"3f49d979-5964-4584-90f2-a4784fa0ae51","Type":"ContainerStarted","Data":"3ac7a5a0e596a391ba46a06050a1bb93e3912c81372532c529d83cbb994d7428"}
Sep 08 15:22:26.631320 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:26.631287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc" event={"ID":"3f49d979-5964-4584-90f2-a4784fa0ae51","Type":"ContainerStarted","Data":"a2c88d4e76de39fc488db4fe4104acc7b82512ed6e465f56bb7746fc442eb475"}
Sep 08 15:22:26.649508 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:26.649456    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc" podStartSLOduration=1.495649641 podStartE2EDuration="2.649440159s" totalImagesPullingTime="1.153790518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:26.647867098 +0000 UTC m=+567.307028225" watchObservedRunningTime="2026-09-08 15:22:26.649440159 +0000 UTC m=+567.308601285"
Sep 08 15:22:28.116548 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.116511    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"]
Sep 08 15:22:28.120496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.120468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.123349 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.123326    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 15:22:28.133267 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.133240    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"]
Sep 08 15:22:28.160149 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.160108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:28.187712 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.187675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpr8\" (UniqueName: \"kubernetes.io/projected/7362e32b-6124-4f6d-ad0b-0672cee261d5-kube-api-access-jhpr8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.187880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.187725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.187880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.187797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.187880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.187838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.188040 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.187881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.188040 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.187913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7362e32b-6124-4f6d-ad0b-0672cee261d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.288438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.288407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpr8\" (UniqueName: \"kubernetes.io/projected/7362e32b-6124-4f6d-ad0b-0672cee261d5-kube-api-access-jhpr8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.288731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.288448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.288731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.288497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.288731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.288520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.288731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.288560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.288731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.288604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7362e32b-6124-4f6d-ad0b-0672cee261d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.289015 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.288923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.289084 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.289013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.289084 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.289060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.291024 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.290997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7362e32b-6124-4f6d-ad0b-0672cee261d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.291239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.291219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7362e32b-6124-4f6d-ad0b-0672cee261d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.297137 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.297114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpr8\" (UniqueName: \"kubernetes.io/projected/7362e32b-6124-4f6d-ad0b-0672cee261d5-kube-api-access-jhpr8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gjlv7\" (UID: \"7362e32b-6124-4f6d-ad0b-0672cee261d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.431682 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.431569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:28.715815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:28.715786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"]
Sep 08 15:22:28.717337 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:22:28.717311    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7362e32b_6124_4f6d_ad0b_0672cee261d5.slice/crio-28712dbcf50a07e5bd645f0d156ea26eaa351669316362afb6db6d9115a3de43 WatchSource:0}: Error finding container 28712dbcf50a07e5bd645f0d156ea26eaa351669316362afb6db6d9115a3de43: Status 404 returned error can't find the container with id 28712dbcf50a07e5bd645f0d156ea26eaa351669316362afb6db6d9115a3de43
Sep 08 15:22:29.648741 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:29.648700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7" event={"ID":"7362e32b-6124-4f6d-ad0b-0672cee261d5","Type":"ContainerStarted","Data":"ef18dfdbabdc5e9e373eb70c22f379c110753362246088028674e5d87d6dfcab"}
Sep 08 15:22:29.649175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:29.648759    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7" event={"ID":"7362e32b-6124-4f6d-ad0b-0672cee261d5","Type":"ContainerStarted","Data":"28712dbcf50a07e5bd645f0d156ea26eaa351669316362afb6db6d9115a3de43"}
Sep 08 15:22:29.671665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:29.671602    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7" podStartSLOduration=1.465478891 podStartE2EDuration="1.671556416s" totalImagesPullingTime="206.077525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:29.667723902 +0000 UTC m=+570.326885030" watchObservedRunningTime="2026-09-08 15:22:29.671556416 +0000 UTC m=+570.330717544"
Sep 08 15:22:34.437463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:34.437421    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:34.437873 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:34.437511    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:34.449948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:34.449923    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:34.685283 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:34.685252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc"
Sep 08 15:22:38.431875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:38.431835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:38.432239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:38.431911    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:38.444823 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:38.444800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:38.705338 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:38.705315    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gjlv7"
Sep 08 15:22:43.788378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:43.788339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:52.804712 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:52.804681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:22:58.570999 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:22:58.570901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:23:09.769209 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:09.769149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:23:09.871019 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:09.870979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:23:14.427609 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.427548    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"]
Sep 08 15:23:14.432544 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.432518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.434938 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.434913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 15:23:14.439337 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.439313    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"]
Sep 08 15:23:14.442023 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.441993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.442132 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.442069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.442132 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.442111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.442248 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.442168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j2kf\" (UniqueName: \"kubernetes.io/projected/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-kube-api-access-9j2kf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.442363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.442342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.442563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.442543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543116 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543116 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j2kf\" (UniqueName: \"kubernetes.io/projected/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-kube-api-access-9j2kf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543712 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.543762 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.543724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.545645 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.545617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.545839 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.545823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.551794 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.551769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j2kf\" (UniqueName: \"kubernetes.io/projected/7c39537f-51e2-4f5b-9fbe-f5a6dc59226c-kube-api-access-9j2kf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mr4m\" (UID: \"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:14.746130 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:14.746094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:15.026823 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:15.026734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"]
Sep 08 15:23:15.032471 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:23:15.032444    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c39537f_51e2_4f5b_9fbe_f5a6dc59226c.slice/crio-1be87219dc0ef48739c6b6cd8bf3ab35a1cdd0dfb9301976d5ec4aac0fe749f4 WatchSource:0}: Error finding container 1be87219dc0ef48739c6b6cd8bf3ab35a1cdd0dfb9301976d5ec4aac0fe749f4: Status 404 returned error can't find the container with id 1be87219dc0ef48739c6b6cd8bf3ab35a1cdd0dfb9301976d5ec4aac0fe749f4
Sep 08 15:23:15.033910 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:15.033887    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:23:15.894265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:15.894226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m" event={"ID":"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c","Type":"ContainerStarted","Data":"4c04246ff0204259ee1b1c79f5d259a6a2a45c15bc95d36edad7cb61d776cfcb"}
Sep 08 15:23:15.894781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:15.894276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m" event={"ID":"7c39537f-51e2-4f5b-9fbe-f5a6dc59226c","Type":"ContainerStarted","Data":"1be87219dc0ef48739c6b6cd8bf3ab35a1cdd0dfb9301976d5ec4aac0fe749f4"}
Sep 08 15:23:15.925387 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:15.925323    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m" podStartSLOduration=1.7246751649999998 podStartE2EDuration="1.925306707s" totalImagesPullingTime="200.631542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:23:15.92509951 +0000 UTC m=+616.584260637" watchObservedRunningTime="2026-09-08 15:23:15.925306707 +0000 UTC m=+616.584467833"
Sep 08 15:23:16.107351 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:16.107312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:23:23.434070 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:23.433982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:23:24.746282 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:24.746244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:24.746788 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:24.746322    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:24.758959 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:24.758931    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:24.955705 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:24.955679    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mr4m"
Sep 08 15:23:35.179075 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:23:35.179032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:23.590551 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:23.590514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:23.687563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:23.687526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:37.172163 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:37.172125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:38.313339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.313306    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd4d79fd8-hccsj"]
Sep 08 15:24:38.313787 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.313496    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-cd4d79fd8-hccsj" podUID="7e55e037-1691-46b0-99f3-bb3551c64fca" containerName="authorino" containerID="cri-o://9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181" gracePeriod=30
Sep 08 15:24:38.562290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.562267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:24:38.695736 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.695655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e55e037-1691-46b0-99f3-bb3551c64fca-tls-cert\") pod \"7e55e037-1691-46b0-99f3-bb3551c64fca\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") "
Sep 08 15:24:38.695736 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.695721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x8zj\" (UniqueName: \"kubernetes.io/projected/7e55e037-1691-46b0-99f3-bb3551c64fca-kube-api-access-9x8zj\") pod \"7e55e037-1691-46b0-99f3-bb3551c64fca\" (UID: \"7e55e037-1691-46b0-99f3-bb3551c64fca\") "
Sep 08 15:24:38.697861 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.697834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e55e037-1691-46b0-99f3-bb3551c64fca-kube-api-access-9x8zj" (OuterVolumeSpecName: "kube-api-access-9x8zj") pod "7e55e037-1691-46b0-99f3-bb3551c64fca" (UID: "7e55e037-1691-46b0-99f3-bb3551c64fca"). InnerVolumeSpecName "kube-api-access-9x8zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:38.706939 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.706909    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e55e037-1691-46b0-99f3-bb3551c64fca-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7e55e037-1691-46b0-99f3-bb3551c64fca" (UID: "7e55e037-1691-46b0-99f3-bb3551c64fca"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:24:38.797454 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.797419    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e55e037-1691-46b0-99f3-bb3551c64fca-tls-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:24:38.797454 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.797452    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x8zj\" (UniqueName: \"kubernetes.io/projected/7e55e037-1691-46b0-99f3-bb3551c64fca-kube-api-access-9x8zj\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:24:38.826866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.826832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:38.929502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:38.929469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:39.326804 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.326768    2578 generic.go:356] "Generic (PLEG): container finished" podID="7e55e037-1691-46b0-99f3-bb3551c64fca" containerID="9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181" exitCode=0
Sep 08 15:24:39.327217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.326816    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd4d79fd8-hccsj"
Sep 08 15:24:39.327217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.326853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd4d79fd8-hccsj" event={"ID":"7e55e037-1691-46b0-99f3-bb3551c64fca","Type":"ContainerDied","Data":"9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181"}
Sep 08 15:24:39.327217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.326896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd4d79fd8-hccsj" event={"ID":"7e55e037-1691-46b0-99f3-bb3551c64fca","Type":"ContainerDied","Data":"695530b705923a6f6b24933038cc600a713af1ff002f97df82f56aba9fef830a"}
Sep 08 15:24:39.327217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.326913    2578 scope.go:117] "RemoveContainer" containerID="9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181"
Sep 08 15:24:39.337846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.337828    2578 scope.go:117] "RemoveContainer" containerID="9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181"
Sep 08 15:24:39.338173 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:24:39.338149    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181\": container with ID starting with 9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181 not found: ID does not exist" containerID="9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181"
Sep 08 15:24:39.338216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.338189    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181"} err="failed to get container status \"9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181\": rpc error: code = NotFound desc = could not find container \"9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181\": container with ID starting with 9051dd88bf3088c9e5c9ea372340c452de1846d24b5eaa00acdefa2f8ec1f181 not found: ID does not exist"
Sep 08 15:24:39.355522 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.355498    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd4d79fd8-hccsj"]
Sep 08 15:24:39.361330 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.361306    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cd4d79fd8-hccsj"]
Sep 08 15:24:39.826847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.826818    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e55e037-1691-46b0-99f3-bb3551c64fca" path="/var/lib/kubelet/pods/7e55e037-1691-46b0-99f3-bb3551c64fca/volumes"
Sep 08 15:24:39.934410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:39.934363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:40.035339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:40.035303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:55.580466 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:55.580387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:55.697759 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:55.697722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:55.899438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:55.899355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:56.000194 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:56.000147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:57.020219 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:57.020188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:57.123148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:57.123116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:57.470411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:57.470373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:59.290488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:59.290451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:24:59.390655 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:24:59.390621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:00.417407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.417370    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"]
Sep 08 15:25:00.418071 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.418049    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e55e037-1691-46b0-99f3-bb3551c64fca" containerName="authorino"
Sep 08 15:25:00.418123 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.418076    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e55e037-1691-46b0-99f3-bb3551c64fca" containerName="authorino"
Sep 08 15:25:00.418210 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.418200    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e55e037-1691-46b0-99f3-bb3551c64fca" containerName="authorino"
Sep 08 15:25:00.423162 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.423142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.425514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.425493    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-60b543-serving-cert\""
Sep 08 15:25:00.430203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.430143    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"]
Sep 08 15:25:00.440266 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.440240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:00.509431 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.509393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.509641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.509441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-metrics-certs\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.509641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.509466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6tv\" (UniqueName: \"kubernetes.io/projected/ce24ec0c-3f49-419b-9a29-09caca1ea869-kube-api-access-dr6tv\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.509641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.509603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce24ec0c-3f49-419b-9a29-09caca1ea869-openshift-service-ca\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.540758 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.540721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:00.610260 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.610220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.610462 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.610291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-metrics-certs\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.610462 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.610321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6tv\" (UniqueName: \"kubernetes.io/projected/ce24ec0c-3f49-419b-9a29-09caca1ea869-kube-api-access-dr6tv\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.610462 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:25:00.610377    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-serving-cert: secret "maas-api-e2e-inf-a-60b543-serving-cert" not found
Sep 08 15:25:00.610462 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.610437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce24ec0c-3f49-419b-9a29-09caca1ea869-openshift-service-ca\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.610462 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:25:00.610463    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls podName:ce24ec0c-3f49-419b-9a29-09caca1ea869 nodeName:}" failed. No retries permitted until 2026-09-08 15:25:01.110441617 +0000 UTC m=+721.769602737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls") pod "maas-api-e2e-inf-a-60b543-84654d6bd-mw586" (UID: "ce24ec0c-3f49-419b-9a29-09caca1ea869") : secret "maas-api-e2e-inf-a-60b543-serving-cert" not found
Sep 08 15:25:00.611272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.611244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce24ec0c-3f49-419b-9a29-09caca1ea869-openshift-service-ca\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.613799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.613777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-metrics-certs\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.622070 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.622044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6tv\" (UniqueName: \"kubernetes.io/projected/ce24ec0c-3f49-419b-9a29-09caca1ea869-kube-api-access-dr6tv\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:00.991446 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:00.991410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:01.087400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:01.087362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:01.115918 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:01.115879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:01.118553 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:01.118529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls\") pod \"maas-api-e2e-inf-a-60b543-84654d6bd-mw586\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:01.337366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:01.337269    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:01.620763 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:01.620733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"]
Sep 08 15:25:01.623223 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:25:01.623195    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce24ec0c_3f49_419b_9a29_09caca1ea869.slice/crio-3f2407c12be9aa96c9e25e068b9073fc1b544391435bb966ca34de6e015c823c WatchSource:0}: Error finding container 3f2407c12be9aa96c9e25e068b9073fc1b544391435bb966ca34de6e015c823c: Status 404 returned error can't find the container with id 3f2407c12be9aa96c9e25e068b9073fc1b544391435bb966ca34de6e015c823c
Sep 08 15:25:02.451676 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:02.451643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586" event={"ID":"ce24ec0c-3f49-419b-9a29-09caca1ea869","Type":"ContainerStarted","Data":"0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8"}
Sep 08 15:25:02.451853 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:02.451700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586" event={"ID":"ce24ec0c-3f49-419b-9a29-09caca1ea869","Type":"ContainerStarted","Data":"3f2407c12be9aa96c9e25e068b9073fc1b544391435bb966ca34de6e015c823c"}
Sep 08 15:25:02.451853 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:02.451760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:02.470400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:02.470348    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586" podStartSLOduration=2.036479517 podStartE2EDuration="2.470331876s" totalImagesPullingTime="433.852359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:02.468678534 +0000 UTC m=+723.127839662" watchObservedRunningTime="2026-09-08 15:25:02.470331876 +0000 UTC m=+723.129493003"
Sep 08 15:25:03.685798 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:03.685763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:03.957687 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:03.957653    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"]
Sep 08 15:25:03.962049 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:03.962022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:03.964416 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:03.964389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eed32982-openshift-default-dockercfg-vtz8z\""
Sep 08 15:25:03.972878 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:03.972854    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"]
Sep 08 15:25:04.046530 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-credential-socket\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-podinfo\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-socket\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-token\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hl65\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-kube-api-access-7hl65\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046893 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-certs\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046893 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-envoy\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046893 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e609265-6f03-4bcf-a5c9-91b474216d8f-istiod-ca-cert\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.046893 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.046852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-data\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.154639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-data\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.154639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-credential-socket\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.154639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-podinfo\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.154639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-socket\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.154966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-token\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.154966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hl65\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-kube-api-access-7hl65\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.154966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-certs\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.155122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-data\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.155122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.154964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-envoy\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.155122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.155018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-credential-socket\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.155122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.155055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e609265-6f03-4bcf-a5c9-91b474216d8f-istiod-ca-cert\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.155122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.155058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-socket\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.155990 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.155967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-certs\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.156361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.156339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e609265-6f03-4bcf-a5c9-91b474216d8f-istiod-ca-cert\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.157226 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.157204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-podinfo\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.157412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.157394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-envoy\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.164124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.164100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hl65\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-kube-api-access-7hl65\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.164643 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.164622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-token\") pod \"e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") " pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.275946 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.275872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:04.357998 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.357965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:04.557563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.557463    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"]
Sep 08 15:25:04.560525 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:25:04.560489    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e609265_6f03_4bcf_a5c9_91b474216d8f.slice/crio-3b16761fb94f8657528c9b466cb7571a0cd14b1c8a303da58b2b087258b7cb16 WatchSource:0}: Error finding container 3b16761fb94f8657528c9b466cb7571a0cd14b1c8a303da58b2b087258b7cb16: Status 404 returned error can't find the container with id 3b16761fb94f8657528c9b466cb7571a0cd14b1c8a303da58b2b087258b7cb16
Sep 08 15:25:04.562924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.562891    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:04.563043 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.562958    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:04.563043 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.562993    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:04.648961 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:04.648925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:05.469155 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:05.469116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" event={"ID":"6e609265-6f03-4bcf-a5c9-91b474216d8f","Type":"ContainerStarted","Data":"5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5"}
Sep 08 15:25:05.469576 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:05.469178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" event={"ID":"6e609265-6f03-4bcf-a5c9-91b474216d8f","Type":"ContainerStarted","Data":"3b16761fb94f8657528c9b466cb7571a0cd14b1c8a303da58b2b087258b7cb16"}
Sep 08 15:25:05.495537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:05.495486    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podStartSLOduration=2.495469541 podStartE2EDuration="2.495469541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:05.493224769 +0000 UTC m=+726.152385905" watchObservedRunningTime="2026-09-08 15:25:05.495469541 +0000 UTC m=+726.154630668"
Sep 08 15:25:06.277121 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:06.277088    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:06.283943 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:06.283915    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:06.475023 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:06.474993    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:06.475994 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:06.475977    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:06.879241 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:06.879203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:06.981324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:06.981289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:08.028504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.028465    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"]
Sep 08 15:25:08.033151 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.033126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.035391 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.035367    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-eed32982-serving-cert\""
Sep 08 15:25:08.042744 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.042717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"]
Sep 08 15:25:08.065707 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.065681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:08.095792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.095758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-metrics-certs\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.095964 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.095800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5qw\" (UniqueName: \"kubernetes.io/projected/15164355-6b45-4cfa-87a6-0d12a38a6cd6-kube-api-access-lp5qw\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.095964 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.095906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.096092 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.095971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15164355-6b45-4cfa-87a6-0d12a38a6cd6-openshift-service-ca\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.197203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.197168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.197376 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.197217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15164355-6b45-4cfa-87a6-0d12a38a6cd6-openshift-service-ca\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.197376 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.197289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-metrics-certs\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.197376 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:25:08.197316    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-serving-cert: secret "maas-api-e2e-ait-eed32982-serving-cert" not found
Sep 08 15:25:08.197376 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:25:08.197375    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls podName:15164355-6b45-4cfa-87a6-0d12a38a6cd6 nodeName:}" failed. No retries permitted until 2026-09-08 15:25:08.6973586 +0000 UTC m=+729.356519710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls") pod "maas-api-e2e-ait-eed32982-67578d974f-pgh45" (UID: "15164355-6b45-4cfa-87a6-0d12a38a6cd6") : secret "maas-api-e2e-ait-eed32982-serving-cert" not found
Sep 08 15:25:08.197610 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.197312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5qw\" (UniqueName: \"kubernetes.io/projected/15164355-6b45-4cfa-87a6-0d12a38a6cd6-kube-api-access-lp5qw\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.197909 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.197891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15164355-6b45-4cfa-87a6-0d12a38a6cd6-openshift-service-ca\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.199772 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.199750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-metrics-certs\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.205150 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.205127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5qw\" (UniqueName: \"kubernetes.io/projected/15164355-6b45-4cfa-87a6-0d12a38a6cd6-kube-api-access-lp5qw\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.384404 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.384318    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"]
Sep 08 15:25:08.388224 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.388199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.390844 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.390823    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-98d03a-openshift-default-dockercfg-ddffg\""
Sep 08 15:25:08.401439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.401414    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"]
Sep 08 15:25:08.462674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.462642    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:25:08.501423 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-data\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.501658 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jjqp\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-kube-api-access-6jjqp\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.501658 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-token\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.501658 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-socket\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.501833 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-podinfo\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.501833 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-credential-socket\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.501940 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istiod-ca-cert\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.501996 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.501975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-certs\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.502052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.502004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-envoy\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.602874 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.602838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istiod-ca-cert\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603046 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.602962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-certs\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603046 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.602997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-envoy\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-data\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jjqp\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-kube-api-access-6jjqp\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-token\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-socket\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-podinfo\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-credential-socket\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603503 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-certs\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-data\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603734 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-credential-socket\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istiod-ca-cert\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.603891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.603853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-socket\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.605879 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.605854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-envoy\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.606011 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.605994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-podinfo\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.611734 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.611713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-token\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.619529 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.619499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jjqp\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-kube-api-access-6jjqp\") pod \"e2e-autores-98d03a-openshift-default-799cd777cb-xbggv\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") " pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.701454 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.701420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:08.705038 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.705011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.707855 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.707829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls\") pod \"maas-api-e2e-ait-eed32982-67578d974f-pgh45\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.949747 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.949706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:08.978115 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.978074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"]
Sep 08 15:25:08.980636 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:25:08.980593    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff52f48d_24ac_46af_a855_f83f7d9eaf85.slice/crio-76f0d64453d8c8cd39c4492550856e6fd2be3e5b4bd7149b1db606a8b91a865b WatchSource:0}: Error finding container 76f0d64453d8c8cd39c4492550856e6fd2be3e5b4bd7149b1db606a8b91a865b: Status 404 returned error can't find the container with id 76f0d64453d8c8cd39c4492550856e6fd2be3e5b4bd7149b1db606a8b91a865b
Sep 08 15:25:08.983713 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.983677    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:08.983843 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.983754    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:08.983843 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:08.983783    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:09.211427 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.211338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:09.237155 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.237122    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"]
Sep 08 15:25:09.238123 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:25:09.238095    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15164355_6b45_4cfa_87a6_0d12a38a6cd6.slice/crio-0b50f3ff39618c35c05c332dc35020407447c8a09a1e206478f1466b57edbe3b WatchSource:0}: Error finding container 0b50f3ff39618c35c05c332dc35020407447c8a09a1e206478f1466b57edbe3b: Status 404 returned error can't find the container with id 0b50f3ff39618c35c05c332dc35020407447c8a09a1e206478f1466b57edbe3b
Sep 08 15:25:09.312230 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.312200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:09.495473 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.495367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" event={"ID":"ff52f48d-24ac-46af-a855-f83f7d9eaf85","Type":"ContainerStarted","Data":"86051384a2c14e10acb984c9a88d2429e0c230d7eecc2e07357c5ff815b7e6d9"}
Sep 08 15:25:09.495473 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.495464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" event={"ID":"ff52f48d-24ac-46af-a855-f83f7d9eaf85","Type":"ContainerStarted","Data":"76f0d64453d8c8cd39c4492550856e6fd2be3e5b4bd7149b1db606a8b91a865b"}
Sep 08 15:25:09.496791 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.496767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45" event={"ID":"15164355-6b45-4cfa-87a6-0d12a38a6cd6","Type":"ContainerStarted","Data":"0b50f3ff39618c35c05c332dc35020407447c8a09a1e206478f1466b57edbe3b"}
Sep 08 15:25:09.514884 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.514831    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podStartSLOduration=1.514815895 podStartE2EDuration="1.514815895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:09.513241008 +0000 UTC m=+730.172402135" watchObservedRunningTime="2026-09-08 15:25:09.514815895 +0000 UTC m=+730.173977015"
Sep 08 15:25:09.702173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:09.702140    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:10.708352 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:10.708322    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:11.395734 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:11.395694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:11.483318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:11.483291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:11.511336 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:11.511299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45" event={"ID":"15164355-6b45-4cfa-87a6-0d12a38a6cd6","Type":"ContainerStarted","Data":"4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3"}
Sep 08 15:25:11.511630 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:11.511607    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:11.511732 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:11.511655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:11.512535 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:11.512515    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:11.531349 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:11.531304    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45" podStartSLOduration=1.607989827 podStartE2EDuration="3.531291589s" totalImagesPullingTime="1.923301762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:11.528402059 +0000 UTC m=+732.187563214" watchObservedRunningTime="2026-09-08 15:25:11.531291589 +0000 UTC m=+732.190452715"
Sep 08 15:25:12.573982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:12.573947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:12.691437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:12.691407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:13.048217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:13.048184    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:13.150318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:13.150282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:13.477094 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:13.477066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:14.343280 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:14.343241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:14.488175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:14.488138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:14.606556 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:14.606476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:14.704151 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:14.704111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:17.345878 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:17.345834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:17.522526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:17.522493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:18.442359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:18.442321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:18.550289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:18.550253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:18.652388 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:18.652355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:18.997556 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:18.997523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:21.484345 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:21.484297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:22.518730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:22.518689    2578 patch_prober.go:28] interesting pod/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:25:22.519215 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:22.518747    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:25:24.029712 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.029673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:24.332275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.332236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:24.585440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.585350    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerID="5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5" exitCode=0
Sep 08 15:25:24.585440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.585428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" event={"ID":"6e609265-6f03-4bcf-a5c9-91b474216d8f","Type":"ContainerDied","Data":"5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5"}
Sep 08 15:25:24.585941 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.585924    2578 scope.go:117] "RemoveContainer" containerID="5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5"
Sep 08 15:25:24.587104 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.587074    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:24.587236 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.587164    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:24.587236 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.587197    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:24.673660 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.673591    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"]
Sep 08 15:25:24.677026 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.677002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.679211 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.679193    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b75273-openshift-default-dockercfg-w9nlp\""
Sep 08 15:25:24.689012 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.688960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"]
Sep 08 15:25:24.789970 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.789920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fdefae-5056-4db9-894d-613e6a92abc6-istiod-ca-cert\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790182 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-certs\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790182 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-socket\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790182 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-istio-token\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkmv5\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-kube-api-access-hkmv5\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-envoy\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790460 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fdefae-5056-4db9-894d-613e6a92abc6-istio-podinfo\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-credential-socket\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.790571 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.790528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-data\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.843173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.843085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:24.891977 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.891934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-istio-token\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkmv5\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-kube-api-access-hkmv5\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-envoy\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fdefae-5056-4db9-894d-613e6a92abc6-istio-podinfo\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-credential-socket\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-data\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892447 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fdefae-5056-4db9-894d-613e6a92abc6-istiod-ca-cert\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892447 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-certs\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892447 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-socket\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.892772 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.892747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-socket\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.893752 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.893715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-data\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.894499 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.894475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-credential-socket\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.894805 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.894784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-certs\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.895196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.895086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fdefae-5056-4db9-894d-613e6a92abc6-istiod-ca-cert\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.903600 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.899801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fdefae-5056-4db9-894d-613e6a92abc6-istio-podinfo\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.903600 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.901123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-envoy\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.906479 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.904029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-istio-token\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.906479 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.905278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkmv5\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-kube-api-access-hkmv5\") pod \"e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") " pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:24.990490 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:24.990173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:25.002140 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.002108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:25.111737 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.111511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:25.203613 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.200865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:25.326665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.326637    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"]
Sep 08 15:25:25.329828 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:25:25.329793    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fdefae_5056_4db9_894d_613e6a92abc6.slice/crio-baea9e80f3420f3714b64d91050bbd993d37a1d694871665adcebeaddecf7b9e WatchSource:0}: Error finding container baea9e80f3420f3714b64d91050bbd993d37a1d694871665adcebeaddecf7b9e: Status 404 returned error can't find the container with id baea9e80f3420f3714b64d91050bbd993d37a1d694871665adcebeaddecf7b9e
Sep 08 15:25:25.332501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.332461    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:25.332688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.332551    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:25.332688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.332616    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:25.372602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.368943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:25.599924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.599865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" event={"ID":"6e609265-6f03-4bcf-a5c9-91b474216d8f","Type":"ContainerStarted","Data":"4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45"}
Sep 08 15:25:25.602795 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.602766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" event={"ID":"42fdefae-5056-4db9-894d-613e6a92abc6","Type":"ContainerStarted","Data":"efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0"}
Sep 08 15:25:25.602942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.602815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" event={"ID":"42fdefae-5056-4db9-894d-613e6a92abc6","Type":"ContainerStarted","Data":"baea9e80f3420f3714b64d91050bbd993d37a1d694871665adcebeaddecf7b9e"}
Sep 08 15:25:25.641035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.640935    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podStartSLOduration=1.640918637 podStartE2EDuration="1.640918637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:25.639657998 +0000 UTC m=+746.298819124" watchObservedRunningTime="2026-09-08 15:25:25.640918637 +0000 UTC m=+746.300079763"
Sep 08 15:25:25.990995 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:25.990940    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:26.277090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:26.277002    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:26.277651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:26.277420    2578 patch_prober.go:28] interesting pod/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 15:25:26.277811 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:26.277787    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 15:25:27.008854 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:27.008809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:27.276718 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:27.276617    2578 patch_prober.go:28] interesting pod/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 15:25:27.276718 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:27.276695    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 15:25:27.604739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:27.604627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:27.619021 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:27.618999    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:27.620315 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:27.620295    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:27.717999 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:27.706478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:28.276965 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:28.276505    2578 patch_prober.go:28] interesting pod/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 15:25:28.276965 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:28.276567    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 15:25:28.924981 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:28.924331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:29.015371 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:29.015334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:29.124111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:29.124061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:29.276672 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:29.276635    2578 patch_prober.go:28] interesting pod/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 15:25:29.276987 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:29.276946    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 15:25:29.804376 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:29.804338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:29.895098 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:29.895060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:30.277192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:30.277155    2578 patch_prober.go:28] interesting pod/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 15:25:30.277866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:30.277834    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 15:25:30.881627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:30.881568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:31.276325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:31.276283    2578 patch_prober.go:28] interesting pod/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 15:25:31.276628 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:31.276592    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 15:25:31.926960 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:31.926920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:32.000321 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:32.000232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:32.337826 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:32.337795    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:32.338119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:32.338081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:32.338880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:32.338856    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:34.658335 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:34.658303    2578 generic.go:356] "Generic (PLEG): container finished" podID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerID="86051384a2c14e10acb984c9a88d2429e0c230d7eecc2e07357c5ff815b7e6d9" exitCode=0
Sep 08 15:25:34.658792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:34.658349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" event={"ID":"ff52f48d-24ac-46af-a855-f83f7d9eaf85","Type":"ContainerDied","Data":"86051384a2c14e10acb984c9a88d2429e0c230d7eecc2e07357c5ff815b7e6d9"}
Sep 08 15:25:34.658842 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:34.658829    2578 scope.go:117] "RemoveContainer" containerID="86051384a2c14e10acb984c9a88d2429e0c230d7eecc2e07357c5ff815b7e6d9"
Sep 08 15:25:34.660197 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:34.660160    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:34.660283 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:34.660254    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:34.660322 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:34.660302    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:34.708890 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:34.708862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:35.673758 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:35.673714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" event={"ID":"ff52f48d-24ac-46af-a855-f83f7d9eaf85","Type":"ContainerStarted","Data":"f330aaf71a2bf46a05f028f9d13526a7ccd8b15925490a46961d5f0d4ae8ac98"}
Sep 08 15:25:35.702379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:35.702343    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:35.702616 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:35.702571    2578 patch_prober.go:28] interesting pod/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 15:25:35.702677 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:35.702653    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 15:25:36.309657 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:36.309625    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:36.702806 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:36.702780    2578 patch_prober.go:28] interesting pod/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 15:25:36.703191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:36.702828    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 15:25:37.702270 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:37.702232    2578 patch_prober.go:28] interesting pod/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 15:25:37.702455 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:37.702288    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 15:25:38.702934 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:38.702893    2578 patch_prober.go:28] interesting pod/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 15:25:38.703473 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:38.702964    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 15:25:39.125275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:39.125157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:39.702286 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:39.702254    2578 patch_prober.go:28] interesting pod/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 15:25:39.702465 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:39.702305    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 15:25:40.702048 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:40.702009    2578 patch_prober.go:28] interesting pod/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 15:25:40.702468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:40.702072    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 15:25:41.512237 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:41.512199    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:41.706191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:41.706157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:41.716735 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:41.716714    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:25:48.456477 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:48.456444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:48.756618 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:48.756563    2578 generic.go:356] "Generic (PLEG): container finished" podID="42fdefae-5056-4db9-894d-613e6a92abc6" containerID="efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0" exitCode=0
Sep 08 15:25:48.756830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:48.756643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" event={"ID":"42fdefae-5056-4db9-894d-613e6a92abc6","Type":"ContainerDied","Data":"efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0"}
Sep 08 15:25:48.757175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:48.757160    2578 scope.go:117] "RemoveContainer" containerID="efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0"
Sep 08 15:25:48.758350 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:48.758316    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:48.758456 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:48.758410    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:48.758519 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:48.758460    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:49.114097 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.114004    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"]
Sep 08 15:25:49.114339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.114304    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45" podUID="15164355-6b45-4cfa-87a6-0d12a38a6cd6" containerName="maas-api" containerID="cri-o://4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3" gracePeriod=30
Sep 08 15:25:49.143130 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.143092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:49.212889 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.212859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:49.314167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.314138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:49.371930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.371865    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:49.396480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.396446    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp5qw\" (UniqueName: \"kubernetes.io/projected/15164355-6b45-4cfa-87a6-0d12a38a6cd6-kube-api-access-lp5qw\") pod \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") "
Sep 08 15:25:49.396704 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.396495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15164355-6b45-4cfa-87a6-0d12a38a6cd6-openshift-service-ca\") pod \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") "
Sep 08 15:25:49.396704 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.396621    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls\") pod \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") "
Sep 08 15:25:49.396704 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.396673    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-metrics-certs\") pod \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\" (UID: \"15164355-6b45-4cfa-87a6-0d12a38a6cd6\") "
Sep 08 15:25:49.397085 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.397043    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15164355-6b45-4cfa-87a6-0d12a38a6cd6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15164355-6b45-4cfa-87a6-0d12a38a6cd6" (UID: "15164355-6b45-4cfa-87a6-0d12a38a6cd6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:25:49.398415 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.398320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:49.399627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.399515    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "15164355-6b45-4cfa-87a6-0d12a38a6cd6" (UID: "15164355-6b45-4cfa-87a6-0d12a38a6cd6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:25:49.399744 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.399660    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15164355-6b45-4cfa-87a6-0d12a38a6cd6-kube-api-access-lp5qw" (OuterVolumeSpecName: "kube-api-access-lp5qw") pod "15164355-6b45-4cfa-87a6-0d12a38a6cd6" (UID: "15164355-6b45-4cfa-87a6-0d12a38a6cd6"). InnerVolumeSpecName "kube-api-access-lp5qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:25:49.400905 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.400263    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15164355-6b45-4cfa-87a6-0d12a38a6cd6" (UID: "15164355-6b45-4cfa-87a6-0d12a38a6cd6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:25:49.472327 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.472289    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"]
Sep 08 15:25:49.472909 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.472591    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy" containerID="cri-o://4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45" gracePeriod=30
Sep 08 15:25:49.495233 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.495201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:49.497526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.497507    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp5qw\" (UniqueName: \"kubernetes.io/projected/15164355-6b45-4cfa-87a6-0d12a38a6cd6-kube-api-access-lp5qw\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:49.497608 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.497527    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15164355-6b45-4cfa-87a6-0d12a38a6cd6-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:49.497608 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.497537    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:49.497608 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.497545    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15164355-6b45-4cfa-87a6-0d12a38a6cd6-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:49.779605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.773831    2578 generic.go:356] "Generic (PLEG): container finished" podID="15164355-6b45-4cfa-87a6-0d12a38a6cd6" containerID="4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3" exitCode=0
Sep 08 15:25:49.779605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.773953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45" event={"ID":"15164355-6b45-4cfa-87a6-0d12a38a6cd6","Type":"ContainerDied","Data":"4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3"}
Sep 08 15:25:49.779605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.774006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45" event={"ID":"15164355-6b45-4cfa-87a6-0d12a38a6cd6","Type":"ContainerDied","Data":"0b50f3ff39618c35c05c332dc35020407447c8a09a1e206478f1466b57edbe3b"}
Sep 08 15:25:49.779605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.774041    2578 scope.go:117] "RemoveContainer" containerID="4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3"
Sep 08 15:25:49.779605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.774202    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"
Sep 08 15:25:49.788765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.788732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" event={"ID":"42fdefae-5056-4db9-894d-613e6a92abc6","Type":"ContainerStarted","Data":"3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a"}
Sep 08 15:25:49.796725 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.796713    2578 scope.go:117] "RemoveContainer" containerID="4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3"
Sep 08 15:25:49.796998 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:25:49.796978    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3\": container with ID starting with 4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3 not found: ID does not exist" containerID="4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3"
Sep 08 15:25:49.797098 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.797005    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3"} err="failed to get container status \"4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3\": rpc error: code = NotFound desc = could not find container \"4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3\": container with ID starting with 4814971704f791876e0e1d6c0d5a299d84c3ad3c507b752bd86e2ca367be74e3 not found: ID does not exist"
Sep 08 15:25:49.835205 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.835175    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"]
Sep 08 15:25:49.835205 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.835209    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eed32982-67578d974f-pgh45"]
Sep 08 15:25:49.990975 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.990945    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:49.991209 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.991183    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 08 15:25:49.991312 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:49.991241    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 08 15:25:50.426247 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.426214    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"]
Sep 08 15:25:50.426697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.426683    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15164355-6b45-4cfa-87a6-0d12a38a6cd6" containerName="maas-api"
Sep 08 15:25:50.426764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.426698    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="15164355-6b45-4cfa-87a6-0d12a38a6cd6" containerName="maas-api"
Sep 08 15:25:50.426810 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.426766    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="15164355-6b45-4cfa-87a6-0d12a38a6cd6" containerName="maas-api"
Sep 08 15:25:50.429692 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.429677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.432042 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.432017    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c69c6364-gw-openshift-default-dockercfg-8rg99\""
Sep 08 15:25:50.441271 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.441249    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"]
Sep 08 15:25:50.509451 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4bde39-048c-4d2d-9968-707c9fa65ec4-istiod-ca-cert\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-certs\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-data\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrznv\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-kube-api-access-hrznv\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-podinfo\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-credential-socket\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-envoy\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-token\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.509945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.509943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-socket\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-token\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611509 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-socket\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611509 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4bde39-048c-4d2d-9968-707c9fa65ec4-istiod-ca-cert\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611509 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-certs\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611509 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-data\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611776 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrznv\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-kube-api-access-hrznv\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611776 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-podinfo\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611776 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-credential-socket\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.611948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.611799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-envoy\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.612178 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.612081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-certs\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.612351 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.612325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-socket\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.612753 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.612702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-credential-socket\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.612870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.612832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4bde39-048c-4d2d-9968-707c9fa65ec4-istiod-ca-cert\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.612934 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.612865    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-data\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.614621 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.614573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-envoy\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.615226 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.615200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-podinfo\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.619197 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.619177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-token\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.620481 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.620461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrznv\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-kube-api-access-hrznv\") pod \"e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") " pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.640592 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.640555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:50.741098 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.741063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:50.743098 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.743067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:50.991553 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.991463    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 08 15:25:50.991553 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:50.991540    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 08 15:25:51.056913 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.056883    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"]
Sep 08 15:25:51.058182 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:25:51.058146    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4bde39_048c_4d2d_9968_707c9fa65ec4.slice/crio-b62a2bd9aeb2f25aa3dd4869bef8e05b83e977794b0cbae285923ecc26b41bbf WatchSource:0}: Error finding container b62a2bd9aeb2f25aa3dd4869bef8e05b83e977794b0cbae285923ecc26b41bbf: Status 404 returned error can't find the container with id b62a2bd9aeb2f25aa3dd4869bef8e05b83e977794b0cbae285923ecc26b41bbf
Sep 08 15:25:51.061177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.061133    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:51.061270 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.061247    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:51.061342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.061289    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:25:51.808256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.808220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" event={"ID":"be4bde39-048c-4d2d-9968-707c9fa65ec4","Type":"ContainerStarted","Data":"fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae"}
Sep 08 15:25:51.808713 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.808274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" event={"ID":"be4bde39-048c-4d2d-9968-707c9fa65ec4","Type":"ContainerStarted","Data":"b62a2bd9aeb2f25aa3dd4869bef8e05b83e977794b0cbae285923ecc26b41bbf"}
Sep 08 15:25:51.828807 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.828774    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15164355-6b45-4cfa-87a6-0d12a38a6cd6" path="/var/lib/kubelet/pods/15164355-6b45-4cfa-87a6-0d12a38a6cd6/volumes"
Sep 08 15:25:51.829282 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.829243    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" podStartSLOduration=1.829229662 podStartE2EDuration="1.829229662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:51.827839774 +0000 UTC m=+772.487000939" watchObservedRunningTime="2026-09-08 15:25:51.829229662 +0000 UTC m=+772.488390790"
Sep 08 15:25:51.992009 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.991974    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 08 15:25:51.992191 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:51.992032    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 08 15:25:52.403187 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:52.403152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:52.741389 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:52.741357    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:52.746535 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:52.746512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:52.814638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:52.814609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:52.815706 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:52.815688    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:25:52.992102 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:52.992011    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 08 15:25:52.992102 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:52.992070    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 08 15:25:53.465540 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:53.465506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:53.581527 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:53.581490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:53.679101 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:53.679068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:53.991471 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:53.991433    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 08 15:25:53.991916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:53.991504    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 08 15:25:54.788968 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.788939    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:54.827989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.827948    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerID="4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45" exitCode=0
Sep 08 15:25:54.828185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.828008    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"
Sep 08 15:25:54.828185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.828030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" event={"ID":"6e609265-6f03-4bcf-a5c9-91b474216d8f","Type":"ContainerDied","Data":"4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45"}
Sep 08 15:25:54.828185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.828090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz" event={"ID":"6e609265-6f03-4bcf-a5c9-91b474216d8f","Type":"ContainerDied","Data":"3b16761fb94f8657528c9b466cb7571a0cd14b1c8a303da58b2b087258b7cb16"}
Sep 08 15:25:54.828185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.828128    2578 scope.go:117] "RemoveContainer" containerID="4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45"
Sep 08 15:25:54.839352 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.839330    2578 scope.go:117] "RemoveContainer" containerID="5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5"
Sep 08 15:25:54.848009 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.847984    2578 scope.go:117] "RemoveContainer" containerID="4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45"
Sep 08 15:25:54.848281 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:25:54.848264    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45\": container with ID starting with 4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45 not found: ID does not exist" containerID="4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45"
Sep 08 15:25:54.848343 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.848289    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45"} err="failed to get container status \"4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45\": rpc error: code = NotFound desc = could not find container \"4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45\": container with ID starting with 4f8761a89bc78bc1e576152b9bb0c519b59fa84f77a816e0ed4400313a5f7e45 not found: ID does not exist"
Sep 08 15:25:54.848343 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.848305    2578 scope.go:117] "RemoveContainer" containerID="5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5"
Sep 08 15:25:54.848558 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:25:54.848539    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5\": container with ID starting with 5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5 not found: ID does not exist" containerID="5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5"
Sep 08 15:25:54.848637 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.848565    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5"} err="failed to get container status \"5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5\": rpc error: code = NotFound desc = could not find container \"5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5\": container with ID starting with 5d58e851c74bd61304a74ea83453ce7ae7b9495f665b751fb0efa8e504535ab5 not found: ID does not exist"
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.878944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-podinfo\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hl65\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-kube-api-access-7hl65\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879038    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-certs\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-data\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-credential-socket\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879232    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-token\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879262    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-socket\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879367    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e609265-6f03-4bcf-a5c9-91b474216d8f-istiod-ca-cert\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.879409    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-envoy\") pod \"6e609265-6f03-4bcf-a5c9-91b474216d8f\" (UID: \"6e609265-6f03-4bcf-a5c9-91b474216d8f\") "
Sep 08 15:25:54.881111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.880840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:25:54.885748 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.882388    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e609265-6f03-4bcf-a5c9-91b474216d8f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:25:54.885748 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.883130    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:25:54.885748 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.883276    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:25:54.885748 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.884201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:25:54.888922 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.888890    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:25:54.888922 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.888902    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:25:54.888922 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.888915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-kube-api-access-7hl65" (OuterVolumeSpecName: "kube-api-access-7hl65") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "kube-api-access-7hl65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:25:54.890439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.890410    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e609265-6f03-4bcf-a5c9-91b474216d8f" (UID: "6e609265-6f03-4bcf-a5c9-91b474216d8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981498    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981538    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981553    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981565    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e609265-6f03-4bcf-a5c9-91b474216d8f-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981598    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981611    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981623    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hl65\" (UniqueName: \"kubernetes.io/projected/6e609265-6f03-4bcf-a5c9-91b474216d8f-kube-api-access-7hl65\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981636    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.981674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.981649    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e609265-6f03-4bcf-a5c9-91b474216d8f-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:25:54.991873 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.991836    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 08 15:25:54.992249 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:54.991895    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 08 15:25:55.064496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.064397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:55.118079 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.118042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:25:55.152138 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.152102    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"]
Sep 08 15:25:55.155520 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.155495    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz"]
Sep 08 15:25:55.827332 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.827300    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" path="/var/lib/kubelet/pods/6e609265-6f03-4bcf-a5c9-91b474216d8f/volumes"
Sep 08 15:25:55.995391 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.995364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:55.995876 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.995778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:25:55.996405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:25:55.996379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:26:10.131856 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:10.131824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:14.945635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:14.945603    2578 generic.go:356] "Generic (PLEG): container finished" podID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerID="fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae" exitCode=0
Sep 08 15:26:14.946084 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:14.945671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" event={"ID":"be4bde39-048c-4d2d-9968-707c9fa65ec4","Type":"ContainerDied","Data":"fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae"}
Sep 08 15:26:14.946240 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:14.946224    2578 scope.go:117] "RemoveContainer" containerID="fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae"
Sep 08 15:26:14.947497 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:14.947470    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:14.947602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:14.947541    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:14.947602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:14.947572    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:15.954487 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:15.954453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" event={"ID":"be4bde39-048c-4d2d-9968-707c9fa65ec4","Type":"ContainerStarted","Data":"22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7"}
Sep 08 15:26:16.741300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:16.741263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:26:16.741510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:16.741487    2578 patch_prober.go:28] interesting pod/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 15:26:16.741558 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:16.741536    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 15:26:17.741476 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:17.741433    2578 patch_prober.go:28] interesting pod/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 15:26:17.741989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:17.741511    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 15:26:18.741442 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:18.741402    2578 patch_prober.go:28] interesting pod/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 15:26:18.741665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:18.741460    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 15:26:19.741849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:19.741808    2578 patch_prober.go:28] interesting pod/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 15:26:19.742233 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:19.741887    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 15:26:20.742181 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:20.742143    2578 patch_prober.go:28] interesting pod/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 15:26:20.742615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:20.742244    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 15:26:21.745480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:21.745443    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:26:21.745874 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:21.745787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:26:21.746443 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:21.746421    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:26:24.791447 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:24.791411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:24.932468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:24.932430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:25.001314 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.001277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:25.096528 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.096425    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"]
Sep 08 15:26:25.096866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.096836    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy" containerID="cri-o://22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7" gracePeriod=30
Sep 08 15:26:25.120410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.120379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:25.509563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.509531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:25.801822 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.801727    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"]
Sep 08 15:26:25.802416 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.802394    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy"
Sep 08 15:26:25.802510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.802418    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy"
Sep 08 15:26:25.802510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.802433    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy"
Sep 08 15:26:25.802510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.802441    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy"
Sep 08 15:26:25.802688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.802554    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy"
Sep 08 15:26:25.805145 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.805123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.809195 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.809175    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ecef8168-openshift-default-dockercfg-n4r77\""
Sep 08 15:26:25.830156 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.830125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"]
Sep 08 15:26:25.878009 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.877970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:25.936119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nghmf\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-kube-api-access-nghmf\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-token\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936341 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-credential-socket\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936341 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-envoy\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936420 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8371570-0422-4bf1-a50f-a767bd333ad5-istiod-ca-cert\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936420 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-certs\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936497 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-socket\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936497 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-podinfo\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:25.936497 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:25.936492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-data\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037456 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nghmf\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-kube-api-access-nghmf\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037663 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-token\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037663 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-credential-socket\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037663 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-envoy\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037663 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8371570-0422-4bf1-a50f-a767bd333ad5-istiod-ca-cert\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037877 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-certs\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037877 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-socket\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.037877 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-podinfo\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.038036 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.037903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-data\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.038036 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.038009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-credential-socket\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.038149 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.038121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-certs\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.038207 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.038159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-socket\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.038341 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.038315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-data\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.038480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.038372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8371570-0422-4bf1-a50f-a767bd333ad5-istiod-ca-cert\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.040018 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.039985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-envoy\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.040240 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.040217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-podinfo\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.046983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.046961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-token\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.047086 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.047022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nghmf\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-kube-api-access-nghmf\") pod \"e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") " pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.116620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.116512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:26.131799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.131769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:26.392229 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.392205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"]
Sep 08 15:26:26.393504 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:26:26.393476    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8371570_0422_4bf1_a50f_a767bd333ad5.slice/crio-97c9f54bd8176e5a02c137a088e91a00e1afa0e077053fd1c86157d5837bb1c1 WatchSource:0}: Error finding container 97c9f54bd8176e5a02c137a088e91a00e1afa0e077053fd1c86157d5837bb1c1: Status 404 returned error can't find the container with id 97c9f54bd8176e5a02c137a088e91a00e1afa0e077053fd1c86157d5837bb1c1
Sep 08 15:26:26.395912 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.395880    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:26.396007 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.395941    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:26.396007 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:26.395970    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:27.028709 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:27.028674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" event={"ID":"c8371570-0422-4bf1-a50f-a767bd333ad5","Type":"ContainerStarted","Data":"2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45"}
Sep 08 15:26:27.029084 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:27.028730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" event={"ID":"c8371570-0422-4bf1-a50f-a767bd333ad5","Type":"ContainerStarted","Data":"97c9f54bd8176e5a02c137a088e91a00e1afa0e077053fd1c86157d5837bb1c1"}
Sep 08 15:26:27.058400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:27.058347    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" podStartSLOduration=2.05833063 podStartE2EDuration="2.05833063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:27.055496145 +0000 UTC m=+807.714657271" watchObservedRunningTime="2026-09-08 15:26:27.05833063 +0000 UTC m=+807.717491757"
Sep 08 15:26:27.117124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:27.117087    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:27.122502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:27.122476    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:28.034484 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:28.034456    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:28.035402 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:28.035382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:28.482569 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:28.482527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:28.573532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:28.573496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:29.670762 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:29.670728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:29.773366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:29.773334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:29.832324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:29.832274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:30.187437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.187402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:30.277274 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.277247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:30.486305 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.486107    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:26:30.590401 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590371    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-data\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrznv\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-kube-api-access-hrznv\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4bde39-048c-4d2d-9968-707c9fa65ec4-istiod-ca-cert\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-envoy\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-socket\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-podinfo\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590645    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-credential-socket\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-token\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.590917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-data" (OuterVolumeSpecName: "istio-data") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:26:30.590917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:26:30.590917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590814    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-certs\") pod \"be4bde39-048c-4d2d-9968-707c9fa65ec4\" (UID: \"be4bde39-048c-4d2d-9968-707c9fa65ec4\") "
Sep 08 15:26:30.591180 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.590915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be4bde39-048c-4d2d-9968-707c9fa65ec4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:30.591180 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.591017    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:26:30.591180 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.591046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:26:30.591363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.591324    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.591363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.591345    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.591363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.591358    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4bde39-048c-4d2d-9968-707c9fa65ec4-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.591485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.591374    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.591485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.591387    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.592957 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.592919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-kube-api-access-hrznv" (OuterVolumeSpecName: "kube-api-access-hrznv") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "kube-api-access-hrznv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:30.592957 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.592951    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-token" (OuterVolumeSpecName: "istio-token") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:30.593143 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.593120    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:26:30.593181 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.593120    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be4bde39-048c-4d2d-9968-707c9fa65ec4" (UID: "be4bde39-048c-4d2d-9968-707c9fa65ec4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:26:30.692651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.692614    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrznv\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-kube-api-access-hrznv\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.692651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.692646    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.692651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.692655    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:30.693119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:30.692663    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4bde39-048c-4d2d-9968-707c9fa65ec4-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:26:31.052299 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.052267    2578 generic.go:356] "Generic (PLEG): container finished" podID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerID="22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7" exitCode=0
Sep 08 15:26:31.052504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.052318    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"
Sep 08 15:26:31.052504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.052321    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" event={"ID":"be4bde39-048c-4d2d-9968-707c9fa65ec4","Type":"ContainerDied","Data":"22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7"}
Sep 08 15:26:31.052504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.052454    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm" event={"ID":"be4bde39-048c-4d2d-9968-707c9fa65ec4","Type":"ContainerDied","Data":"b62a2bd9aeb2f25aa3dd4869bef8e05b83e977794b0cbae285923ecc26b41bbf"}
Sep 08 15:26:31.052504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.052484    2578 scope.go:117] "RemoveContainer" containerID="22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7"
Sep 08 15:26:31.062916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.062895    2578 scope.go:117] "RemoveContainer" containerID="fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae"
Sep 08 15:26:31.071598 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.071460    2578 scope.go:117] "RemoveContainer" containerID="22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7"
Sep 08 15:26:31.072000 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:26:31.071804    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7\": container with ID starting with 22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7 not found: ID does not exist" containerID="22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7"
Sep 08 15:26:31.072000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.071840    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7"} err="failed to get container status \"22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7\": rpc error: code = NotFound desc = could not find container \"22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7\": container with ID starting with 22f24e550e479f3a4c0a59b3a55ea552582ed7133b7800fa142983813c73f0f7 not found: ID does not exist"
Sep 08 15:26:31.072000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.071866    2578 scope.go:117] "RemoveContainer" containerID="fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae"
Sep 08 15:26:31.072325 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:26:31.072167    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae\": container with ID starting with fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae not found: ID does not exist" containerID="fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae"
Sep 08 15:26:31.072325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.072194    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae"} err="failed to get container status \"fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae\": rpc error: code = NotFound desc = could not find container \"fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae\": container with ID starting with fda692712d8871693480748921d52dc97aed371c541c20af73e3b62eb7bf52ae not found: ID does not exist"
Sep 08 15:26:31.074329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.074308    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"]
Sep 08 15:26:31.078298 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.078273    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm"]
Sep 08 15:26:31.828156 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:31.828122    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" path="/var/lib/kubelet/pods/be4bde39-048c-4d2d-9968-707c9fa65ec4/volumes"
Sep 08 15:26:33.908835 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:33.908798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:43.965224 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:43.965179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:48.153250 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:48.153215    2578 generic.go:356] "Generic (PLEG): container finished" podID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerID="2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45" exitCode=0
Sep 08 15:26:48.153709 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:48.153287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" event={"ID":"c8371570-0422-4bf1-a50f-a767bd333ad5","Type":"ContainerDied","Data":"2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45"}
Sep 08 15:26:48.153768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:48.153742    2578 scope.go:117] "RemoveContainer" containerID="2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45"
Sep 08 15:26:48.154853 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:48.154824    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:48.154959 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:48.154892    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:48.154959 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:48.154924    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:26:49.161720 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:49.161681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" event={"ID":"c8371570-0422-4bf1-a50f-a767bd333ad5","Type":"ContainerStarted","Data":"41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8"}
Sep 08 15:26:50.117422 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:50.117377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:50.117681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:50.117658    2578 patch_prober.go:28] interesting pod/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 15:26:50.117739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:50.117710    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 15:26:50.592573 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:50.592541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:51.117020 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:51.116979    2578 patch_prober.go:28] interesting pod/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 15:26:51.117225 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:51.117055    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 15:26:52.117796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:52.117760    2578 patch_prober.go:28] interesting pod/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 15:26:52.118184 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:52.117818    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 15:26:52.372384 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:52.372286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:53.117433 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:53.117399    2578 patch_prober.go:28] interesting pod/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 15:26:53.117633 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:53.117456    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 15:26:53.996203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:53.996163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:54.117234 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:54.117189    2578 patch_prober.go:28] interesting pod/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 15:26:54.117424 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:54.117260    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 15:26:54.831924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:54.831892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:55.121741 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:55.121653    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:55.122127 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:55.122075    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:55.122772 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:55.122751    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:26:55.537612 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:55.537566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:55.647948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:55.647915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:55.709153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:55.709121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:26:56.617746 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:26:56.617712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:00.193378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:00.193283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:00.296042 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:00.296004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:00.374534 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:00.374504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:01.335546 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:01.335502    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:01.423903 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:01.423869    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"]
Sep 08 15:27:01.424158 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:01.424133    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy" containerID="cri-o://41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8" gracePeriod=30
Sep 08 15:27:01.425750 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:01.425717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:01.561334 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:01.561299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:01.917357 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:01.917312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:02.212099 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:02.212065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:02.314295 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:02.314260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:04.327180 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:04.327149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:04.419709 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:04.419671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:05.434245 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.434199    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"]
Sep 08 15:27:05.439450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.436056    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy"
Sep 08 15:27:05.439450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.438400    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy"
Sep 08 15:27:05.439450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.438610    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy"
Sep 08 15:27:05.439450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.438630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e609265-6f03-4bcf-a5c9-91b474216d8f" containerName="istio-proxy"
Sep 08 15:27:05.446904 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.446879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.451399 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.451377    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b5aeacc1-serving-cert\""
Sep 08 15:27:05.456051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.452225    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"]
Sep 08 15:27:05.468302 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.468256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:05.557834 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.557794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342d972b-9771-4d37-8617-f55023e36b13-openshift-service-ca\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.557834 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.557838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-maas-api-tls\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.558117 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.557958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc45g\" (UniqueName: \"kubernetes.io/projected/342d972b-9771-4d37-8617-f55023e36b13-kube-api-access-gc45g\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.558117 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.558090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-metrics-certs\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.571160 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.571110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:05.658668 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.658633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-metrics-certs\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.658857 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.658683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342d972b-9771-4d37-8617-f55023e36b13-openshift-service-ca\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.658857 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.658713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-maas-api-tls\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.658857 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.658798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc45g\" (UniqueName: \"kubernetes.io/projected/342d972b-9771-4d37-8617-f55023e36b13-kube-api-access-gc45g\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.659469 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.659440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342d972b-9771-4d37-8617-f55023e36b13-openshift-service-ca\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.661640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.661616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-maas-api-tls\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.662037 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.662016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-metrics-certs\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.666272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.666240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:05.667396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.667366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc45g\" (UniqueName: \"kubernetes.io/projected/342d972b-9771-4d37-8617-f55023e36b13-kube-api-access-gc45g\") pod \"maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:05.767897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:05.767855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:06.043305 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.043231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:06.054923 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.054897    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"]
Sep 08 15:27:06.057357 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:27:06.057324    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342d972b_9771_4d37_8617_f55023e36b13.slice/crio-4c14e8ffaa586ad3f20d223a68f9c2be8f7f62b16795cbbe8a4f23c8689f5391 WatchSource:0}: Error finding container 4c14e8ffaa586ad3f20d223a68f9c2be8f7f62b16795cbbe8a4f23c8689f5391: Status 404 returned error can't find the container with id 4c14e8ffaa586ad3f20d223a68f9c2be8f7f62b16795cbbe8a4f23c8689f5391
Sep 08 15:27:06.139572 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.139540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:06.284502 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.284191    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x" event={"ID":"342d972b-9771-4d37-8617-f55023e36b13","Type":"ContainerStarted","Data":"4c14e8ffaa586ad3f20d223a68f9c2be8f7f62b16795cbbe8a4f23c8689f5391"}
Sep 08 15:27:06.687634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.687560    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:27:06.778357 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-socket\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778357 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778362    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-data\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778445    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-certs\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778481    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-token\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778502    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-envoy\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8371570-0422-4bf1-a50f-a767bd333ad5-istiod-ca-cert\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778651    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nghmf\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-kube-api-access-nghmf\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778642    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:06.778892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778692    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-credential-socket\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778717    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:06.778892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-podinfo\") pod \"c8371570-0422-4bf1-a50f-a767bd333ad5\" (UID: \"c8371570-0422-4bf1-a50f-a767bd333ad5\") "
Sep 08 15:27:06.778892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778805    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:06.779172 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.778989    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8371570-0422-4bf1-a50f-a767bd333ad5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:06.779172 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.779138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:06.779291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.779210    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.779291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.779230    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.779291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.779244    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.779291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.779256    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8371570-0422-4bf1-a50f-a767bd333ad5-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.779291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.779270    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.780898 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.780875    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-kube-api-access-nghmf" (OuterVolumeSpecName: "kube-api-access-nghmf") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "kube-api-access-nghmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:06.781005 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.780925    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:06.781152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.781127    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:06.781152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.781126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8371570-0422-4bf1-a50f-a767bd333ad5" (UID: "c8371570-0422-4bf1-a50f-a767bd333ad5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:27:06.880849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.880812    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nghmf\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-kube-api-access-nghmf\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.880849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.880846    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.880849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.880857    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:06.881074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:06.880866    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8371570-0422-4bf1-a50f-a767bd333ad5-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:07.292593 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.292535    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x" event={"ID":"342d972b-9771-4d37-8617-f55023e36b13","Type":"ContainerStarted","Data":"668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d"}
Sep 08 15:27:07.292793 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.292715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:07.294407 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.294377    2578 generic.go:356] "Generic (PLEG): container finished" podID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerID="41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8" exitCode=0
Sep 08 15:27:07.294536 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.294419    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"
Sep 08 15:27:07.294536 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.294463    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" event={"ID":"c8371570-0422-4bf1-a50f-a767bd333ad5","Type":"ContainerDied","Data":"41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8"}
Sep 08 15:27:07.294536 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.294512    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4" event={"ID":"c8371570-0422-4bf1-a50f-a767bd333ad5","Type":"ContainerDied","Data":"97c9f54bd8176e5a02c137a088e91a00e1afa0e077053fd1c86157d5837bb1c1"}
Sep 08 15:27:07.294758 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.294542    2578 scope.go:117] "RemoveContainer" containerID="41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8"
Sep 08 15:27:07.304229 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.304184    2578 scope.go:117] "RemoveContainer" containerID="2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45"
Sep 08 15:27:07.309972 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.309917    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x" podStartSLOduration=1.864738815 podStartE2EDuration="2.309898102s" totalImagesPullingTime="445.159287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:07.308280273 +0000 UTC m=+847.967441403" watchObservedRunningTime="2026-09-08 15:27:07.309898102 +0000 UTC m=+847.969059230"
Sep 08 15:27:07.313495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.313477    2578 scope.go:117] "RemoveContainer" containerID="41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8"
Sep 08 15:27:07.313785 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:27:07.313767    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8\": container with ID starting with 41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8 not found: ID does not exist" containerID="41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8"
Sep 08 15:27:07.313880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.313791    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8"} err="failed to get container status \"41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8\": rpc error: code = NotFound desc = could not find container \"41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8\": container with ID starting with 41a929a74dd46ea321e27a5cb1f91496605821a238c61842649e36ba8e4cc7e8 not found: ID does not exist"
Sep 08 15:27:07.313880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.313809    2578 scope.go:117] "RemoveContainer" containerID="2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45"
Sep 08 15:27:07.314076 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:27:07.314059    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45\": container with ID starting with 2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45 not found: ID does not exist" containerID="2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45"
Sep 08 15:27:07.314136 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.314079    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45"} err="failed to get container status \"2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45\": rpc error: code = NotFound desc = could not find container \"2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45\": container with ID starting with 2801648bf6726d498615faefb77e32553e34c7071a1a0a468415efc02c8dbe45 not found: ID does not exist"
Sep 08 15:27:07.323962 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.323938    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"]
Sep 08 15:27:07.327280 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.327260    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4"]
Sep 08 15:27:07.827566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:07.827537    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" path="/var/lib/kubelet/pods/c8371570-0422-4bf1-a50f-a767bd333ad5/volumes"
Sep 08 15:27:11.702241 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702198    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"]
Sep 08 15:27:11.702772 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702755    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy"
Sep 08 15:27:11.702836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702775    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy"
Sep 08 15:27:11.702836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702789    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy"
Sep 08 15:27:11.702836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702795    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy"
Sep 08 15:27:11.702836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702804    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy"
Sep 08 15:27:11.702836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702809    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy"
Sep 08 15:27:11.703000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702884    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy"
Sep 08 15:27:11.703000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702892    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4bde39-048c-4d2d-9968-707c9fa65ec4" containerName="istio-proxy"
Sep 08 15:27:11.703000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.702905    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8371570-0422-4bf1-a50f-a767bd333ad5" containerName="istio-proxy"
Sep 08 15:27:11.706117 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.706099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.708573 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.708553    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-60b543\"/\"kube-root-ca.crt\""
Sep 08 15:27:11.709412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.709392    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-60b543\"/\"default-dockercfg-hbwmd\""
Sep 08 15:27:11.709505 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.709439    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-60b543\"/\"test-model-60b543-kserve-self-signed-certs\""
Sep 08 15:27:11.709505 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.709439    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-60b543\"/\"openshift-service-ca.crt\""
Sep 08 15:27:11.714355 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.714334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"]
Sep 08 15:27:11.734359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.734326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tls-certs\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.734359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.734357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-model-cache\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.734550 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.734379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98tn\" (UniqueName: \"kubernetes.io/projected/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-kube-api-access-x98tn\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.734550 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.734457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-home\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.734550 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.734473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-dshm\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.734550 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.734505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tmp-dir\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.835640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.835610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tls-certs\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.835640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.835642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-model-cache\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.835899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.835664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x98tn\" (UniqueName: \"kubernetes.io/projected/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-kube-api-access-x98tn\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.835899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.835709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-home\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.835899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.835722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-dshm\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.835899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.835741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tmp-dir\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.836116 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.836009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-model-cache\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.836116 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.836069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-home\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.836116 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.836097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tmp-dir\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.837930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.837906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-dshm\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.838310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.838289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tls-certs\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:11.843554 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:11.843535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98tn\" (UniqueName: \"kubernetes.io/projected/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-kube-api-access-x98tn\") pod \"test-model-60b543-kserve-9b8676bd5-b5qzr\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") " pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:12.016614 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:12.016503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:12.202287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:12.202251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:12.291148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:12.291119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"]
Sep 08 15:27:12.292973 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:27:12.292946    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f9ceaa6_7ba4_4390_9069_5c2bf4699cae.slice/crio-ee75eb9251280007af9ca92a42062c38613bf1b33e0b78cdef86f8eab95e2b18 WatchSource:0}: Error finding container ee75eb9251280007af9ca92a42062c38613bf1b33e0b78cdef86f8eab95e2b18: Status 404 returned error can't find the container with id ee75eb9251280007af9ca92a42062c38613bf1b33e0b78cdef86f8eab95e2b18
Sep 08 15:27:12.322988 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:12.322866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr" event={"ID":"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae","Type":"ContainerStarted","Data":"ee75eb9251280007af9ca92a42062c38613bf1b33e0b78cdef86f8eab95e2b18"}
Sep 08 15:27:13.306244 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:13.306213    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:13.330389 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:13.330336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr" event={"ID":"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae","Type":"ContainerStarted","Data":"cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a"}
Sep 08 15:27:13.351086 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:13.351034    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr" podStartSLOduration=2.351013311 podStartE2EDuration="2.351013311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:13.348530246 +0000 UTC m=+854.007691376" watchObservedRunningTime="2026-09-08 15:27:13.351013311 +0000 UTC m=+854.010174438"
Sep 08 15:27:21.918526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:21.918487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:22.016655 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:22.016622    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:22.016842 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:22.016674    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:22.029059 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:22.029033    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:22.393397 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:22.393366    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:27:23.351869 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:23.351841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:24.160517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:24.160480    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:27.463924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:27.463885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:35.934983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:35.934950    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"]
Sep 08 15:27:35.935522 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:35.935172    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x" podUID="342d972b-9771-4d37-8617-f55023e36b13" containerName="maas-api" containerID="cri-o://668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d" gracePeriod=30
Sep 08 15:27:35.964149 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:35.964116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:36.063365 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.063339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:36.135847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.135816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:36.186014 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.185954    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:36.196200 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.196173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:36.282929 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.282898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:36.310045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.310017    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-maas-api-tls\") pod \"342d972b-9771-4d37-8617-f55023e36b13\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") "
Sep 08 15:27:36.310216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.310092    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342d972b-9771-4d37-8617-f55023e36b13-openshift-service-ca\") pod \"342d972b-9771-4d37-8617-f55023e36b13\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") "
Sep 08 15:27:36.310216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.310158    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-metrics-certs\") pod \"342d972b-9771-4d37-8617-f55023e36b13\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") "
Sep 08 15:27:36.310329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.310234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc45g\" (UniqueName: \"kubernetes.io/projected/342d972b-9771-4d37-8617-f55023e36b13-kube-api-access-gc45g\") pod \"342d972b-9771-4d37-8617-f55023e36b13\" (UID: \"342d972b-9771-4d37-8617-f55023e36b13\") "
Sep 08 15:27:36.310512 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.310488    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d972b-9771-4d37-8617-f55023e36b13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "342d972b-9771-4d37-8617-f55023e36b13" (UID: "342d972b-9771-4d37-8617-f55023e36b13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:36.310657 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.310640    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342d972b-9771-4d37-8617-f55023e36b13-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:36.312137 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.312110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "342d972b-9771-4d37-8617-f55023e36b13" (UID: "342d972b-9771-4d37-8617-f55023e36b13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:27:36.312292 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.312270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342d972b-9771-4d37-8617-f55023e36b13-kube-api-access-gc45g" (OuterVolumeSpecName: "kube-api-access-gc45g") pod "342d972b-9771-4d37-8617-f55023e36b13" (UID: "342d972b-9771-4d37-8617-f55023e36b13"). InnerVolumeSpecName "kube-api-access-gc45g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:36.312336 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.312316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "342d972b-9771-4d37-8617-f55023e36b13" (UID: "342d972b-9771-4d37-8617-f55023e36b13"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:27:36.411992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.411958    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:36.411992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.411985    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342d972b-9771-4d37-8617-f55023e36b13-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:36.411992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.411994    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc45g\" (UniqueName: \"kubernetes.io/projected/342d972b-9771-4d37-8617-f55023e36b13-kube-api-access-gc45g\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:36.459892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.459856    2578 generic.go:356] "Generic (PLEG): container finished" podID="342d972b-9771-4d37-8617-f55023e36b13" containerID="668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d" exitCode=0
Sep 08 15:27:36.459892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.459899    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"
Sep 08 15:27:36.460168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.459944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x" event={"ID":"342d972b-9771-4d37-8617-f55023e36b13","Type":"ContainerDied","Data":"668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d"}
Sep 08 15:27:36.460168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.460020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x" event={"ID":"342d972b-9771-4d37-8617-f55023e36b13","Type":"ContainerDied","Data":"4c14e8ffaa586ad3f20d223a68f9c2be8f7f62b16795cbbe8a4f23c8689f5391"}
Sep 08 15:27:36.460168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.460056    2578 scope.go:117] "RemoveContainer" containerID="668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d"
Sep 08 15:27:36.474426 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.473497    2578 scope.go:117] "RemoveContainer" containerID="668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d"
Sep 08 15:27:36.476989 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:27:36.476899    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d\": container with ID starting with 668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d not found: ID does not exist" containerID="668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d"
Sep 08 15:27:36.476989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.476956    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d"} err="failed to get container status \"668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d\": rpc error: code = NotFound desc = could not find container \"668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d\": container with ID starting with 668e27e6ffcc1f4c192eac1620450ca79f47bec9324785451d5cf5bb7779be0d not found: ID does not exist"
Sep 08 15:27:36.485674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.485563    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"]
Sep 08 15:27:36.491936 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.491909    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5aeacc1-ffbcd89c7-vpf4x"]
Sep 08 15:27:36.952112 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:36.952080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:37.052433 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:37.052400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:37.153526 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:37.153489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:37.828088 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:37.828055    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="342d972b-9771-4d37-8617-f55023e36b13" path="/var/lib/kubelet/pods/342d972b-9771-4d37-8617-f55023e36b13/volumes"
Sep 08 15:27:38.145288 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:38.145196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:38.352110 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:38.352072    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"]
Sep 08 15:27:38.352306 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:38.352279    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" containerID="cri-o://f330aaf71a2bf46a05f028f9d13526a7ccd8b15925490a46961d5f0d4ae8ac98" gracePeriod=30
Sep 08 15:27:38.368793 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:38.368763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:38.466765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:38.466721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:38.809450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:38.809369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:39.070050 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.069936    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"]
Sep 08 15:27:39.071235 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.071205    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d972b-9771-4d37-8617-f55023e36b13" containerName="maas-api"
Sep 08 15:27:39.071235 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.071232    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d972b-9771-4d37-8617-f55023e36b13" containerName="maas-api"
Sep 08 15:27:39.071404 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.071343    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="342d972b-9771-4d37-8617-f55023e36b13" containerName="maas-api"
Sep 08 15:27:39.075262 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.075238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.078715 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.078696    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-0c2253-openshift-default-dockercfg-dv2pg\""
Sep 08 15:27:39.088541 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.088515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"]
Sep 08 15:27:39.107670 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.107638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:39.139967 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.139937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-podinfo\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.139998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-token\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.140028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-socket\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.140056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-credential-socket\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.140121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-certs\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.140160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-data\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.140183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rwkl\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-kube-api-access-8rwkl\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.140214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-envoy\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.140396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.140262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istiod-ca-cert\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-socket\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-credential-socket\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-certs\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-data\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rwkl\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-kube-api-access-8rwkl\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-envoy\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istiod-ca-cert\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-podinfo\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241463 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-token\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-socket\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-certs\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.241948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.241547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-data\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.242112 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.242005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-credential-socket\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.242398 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.242374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istiod-ca-cert\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.243459 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.243437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-envoy\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.243813 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.243794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-podinfo\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.249489 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.249466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-token\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.249716 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.249698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rwkl\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-kube-api-access-8rwkl\") pod \"e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") " pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.299814 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.299777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:39.388105 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.388023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:39.662639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.662612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"]
Sep 08 15:27:39.664542 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:27:39.664514    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c1b07d_e34b_4ba4_a824_13b35fb112e7.slice/crio-b0cc68c1e686a849c5e4fc2fc846821197ce6562c0c274055a1e0bff5f2fda1e WatchSource:0}: Error finding container b0cc68c1e686a849c5e4fc2fc846821197ce6562c0c274055a1e0bff5f2fda1e: Status 404 returned error can't find the container with id b0cc68c1e686a849c5e4fc2fc846821197ce6562c0c274055a1e0bff5f2fda1e
Sep 08 15:27:39.666771 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.666739    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:27:39.666864 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.666808    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:27:39.666864 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:39.666840    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:27:40.486386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:40.486348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" event={"ID":"f5c1b07d-e34b-4ba4-a824-13b35fb112e7","Type":"ContainerStarted","Data":"5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93"}
Sep 08 15:27:40.486799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:40.486408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" event={"ID":"f5c1b07d-e34b-4ba4-a824-13b35fb112e7","Type":"ContainerStarted","Data":"b0cc68c1e686a849c5e4fc2fc846821197ce6562c0c274055a1e0bff5f2fda1e"}
Sep 08 15:27:40.506866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:40.506806    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podStartSLOduration=1.5067881330000001 podStartE2EDuration="1.506788133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:40.505692411 +0000 UTC m=+881.164853551" watchObservedRunningTime="2026-09-08 15:27:40.506788133 +0000 UTC m=+881.165949261"
Sep 08 15:27:41.388639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:41.388575    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:41.393686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:41.393663    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:41.491965 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:41.491937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:41.492732 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:41.492713    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:27:41.718048 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:41.718014    2578 patch_prober.go:28] interesting pod/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:27:41.718203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:41.718075    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:27:42.375492 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:42.375452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:42.469388 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:42.469348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:43.508416 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.508385    2578 generic.go:356] "Generic (PLEG): container finished" podID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerID="f330aaf71a2bf46a05f028f9d13526a7ccd8b15925490a46961d5f0d4ae8ac98" exitCode=0
Sep 08 15:27:43.508829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.508462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" event={"ID":"ff52f48d-24ac-46af-a855-f83f7d9eaf85","Type":"ContainerDied","Data":"f330aaf71a2bf46a05f028f9d13526a7ccd8b15925490a46961d5f0d4ae8ac98"}
Sep 08 15:27:43.508829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.508530    2578 scope.go:117] "RemoveContainer" containerID="86051384a2c14e10acb984c9a88d2429e0c230d7eecc2e07357c5ff815b7e6d9"
Sep 08 15:27:43.577810 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.577743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:43.626880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.626820    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:27:43.657546 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.657517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:43.689419 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689390    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-data\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689593 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689430    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-credential-socket\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689593 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689460    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-socket\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689593 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689522    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jjqp\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-kube-api-access-6jjqp\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689593 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-certs\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689593 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689575    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-token\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689660    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:43.689870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689739    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-podinfo\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689777    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:43.689870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689792    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:43.689870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689835    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istiod-ca-cert\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.689870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689863    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-envoy\") pod \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\" (UID: \"ff52f48d-24ac-46af-a855-f83f7d9eaf85\") "
Sep 08 15:27:43.690187 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.689935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:43.690244 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.690197    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:43.690366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.690345    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.690438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.690370    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.690438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.690384    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.690438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.690396    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.690438 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.690412    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.692086 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.692054    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-kube-api-access-6jjqp" (OuterVolumeSpecName: "kube-api-access-6jjqp") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "kube-api-access-6jjqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:43.692188 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.692129    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:27:43.692188 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.692137    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:43.692344 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.692321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff52f48d-24ac-46af-a855-f83f7d9eaf85" (UID: "ff52f48d-24ac-46af-a855-f83f7d9eaf85"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:43.717439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.717410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:43.791402 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.791369    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jjqp\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-kube-api-access-6jjqp\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.791402 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.791404    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.791682 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.791420    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:43.791682 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:43.791433    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff52f48d-24ac-46af-a855-f83f7d9eaf85-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:27:44.146442 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:44.146402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:44.225124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:44.225095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:44.515916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:44.515878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv" event={"ID":"ff52f48d-24ac-46af-a855-f83f7d9eaf85","Type":"ContainerDied","Data":"76f0d64453d8c8cd39c4492550856e6fd2be3e5b4bd7149b1db606a8b91a865b"}
Sep 08 15:27:44.516376 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:44.515939    2578 scope.go:117] "RemoveContainer" containerID="f330aaf71a2bf46a05f028f9d13526a7ccd8b15925490a46961d5f0d4ae8ac98"
Sep 08 15:27:44.516376 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:44.515892    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"
Sep 08 15:27:44.534107 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:44.534080    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"]
Sep 08 15:27:44.537620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:44.537594    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv"]
Sep 08 15:27:45.245877 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:45.245847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:45.350987 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:45.350951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:45.445992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:45.445960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:45.546679 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:45.546566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:45.835233 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:45.835148    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" path="/var/lib/kubelet/pods/ff52f48d-24ac-46af-a855-f83f7d9eaf85/volumes"
Sep 08 15:27:45.907875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:45.907837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:27:57.534725 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:57.534689    2578 patch_prober.go:28] interesting pod/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:27:57.535184 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:57.534766    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:27:59.612808 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:59.612770    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerID="5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93" exitCode=0
Sep 08 15:27:59.613238 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:59.612843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" event={"ID":"f5c1b07d-e34b-4ba4-a824-13b35fb112e7","Type":"ContainerDied","Data":"5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93"}
Sep 08 15:27:59.613373 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:59.613355    2578 scope.go:117] "RemoveContainer" containerID="5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93"
Sep 08 15:27:59.614442 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:59.614412    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:27:59.614530 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:59.614483    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:27:59.614530 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:27:59.614513    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:28:00.620508 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:00.620474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" event={"ID":"f5c1b07d-e34b-4ba4-a824-13b35fb112e7","Type":"ContainerStarted","Data":"c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb"}
Sep 08 15:28:01.388412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:01.388375    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:28:01.388649 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:01.388612    2578 patch_prober.go:28] interesting pod/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:28:01.388719 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:01.388671    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 15:28:02.389378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:02.389339    2578 patch_prober.go:28] interesting pod/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:28:02.389854 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:02.389407    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 15:28:03.389023 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:03.388977    2578 patch_prober.go:28] interesting pod/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:28:03.389240 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:03.389035    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 15:28:04.388655 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:04.388617    2578 patch_prober.go:28] interesting pod/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:28:04.389161 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:04.388683    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 15:28:05.388755 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:05.388714    2578 patch_prober.go:28] interesting pod/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:28:05.389160 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:05.388799    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 15:28:06.389264 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:06.389215    2578 patch_prober.go:28] interesting pod/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:28:06.389719 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:06.389284    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 15:28:07.297731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:07.297692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:07.392185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:07.392154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:28:07.392664 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:07.392560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:28:07.393214 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:07.393195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:28:11.803722 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:11.803679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:15.226802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:15.226769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:18.336011 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:18.335974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:18.434155 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:18.434116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:21.936913 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:21.936868    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:29.238340 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:29.238299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:33.449650 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:33.449604    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:39.302476 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:39.302439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:39.420988 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:39.420954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:39.510928 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:39.510895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:39.606851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:39.606753    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:39.996209 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:39.996175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:40.109440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:40.109400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:40.187725 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:40.187689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:40.271423 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:40.271329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:40.329229 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:40.329188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:40.620358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:40.620269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:45.917838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:45.917799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:46.799365 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:46.799329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:47.042937 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:47.042903    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"]
Sep 08 15:28:47.043366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:47.043208    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy" containerID="cri-o://c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb" gracePeriod=30
Sep 08 15:28:47.537289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:47.537249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:47.639754 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:47.639715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:47.781418 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:47.781370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:48.271473 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:48.271429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:48.772213 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:48.772164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:48.868963 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:48.868919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:49.875720 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:49.875671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:49.992017 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:49.991975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:50.736056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:50.736005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:52.302984 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.302960    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:28:52.414272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414174    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-data\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414272    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-credential-socket\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414316    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-socket\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-podinfo\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-envoy\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414440    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:28:52.414729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-token\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rwkl\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-kube-api-access-8rwkl\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414549    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:28:52.414729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-certs\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414645    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istiod-ca-cert\") pod \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\" (UID: \"f5c1b07d-e34b-4ba4-a824-13b35fb112e7\") "
Sep 08 15:28:52.414729 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.414641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:28:52.415115 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.415052    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.415115 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.415073    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.415115 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.415092    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.415528 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.415494    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:28:52.415528 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.415516    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:28:52.417404 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.417329    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:28:52.417534 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.417410    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:28:52.417822 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.417712    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:28:52.417822 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.417735    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-kube-api-access-8rwkl" (OuterVolumeSpecName: "kube-api-access-8rwkl") pod "f5c1b07d-e34b-4ba4-a824-13b35fb112e7" (UID: "f5c1b07d-e34b-4ba4-a824-13b35fb112e7"). InnerVolumeSpecName "kube-api-access-8rwkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:28:52.516548 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.516495    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.516548 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.516544    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.516845 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.516561    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rwkl\" (UniqueName: \"kubernetes.io/projected/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-kube-api-access-8rwkl\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.516845 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.516593    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.516845 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.516610    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.516845 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.516625    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5c1b07d-e34b-4ba4-a824-13b35fb112e7-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:28:52.909421 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.909385    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerID="c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb" exitCode=0
Sep 08 15:28:52.909647 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.909427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" event={"ID":"f5c1b07d-e34b-4ba4-a824-13b35fb112e7","Type":"ContainerDied","Data":"c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb"}
Sep 08 15:28:52.909647 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.909436    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"
Sep 08 15:28:52.909647 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.909478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd" event={"ID":"f5c1b07d-e34b-4ba4-a824-13b35fb112e7","Type":"ContainerDied","Data":"b0cc68c1e686a849c5e4fc2fc846821197ce6562c0c274055a1e0bff5f2fda1e"}
Sep 08 15:28:52.909647 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.909509    2578 scope.go:117] "RemoveContainer" containerID="c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb"
Sep 08 15:28:52.920083 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.920062    2578 scope.go:117] "RemoveContainer" containerID="5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93"
Sep 08 15:28:52.928342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.928302    2578 scope.go:117] "RemoveContainer" containerID="c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb"
Sep 08 15:28:52.928689 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:28:52.928654    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb\": container with ID starting with c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb not found: ID does not exist" containerID="c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb"
Sep 08 15:28:52.928840 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.928699    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb"} err="failed to get container status \"c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb\": rpc error: code = NotFound desc = could not find container \"c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb\": container with ID starting with c5c92c474baa09d36fb3cd4a864a24964b44d3ed4ed75ac880e3bb897fc8b9eb not found: ID does not exist"
Sep 08 15:28:52.928840 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.928718    2578 scope.go:117] "RemoveContainer" containerID="5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93"
Sep 08 15:28:52.929057 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:28:52.929033    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93\": container with ID starting with 5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93 not found: ID does not exist" containerID="5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93"
Sep 08 15:28:52.929124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.929063    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93"} err="failed to get container status \"5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93\": rpc error: code = NotFound desc = could not find container \"5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93\": container with ID starting with 5521100eb6ab5890494fff23dedcbbe61a8fbdae8f1207cbe74faacc1951df93 not found: ID does not exist"
Sep 08 15:28:52.931759 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.931736    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"]
Sep 08 15:28:52.935465 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:52.935445    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd"]
Sep 08 15:28:53.827737 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:53.827702    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" path="/var/lib/kubelet/pods/f5c1b07d-e34b-4ba4-a824-13b35fb112e7/volumes"
Sep 08 15:28:56.672406 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:56.672357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:56.737604 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:56.737556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:56.821623 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:56.821571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:56.927999 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:56.927907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:57.020902 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:57.020873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:57.570190 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:57.570108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:57.666656 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:57.666624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:57.767299 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:57.767263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:28:59.170736 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:28:59.170697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:00.680837 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:00.680802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:04.960492 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:04.960453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:05.202462 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:05.202429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:05.304139 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:05.304016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:05.846867 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:05.846830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:08.523642 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:08.523600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:08.640022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:08.639993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:08.848811 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:08.848728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:08.964522 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:08.964494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:11.689216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:11.689179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:11.752797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:11.752764    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:11.917440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:11.917406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:12.177032 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.176987    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"]
Sep 08 15:29:12.177633 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177614    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy"
Sep 08 15:29:12.177697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177634    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy"
Sep 08 15:29:12.177697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177657    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy"
Sep 08 15:29:12.177697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177663    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy"
Sep 08 15:29:12.177697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177670    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy"
Sep 08 15:29:12.177697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177675    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy"
Sep 08 15:29:12.177697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177688    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy"
Sep 08 15:29:12.177697 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177696    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy"
Sep 08 15:29:12.177915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177782    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy"
Sep 08 15:29:12.177915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177791    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy"
Sep 08 15:29:12.177915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.177799    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff52f48d-24ac-46af-a855-f83f7d9eaf85" containerName="istio-proxy"
Sep 08 15:29:12.180711 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.180691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.184078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.184048    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8acdf03d-openshift-default-dockercfg-jv4m7\""
Sep 08 15:29:12.204102 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.204074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"]
Sep 08 15:29:12.221737 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.221709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:12.322854 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.322821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qf79\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-kube-api-access-8qf79\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.322854 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.322857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-certs\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.323129 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.322877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-token\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.323129 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.322909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-data\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.323129 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.322971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-credential-socket\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.323129 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.323008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-podinfo\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.323129 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.323027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-socket\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.323129 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.323050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-envoy\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.323392 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.323189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2272cb-9128-440a-b7f9-4200f6c967ec-istiod-ca-cert\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.424723 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-certs\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.424723 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-token\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-data\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-credential-socket\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-podinfo\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-socket\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-envoy\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.424959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2272cb-9128-440a-b7f9-4200f6c967ec-istiod-ca-cert\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.425033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qf79\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-kube-api-access-8qf79\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.425193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-credential-socket\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.425232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-certs\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425494 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.425339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-socket\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425494 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.425367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-data\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.425883 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.425858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2272cb-9128-440a-b7f9-4200f6c967ec-istiod-ca-cert\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.427281 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.427229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-envoy\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.427389 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.427368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-podinfo\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.432523 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.432493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-token\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.432654 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.432621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qf79\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-kube-api-access-8qf79\") pod \"e2e-mt-8acdf03d-openshift-default-654576b76-72fqm\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") " pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.495263 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.495228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:12.541047 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.541007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:12.779527 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.779502    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"]
Sep 08 15:29:12.781347 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:29:12.781316    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2272cb_9128_440a_b7f9_4200f6c967ec.slice/crio-c1e20cea1d2b0b9f728d610507cf85e6f74a21a84c939a55b306eda1c257cfe9 WatchSource:0}: Error finding container c1e20cea1d2b0b9f728d610507cf85e6f74a21a84c939a55b306eda1c257cfe9: Status 404 returned error can't find the container with id c1e20cea1d2b0b9f728d610507cf85e6f74a21a84c939a55b306eda1c257cfe9
Sep 08 15:29:12.783763 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.783733    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:29:12.783844 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.783797    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:29:12.783844 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:12.783826    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:29:13.023917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:13.023882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" event={"ID":"0b2272cb-9128-440a-b7f9-4200f6c967ec","Type":"ContainerStarted","Data":"859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357"}
Sep 08 15:29:13.024122 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:13.023942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" event={"ID":"0b2272cb-9128-440a-b7f9-4200f6c967ec","Type":"ContainerStarted","Data":"c1e20cea1d2b0b9f728d610507cf85e6f74a21a84c939a55b306eda1c257cfe9"}
Sep 08 15:29:13.043743 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:13.043646    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podStartSLOduration=1.043630041 podStartE2EDuration="1.043630041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:29:13.042648289 +0000 UTC m=+973.701809418" watchObservedRunningTime="2026-09-08 15:29:13.043630041 +0000 UTC m=+973.702791168"
Sep 08 15:29:13.496184 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:13.496123    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:13.501330 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:13.501306    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:13.981468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:13.981433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:14.029724 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:14.029691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:14.030743 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:14.030721    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:14.907683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:14.907645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:15.008241 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:15.008206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:16.054262 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.054232    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"]
Sep 08 15:29:16.054779 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.054763    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5c1b07d-e34b-4ba4-a824-13b35fb112e7" containerName="istio-proxy"
Sep 08 15:29:16.063892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.063852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.068465 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.068431    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8acdf03d-serving-cert\""
Sep 08 15:29:16.075728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.075704    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"]
Sep 08 15:29:16.094691 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.094652    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:16.166568 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.166537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbbm8\" (UniqueName: \"kubernetes.io/projected/9e897253-2f23-4755-8de6-132f122a86be-kube-api-access-hbbm8\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.166761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.166571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-metrics-certs\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.166761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.166647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e897253-2f23-4755-8de6-132f122a86be-openshift-service-ca\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.166905 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.166844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-maas-api-tls\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.171388 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.171365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:16.268322 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.268291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e897253-2f23-4755-8de6-132f122a86be-openshift-service-ca\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.268518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.268370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-maas-api-tls\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.268518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.268454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbbm8\" (UniqueName: \"kubernetes.io/projected/9e897253-2f23-4755-8de6-132f122a86be-kube-api-access-hbbm8\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.268518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.268482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-metrics-certs\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.269036 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.269011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e897253-2f23-4755-8de6-132f122a86be-openshift-service-ca\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.270885 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.270863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-metrics-certs\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.271023 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.271001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-maas-api-tls\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.277927 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.277903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbbm8\" (UniqueName: \"kubernetes.io/projected/9e897253-2f23-4755-8de6-132f122a86be-kube-api-access-hbbm8\") pod \"maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.379283 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.379182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:16.665759 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.665721    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"]
Sep 08 15:29:16.667969 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:29:16.667939    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e897253_2f23_4755_8de6_132f122a86be.slice/crio-1a892894d07bbca99ab14a0c97e930e61c9915e411a35d6f9c0b6bae069e63ce WatchSource:0}: Error finding container 1a892894d07bbca99ab14a0c97e930e61c9915e411a35d6f9c0b6bae069e63ce: Status 404 returned error can't find the container with id 1a892894d07bbca99ab14a0c97e930e61c9915e411a35d6f9c0b6bae069e63ce
Sep 08 15:29:16.669412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.669394    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:29:16.775689 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.775653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:16.876815 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:16.876779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:17.049358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:17.049319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88" event={"ID":"9e897253-2f23-4755-8de6-132f122a86be","Type":"ContainerStarted","Data":"1a892894d07bbca99ab14a0c97e930e61c9915e411a35d6f9c0b6bae069e63ce"}
Sep 08 15:29:18.056839 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:18.056797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88" event={"ID":"9e897253-2f23-4755-8de6-132f122a86be","Type":"ContainerStarted","Data":"07c6a0c98e61875e3907d7f67ef8c33cab6e614be3494347e67a509ed515a153"}
Sep 08 15:29:18.057256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:18.056890    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:18.083388 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:18.083332    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88" podStartSLOduration=1.699993828 podStartE2EDuration="2.083316515s" totalImagesPullingTime="383.322687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:29:18.081513946 +0000 UTC m=+978.740675073" watchObservedRunningTime="2026-09-08 15:29:18.083316515 +0000 UTC m=+978.742477672"
Sep 08 15:29:24.077468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:24.077036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:24.325777 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:24.325644    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"]
Sep 08 15:29:24.336472 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:24.336388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:25.667616 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:25.667565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:25.971325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:25.971229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:29.678318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:29.678082    2578 patch_prober.go:28] interesting pod/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:56812->10.134.0.55:15021: read: connection reset by peer" start-of-body=
Sep 08 15:29:29.678318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:29.678144    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:56812->10.134.0.55:15021: read: connection reset by peer"
Sep 08 15:29:30.132190 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:30.132150    2578 generic.go:356] "Generic (PLEG): container finished" podID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerID="859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357" exitCode=0
Sep 08 15:29:30.132398 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:30.132224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" event={"ID":"0b2272cb-9128-440a-b7f9-4200f6c967ec","Type":"ContainerDied","Data":"859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357"}
Sep 08 15:29:30.132680 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:30.132665    2578 scope.go:117] "RemoveContainer" containerID="859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357"
Sep 08 15:29:30.133728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:30.133701    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:29:30.133825 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:30.133766    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:29:30.133825 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:30.133818    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:29:31.139421 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:31.139390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" event={"ID":"0b2272cb-9128-440a-b7f9-4200f6c967ec","Type":"ContainerStarted","Data":"8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe"}
Sep 08 15:29:31.496142 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:31.496112    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:31.496352 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:31.496329    2578 patch_prober.go:28] interesting pod/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:29:31.496399 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:31.496381    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 15:29:32.496057 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:32.496023    2578 patch_prober.go:28] interesting pod/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:29:32.496487 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:32.496081    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 15:29:33.495921 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:33.495884    2578 patch_prober.go:28] interesting pod/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:29:33.496112 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:33.495955    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 15:29:34.495823 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:34.495782    2578 patch_prober.go:28] interesting pod/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:29:34.496020 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:34.495842    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 15:29:35.496466 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:35.496427    2578 patch_prober.go:28] interesting pod/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:29:35.496934 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:35.496486    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 15:29:36.310430 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.310392    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"]
Sep 08 15:29:36.310870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.310727    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586" podUID="ce24ec0c-3f49-419b-9a29-09caca1ea869" containerName="maas-api" containerID="cri-o://0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8" gracePeriod=30
Sep 08 15:29:36.342092 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.342060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:36.442738 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.442702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:36.502512 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.502478    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:36.504525 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.503812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:36.504920 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.504873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:29:36.535930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.535895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:36.586495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.586466    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:29:36.612150 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.612109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:36.696078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.696047    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls\") pod \"ce24ec0c-3f49-419b-9a29-09caca1ea869\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") "
Sep 08 15:29:36.696275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.696145    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-metrics-certs\") pod \"ce24ec0c-3f49-419b-9a29-09caca1ea869\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") "
Sep 08 15:29:36.696275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.696235    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce24ec0c-3f49-419b-9a29-09caca1ea869-openshift-service-ca\") pod \"ce24ec0c-3f49-419b-9a29-09caca1ea869\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") "
Sep 08 15:29:36.696275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.696261    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr6tv\" (UniqueName: \"kubernetes.io/projected/ce24ec0c-3f49-419b-9a29-09caca1ea869-kube-api-access-dr6tv\") pod \"ce24ec0c-3f49-419b-9a29-09caca1ea869\" (UID: \"ce24ec0c-3f49-419b-9a29-09caca1ea869\") "
Sep 08 15:29:36.696648 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.696615    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce24ec0c-3f49-419b-9a29-09caca1ea869-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce24ec0c-3f49-419b-9a29-09caca1ea869" (UID: "ce24ec0c-3f49-419b-9a29-09caca1ea869"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:36.698298 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.698272    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce24ec0c-3f49-419b-9a29-09caca1ea869" (UID: "ce24ec0c-3f49-419b-9a29-09caca1ea869"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:29:36.698402 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.698321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ce24ec0c-3f49-419b-9a29-09caca1ea869" (UID: "ce24ec0c-3f49-419b-9a29-09caca1ea869"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:29:36.698402 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.698344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce24ec0c-3f49-419b-9a29-09caca1ea869-kube-api-access-dr6tv" (OuterVolumeSpecName: "kube-api-access-dr6tv") pod "ce24ec0c-3f49-419b-9a29-09caca1ea869" (UID: "ce24ec0c-3f49-419b-9a29-09caca1ea869"). InnerVolumeSpecName "kube-api-access-dr6tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:36.797910 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.797861    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce24ec0c-3f49-419b-9a29-09caca1ea869-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:36.797910 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.797901    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr6tv\" (UniqueName: \"kubernetes.io/projected/ce24ec0c-3f49-419b-9a29-09caca1ea869-kube-api-access-dr6tv\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:36.797910 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.797915    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:36.798159 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.797927    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce24ec0c-3f49-419b-9a29-09caca1ea869-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:36.914263 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:36.914169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:37.182698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.182621    2578 generic.go:356] "Generic (PLEG): container finished" podID="ce24ec0c-3f49-419b-9a29-09caca1ea869" containerID="0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8" exitCode=0
Sep 08 15:29:37.182698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.182671    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"
Sep 08 15:29:37.182942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.182714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586" event={"ID":"ce24ec0c-3f49-419b-9a29-09caca1ea869","Type":"ContainerDied","Data":"0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8"}
Sep 08 15:29:37.182942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.182773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586" event={"ID":"ce24ec0c-3f49-419b-9a29-09caca1ea869","Type":"ContainerDied","Data":"3f2407c12be9aa96c9e25e068b9073fc1b544391435bb966ca34de6e015c823c"}
Sep 08 15:29:37.182942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.182801    2578 scope.go:117] "RemoveContainer" containerID="0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8"
Sep 08 15:29:37.193331 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.193315    2578 scope.go:117] "RemoveContainer" containerID="0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8"
Sep 08 15:29:37.193655 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:29:37.193632    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8\": container with ID starting with 0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8 not found: ID does not exist" containerID="0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8"
Sep 08 15:29:37.193738 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.193665    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8"} err="failed to get container status \"0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8\": rpc error: code = NotFound desc = could not find container \"0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8\": container with ID starting with 0ad3328a19922c78faff5803d54749bab6b6ab52e5781f69cc21ed2555ea22d8 not found: ID does not exist"
Sep 08 15:29:37.205371 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.205343    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"]
Sep 08 15:29:37.209077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.209053    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60b543-84654d6bd-mw586"]
Sep 08 15:29:37.270675 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.270644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:37.828285 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:37.828245    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce24ec0c-3f49-419b-9a29-09caca1ea869" path="/var/lib/kubelet/pods/ce24ec0c-3f49-419b-9a29-09caca1ea869/volumes"
Sep 08 15:29:39.346273 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.346228    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr" podUID="2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" containerName="main" containerID="cri-o://cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a" gracePeriod=45
Sep 08 15:29:39.606105 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.606043    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:29:39.729414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729381    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x98tn\" (UniqueName: \"kubernetes.io/projected/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-kube-api-access-x98tn\") pod \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") "
Sep 08 15:29:39.729627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729422    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tls-certs\") pod \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") "
Sep 08 15:29:39.729627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-home\") pod \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") "
Sep 08 15:29:39.729627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729526    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-model-cache\") pod \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") "
Sep 08 15:29:39.729627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-dshm\") pod \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") "
Sep 08 15:29:39.729627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tmp-dir\") pod \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\" (UID: \"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae\") "
Sep 08 15:29:39.729916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729820    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-home" (OuterVolumeSpecName: "home") pod "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" (UID: "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:39.729916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729831    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" (UID: "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:39.730029 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.729931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" (UID: "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:39.730153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.730132    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tmp-dir\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:39.730153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.730151    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-home\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:39.730293 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.730160    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-model-cache\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:39.731870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.731841    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-dshm" (OuterVolumeSpecName: "dshm") pod "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" (UID: "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:39.731989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.731866    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-kube-api-access-x98tn" (OuterVolumeSpecName: "kube-api-access-x98tn") pod "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" (UID: "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae"). InnerVolumeSpecName "kube-api-access-x98tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:39.731989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.731892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" (UID: "2f9ceaa6-7ba4-4390-9069-5c2bf4699cae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:29:39.831167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.831134    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x98tn\" (UniqueName: \"kubernetes.io/projected/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-kube-api-access-x98tn\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:39.831167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.831163    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-tls-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:39.831167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.831174    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae-dshm\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:39.859094 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:39.858979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:40.207657 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.207625    2578 generic.go:356] "Generic (PLEG): container finished" podID="2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" containerID="cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a" exitCode=0
Sep 08 15:29:40.207846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.207671    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"
Sep 08 15:29:40.207846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.207704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr" event={"ID":"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae","Type":"ContainerDied","Data":"cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a"}
Sep 08 15:29:40.207846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.207745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr" event={"ID":"2f9ceaa6-7ba4-4390-9069-5c2bf4699cae","Type":"ContainerDied","Data":"ee75eb9251280007af9ca92a42062c38613bf1b33e0b78cdef86f8eab95e2b18"}
Sep 08 15:29:40.207846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.207763    2578 scope.go:117] "RemoveContainer" containerID="cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a"
Sep 08 15:29:40.218037 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.218017    2578 scope.go:117] "RemoveContainer" containerID="cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a"
Sep 08 15:29:40.218315 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:29:40.218296    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a\": container with ID starting with cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a not found: ID does not exist" containerID="cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a"
Sep 08 15:29:40.218436 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.218319    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a"} err="failed to get container status \"cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a\": rpc error: code = NotFound desc = could not find container \"cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a\": container with ID starting with cf69ea3bb6da65fc84dd6f405c4068e27fc9baf5f597c5c0e413ff14e389345a not found: ID does not exist"
Sep 08 15:29:40.224640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.224556    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"]
Sep 08 15:29:40.229054 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.229032    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-60b543/test-model-60b543-kserve-9b8676bd5-b5qzr"]
Sep 08 15:29:40.500749 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.500653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:40.622978 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.622949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:40.923297 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:40.923213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:41.829522 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:41.829488    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" path="/var/lib/kubelet/pods/2f9ceaa6-7ba4-4390-9069-5c2bf4699cae/volumes"
Sep 08 15:29:42.542662 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:42.542631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:42.643382 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:42.643351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:42.788428 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:42.788402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:43.253953 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:43.253922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:46.930589 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:46.930542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:47.030342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:47.030313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:47.370821 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:47.370786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:50.836228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:50.836177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:53.258392 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:53.258353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:54.010704 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:54.010657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:54.108277 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:54.108225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:54.369239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:54.369151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:54.474379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:54.474345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:57.486378 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:57.486344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:58.101045 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.101006    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"]
Sep 08 15:29:58.101339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.101311    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88" podUID="9e897253-2f23-4755-8de6-132f122a86be" containerName="maas-api" containerID="cri-o://07c6a0c98e61875e3907d7f67ef8c33cab6e614be3494347e67a509ed515a153" gracePeriod=30
Sep 08 15:29:58.130863 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.130833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:58.309031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.308999    2578 generic.go:356] "Generic (PLEG): container finished" podID="9e897253-2f23-4755-8de6-132f122a86be" containerID="07c6a0c98e61875e3907d7f67ef8c33cab6e614be3494347e67a509ed515a153" exitCode=0
Sep 08 15:29:58.309219 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.309069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88" event={"ID":"9e897253-2f23-4755-8de6-132f122a86be","Type":"ContainerDied","Data":"07c6a0c98e61875e3907d7f67ef8c33cab6e614be3494347e67a509ed515a153"}
Sep 08 15:29:58.350876 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.350849    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:58.425235 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.425159    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbbm8\" (UniqueName: \"kubernetes.io/projected/9e897253-2f23-4755-8de6-132f122a86be-kube-api-access-hbbm8\") pod \"9e897253-2f23-4755-8de6-132f122a86be\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") "
Sep 08 15:29:58.425381 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.425254    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-maas-api-tls\") pod \"9e897253-2f23-4755-8de6-132f122a86be\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") "
Sep 08 15:29:58.425381 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.425295    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-metrics-certs\") pod \"9e897253-2f23-4755-8de6-132f122a86be\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") "
Sep 08 15:29:58.425381 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.425340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e897253-2f23-4755-8de6-132f122a86be-openshift-service-ca\") pod \"9e897253-2f23-4755-8de6-132f122a86be\" (UID: \"9e897253-2f23-4755-8de6-132f122a86be\") "
Sep 08 15:29:58.425802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.425773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e897253-2f23-4755-8de6-132f122a86be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e897253-2f23-4755-8de6-132f122a86be" (UID: "9e897253-2f23-4755-8de6-132f122a86be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:58.427386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.427362    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e897253-2f23-4755-8de6-132f122a86be-kube-api-access-hbbm8" (OuterVolumeSpecName: "kube-api-access-hbbm8") pod "9e897253-2f23-4755-8de6-132f122a86be" (UID: "9e897253-2f23-4755-8de6-132f122a86be"). InnerVolumeSpecName "kube-api-access-hbbm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:58.427475 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.427389    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9e897253-2f23-4755-8de6-132f122a86be" (UID: "9e897253-2f23-4755-8de6-132f122a86be"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:29:58.427475 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.427425    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e897253-2f23-4755-8de6-132f122a86be" (UID: "9e897253-2f23-4755-8de6-132f122a86be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:29:58.527167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.527131    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.527167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.527159    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e897253-2f23-4755-8de6-132f122a86be-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.527167 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.527168    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e897253-2f23-4755-8de6-132f122a86be-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.527609 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.527178    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbbm8\" (UniqueName: \"kubernetes.io/projected/9e897253-2f23-4755-8de6-132f122a86be-kube-api-access-hbbm8\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.632257 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.632215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:58.731324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.731287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:58.831971 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:58.831937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:29:59.315829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:59.315796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88" event={"ID":"9e897253-2f23-4755-8de6-132f122a86be","Type":"ContainerDied","Data":"1a892894d07bbca99ab14a0c97e930e61c9915e411a35d6f9c0b6bae069e63ce"}
Sep 08 15:29:59.315829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:59.315816    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"
Sep 08 15:29:59.316057 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:59.315852    2578 scope.go:117] "RemoveContainer" containerID="07c6a0c98e61875e3907d7f67ef8c33cab6e614be3494347e67a509ed515a153"
Sep 08 15:29:59.337256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:59.337226    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"]
Sep 08 15:29:59.343116 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:59.343093    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8acdf03d-f8b5bcd4f-wxp88"]
Sep 08 15:29:59.828401 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:29:59.828370    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e897253-2f23-4755-8de6-132f122a86be" path="/var/lib/kubelet/pods/9e897253-2f23-4755-8de6-132f122a86be/volumes"
Sep 08 15:30:00.678282 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:00.678255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:00.799409 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:00.799355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:00.901141 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:00.901101    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"]
Sep 08 15:30:00.901640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:00.901308    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy" containerID="cri-o://3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a" gracePeriod=30
Sep 08 15:30:00.927766 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:00.927669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:01.744625 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:01.744560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:01.834919 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:01.834889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:02.004411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:02.004314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:04.893379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:04.893318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:05.102166 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:05.102126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:05.464816 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:05.464783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:05.565410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:05.565379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:05.697010 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:05.696976    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"]
Sep 08 15:30:05.697222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:05.697193    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" containerID="cri-o://8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe" gracePeriod=30
Sep 08 15:30:05.717250 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:05.717178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:06.018507 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.018462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:06.162879 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.162849    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:30:06.313121 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313046    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fdefae-5056-4db9-894d-613e6a92abc6-istio-podinfo\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313121 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-credential-socket\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313121 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-envoy\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313147    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-socket\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313168    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-istio-token\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-certs\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313226    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkmv5\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-kube-api-access-hkmv5\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313266    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-data\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fdefae-5056-4db9-894d-613e6a92abc6-istiod-ca-cert\") pod \"42fdefae-5056-4db9-894d-613e6a92abc6\" (UID: \"42fdefae-5056-4db9-894d-613e6a92abc6\") "
Sep 08 15:30:06.313720 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:06.313720 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313482    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:06.313720 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313519    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:06.313865 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-data" (OuterVolumeSpecName: "istio-data") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:06.313919 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313862    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.313919 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313863    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42fdefae-5056-4db9-894d-613e6a92abc6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:30:06.313919 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313879    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.313919 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313912    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.314064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.313927    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.315361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.315333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42fdefae-5056-4db9-894d-613e6a92abc6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:30:06.315517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.315496    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-kube-api-access-hkmv5" (OuterVolumeSpecName: "kube-api-access-hkmv5") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "kube-api-access-hkmv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:06.315823 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.315803    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-istio-token" (OuterVolumeSpecName: "istio-token") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:06.315823 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.315809    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42fdefae-5056-4db9-894d-613e6a92abc6" (UID: "42fdefae-5056-4db9-894d-613e6a92abc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:06.355513 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.355479    2578 generic.go:356] "Generic (PLEG): container finished" podID="42fdefae-5056-4db9-894d-613e6a92abc6" containerID="3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a" exitCode=0
Sep 08 15:30:06.355727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.355525    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"
Sep 08 15:30:06.355727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.355572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" event={"ID":"42fdefae-5056-4db9-894d-613e6a92abc6","Type":"ContainerDied","Data":"3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a"}
Sep 08 15:30:06.355727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.355648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq" event={"ID":"42fdefae-5056-4db9-894d-613e6a92abc6","Type":"ContainerDied","Data":"baea9e80f3420f3714b64d91050bbd993d37a1d694871665adcebeaddecf7b9e"}
Sep 08 15:30:06.355727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.355673    2578 scope.go:117] "RemoveContainer" containerID="3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a"
Sep 08 15:30:06.365439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.365418    2578 scope.go:117] "RemoveContainer" containerID="efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0"
Sep 08 15:30:06.374048 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.374028    2578 scope.go:117] "RemoveContainer" containerID="3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a"
Sep 08 15:30:06.374328 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:30:06.374308    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a\": container with ID starting with 3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a not found: ID does not exist" containerID="3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a"
Sep 08 15:30:06.374412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.374341    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a"} err="failed to get container status \"3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a\": rpc error: code = NotFound desc = could not find container \"3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a\": container with ID starting with 3f84f7477ba78c5fdaccde882a25418a62778c389a0a37adaf487e15fa838d7a not found: ID does not exist"
Sep 08 15:30:06.374412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.374364    2578 scope.go:117] "RemoveContainer" containerID="efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0"
Sep 08 15:30:06.374623 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:30:06.374605    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0\": container with ID starting with efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0 not found: ID does not exist" containerID="efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0"
Sep 08 15:30:06.374675 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.374629    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0"} err="failed to get container status \"efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0\": rpc error: code = NotFound desc = could not find container \"efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0\": container with ID starting with efa27e0a8bfaa3cadba096bf9e93caecad6900e6500f8ed23ebf76d53737c0e0 not found: ID does not exist"
Sep 08 15:30:06.383680 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.383651    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"]
Sep 08 15:30:06.385532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.385503    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq"]
Sep 08 15:30:06.414857 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.414827    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fdefae-5056-4db9-894d-613e6a92abc6-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.414857 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.414855    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fdefae-5056-4db9-894d-613e6a92abc6-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.414857 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.414864    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fdefae-5056-4db9-894d-613e6a92abc6-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.415133 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.414871    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.415133 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.414881    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkmv5\" (UniqueName: \"kubernetes.io/projected/42fdefae-5056-4db9-894d-613e6a92abc6-kube-api-access-hkmv5\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:06.505200 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.505165    2578 patch_prober.go:28] interesting pod/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:30:06.505383 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.505247    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:30:06.927448 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:06.927412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:07.013969 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:07.013936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:07.827423 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:07.827384    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" path="/var/lib/kubelet/pods/42fdefae-5056-4db9-894d-613e6a92abc6/volumes"
Sep 08 15:30:10.941710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:10.941687    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:30:11.059364 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059277    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-certs\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059364 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2272cb-9128-440a-b7f9-4200f6c967ec-istiod-ca-cert\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059364 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059350    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-socket\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059388    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qf79\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-kube-api-access-8qf79\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059424    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-token\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059440    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-credential-socket\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059469    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-podinfo\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059543    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-data\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.059681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059612    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:11.059681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059621    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-envoy\") pod \"0b2272cb-9128-440a-b7f9-4200f6c967ec\" (UID: \"0b2272cb-9128-440a-b7f9-4200f6c967ec\") "
Sep 08 15:30:11.060052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059752    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:11.060052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059811    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:11.060052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b2272cb-9128-440a-b7f9-4200f6c967ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:30:11.060052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.059934    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:11.060246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.060109    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.060246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.060128    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.060246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.060141    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2272cb-9128-440a-b7f9-4200f6c967ec-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.060246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.060154    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.060246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.060167    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.061761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.061738    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:11.061761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.061754    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:11.062057 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.062039    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:30:11.062110 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.062049    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-kube-api-access-8qf79" (OuterVolumeSpecName: "kube-api-access-8qf79") pod "0b2272cb-9128-440a-b7f9-4200f6c967ec" (UID: "0b2272cb-9128-440a-b7f9-4200f6c967ec"). InnerVolumeSpecName "kube-api-access-8qf79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:11.161640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.161608    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.161640 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.161639    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.161850 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.161653    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2272cb-9128-440a-b7f9-4200f6c967ec-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.161850 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.161664    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qf79\" (UniqueName: \"kubernetes.io/projected/0b2272cb-9128-440a-b7f9-4200f6c967ec-kube-api-access-8qf79\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:30:11.386069 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.385973    2578 generic.go:356] "Generic (PLEG): container finished" podID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerID="8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe" exitCode=0
Sep 08 15:30:11.386069 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.386016    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"
Sep 08 15:30:11.386069 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.386055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" event={"ID":"0b2272cb-9128-440a-b7f9-4200f6c967ec","Type":"ContainerDied","Data":"8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe"}
Sep 08 15:30:11.386344 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.386112    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm" event={"ID":"0b2272cb-9128-440a-b7f9-4200f6c967ec","Type":"ContainerDied","Data":"c1e20cea1d2b0b9f728d610507cf85e6f74a21a84c939a55b306eda1c257cfe9"}
Sep 08 15:30:11.386344 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.386136    2578 scope.go:117] "RemoveContainer" containerID="8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe"
Sep 08 15:30:11.395657 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.395637    2578 scope.go:117] "RemoveContainer" containerID="859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357"
Sep 08 15:30:11.403741 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.403722    2578 scope.go:117] "RemoveContainer" containerID="8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe"
Sep 08 15:30:11.404007 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:30:11.403989    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe\": container with ID starting with 8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe not found: ID does not exist" containerID="8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe"
Sep 08 15:30:11.404056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.404016    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe"} err="failed to get container status \"8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe\": rpc error: code = NotFound desc = could not find container \"8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe\": container with ID starting with 8978e41f316dc1e17cbcd25b4ed9ed337cd7b77c7977a53747a19ef6c14b2bbe not found: ID does not exist"
Sep 08 15:30:11.404056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.404033    2578 scope.go:117] "RemoveContainer" containerID="859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357"
Sep 08 15:30:11.404304 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:30:11.404286    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357\": container with ID starting with 859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357 not found: ID does not exist" containerID="859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357"
Sep 08 15:30:11.404359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.404313    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357"} err="failed to get container status \"859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357\": rpc error: code = NotFound desc = could not find container \"859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357\": container with ID starting with 859f15165b27c04ac8963cfe757d279248597c31223b44b8625326cc014e2357 not found: ID does not exist"
Sep 08 15:30:11.409193 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.409167    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"]
Sep 08 15:30:11.414608 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.414571    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm"]
Sep 08 15:30:11.828022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:11.827989    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" path="/var/lib/kubelet/pods/0b2272cb-9128-440a-b7f9-4200f6c967ec/volumes"
Sep 08 15:30:12.187118 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:12.187030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:12.289840 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:12.289799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:12.389856 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:12.389825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:12.551752 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:12.551711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:18.263682 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:18.263634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:18.321137 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:18.321105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:19.186291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.186256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:19.463625 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.463571    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"]
Sep 08 15:30:19.464111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464051    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy"
Sep 08 15:30:19.464111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464066    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy"
Sep 08 15:30:19.464111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464081    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" containerName="main"
Sep 08 15:30:19.464111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464089    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" containerName="main"
Sep 08 15:30:19.464111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464101    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy"
Sep 08 15:30:19.464111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464108    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy"
Sep 08 15:30:19.464111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464117    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce24ec0c-3f49-419b-9a29-09caca1ea869" containerName="maas-api"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464123    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce24ec0c-3f49-419b-9a29-09caca1ea869" containerName="maas-api"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464129    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464137    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464160    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464166    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464175    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e897253-2f23-4755-8de6-132f122a86be" containerName="maas-api"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464180    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e897253-2f23-4755-8de6-132f122a86be" containerName="maas-api"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464245    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464254    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce24ec0c-3f49-419b-9a29-09caca1ea869" containerName="maas-api"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464263    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="42fdefae-5056-4db9-894d-613e6a92abc6" containerName="istio-proxy"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464270    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e897253-2f23-4755-8de6-132f122a86be" containerName="maas-api"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464278    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464283    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f9ceaa6-7ba4-4390-9069-5c2bf4699cae" containerName="main"
Sep 08 15:30:19.464501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.464288    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2272cb-9128-440a-b7f9-4200f6c967ec" containerName="istio-proxy"
Sep 08 15:30:19.469323 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.469304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.471955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.471912    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-020a18-openshift-default-dockercfg-d7s85\""
Sep 08 15:30:19.482464 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.482435    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"]
Sep 08 15:30:19.516473 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.516400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:19.544379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-credential-socket\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319980fa-3656-45a5-b755-53d328583426-istio-podinfo\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-socket\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kpzd\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-kube-api-access-5kpzd\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-data\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319980fa-3656-45a5-b755-53d328583426-istiod-ca-cert\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-certs\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-istio-token\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.544798 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.544686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-envoy\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:19.645480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-socket\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kpzd\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-kube-api-access-5kpzd\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645642 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-data\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645642 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319980fa-3656-45a5-b755-53d328583426-istiod-ca-cert\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645642 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-certs\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645642 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-istio-token\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645896 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-envoy\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645896 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-credential-socket\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645896 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-socket\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.645896 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319980fa-3656-45a5-b755-53d328583426-istio-podinfo\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.646099 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-certs\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.646099 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.645983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-data\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.646212 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.646147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-credential-socket\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.646355 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.646327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319980fa-3656-45a5-b755-53d328583426-istiod-ca-cert\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.648027 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.647994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-envoy\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.648258 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.648239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319980fa-3656-45a5-b755-53d328583426-istio-podinfo\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.654602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.654565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-istio-token\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.654808 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.654790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kpzd\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-kube-api-access-5kpzd\") pod \"e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") " pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:19.781157 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:19.781068    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:20.057501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.057472    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"]
Sep 08 15:30:20.059848 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:30:20.059821    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319980fa_3656_45a5_b755_53d328583426.slice/crio-40e5fc5fce5d00caa6f0829296c19bb23f56cf492f3da901f47aaf77979a29cd WatchSource:0}: Error finding container 40e5fc5fce5d00caa6f0829296c19bb23f56cf492f3da901f47aaf77979a29cd: Status 404 returned error can't find the container with id 40e5fc5fce5d00caa6f0829296c19bb23f56cf492f3da901f47aaf77979a29cd
Sep 08 15:30:20.062310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.062271    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:20.062410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.062356    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:20.062410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.062399    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:20.437958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.437864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" event={"ID":"319980fa-3656-45a5-b755-53d328583426","Type":"ContainerStarted","Data":"8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab"}
Sep 08 15:30:20.437958 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.437915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" event={"ID":"319980fa-3656-45a5-b755-53d328583426","Type":"ContainerStarted","Data":"40e5fc5fce5d00caa6f0829296c19bb23f56cf492f3da901f47aaf77979a29cd"}
Sep 08 15:30:20.462207 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.462146    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podStartSLOduration=1.46212695 podStartE2EDuration="1.46212695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:20.458489012 +0000 UTC m=+1041.117650360" watchObservedRunningTime="2026-09-08 15:30:20.46212695 +0000 UTC m=+1041.121288078"
Sep 08 15:30:20.781959 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:20.781925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:21.786310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:21.786278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:22.368152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:22.368117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:22.447693 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:22.447655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:22.448853 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:22.448832    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:22.466219 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:22.466188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:23.573213 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.573166    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"]
Sep 08 15:30:23.577311 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.577287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.580431 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.580412    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-020a18-serving-cert\""
Sep 08 15:30:23.590518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.590492    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"]
Sep 08 15:30:23.645877 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.645844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:23.687311 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.687271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40dbc077-cfec-4966-b591-f236f17830c1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.687511 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.687344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.687511 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.687483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.687668 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.687539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp54s\" (UniqueName: \"kubernetes.io/projected/40dbc077-cfec-4966-b591-f236f17830c1-kube-api-access-bp54s\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.781946 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.781908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:23.789208 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.789182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.789285 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.789246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.789285 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.789271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp54s\" (UniqueName: \"kubernetes.io/projected/40dbc077-cfec-4966-b591-f236f17830c1-kube-api-access-bp54s\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.789374 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.789316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40dbc077-cfec-4966-b591-f236f17830c1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.789374 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:30:23.789336    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-serving-cert: secret "maas-api-e2e-shared-a-w2-020a18-serving-cert" not found
Sep 08 15:30:23.789454 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:30:23.789401    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls podName:40dbc077-cfec-4966-b591-f236f17830c1 nodeName:}" failed. No retries permitted until 2026-09-08 15:30:24.289384688 +0000 UTC m=+1044.948545797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls") pod "maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb" (UID: "40dbc077-cfec-4966-b591-f236f17830c1") : secret "maas-api-e2e-shared-a-w2-020a18-serving-cert" not found
Sep 08 15:30:23.789996 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.789974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40dbc077-cfec-4966-b591-f236f17830c1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.791791 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.791773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.800035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.800014    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp54s\" (UniqueName: \"kubernetes.io/projected/40dbc077-cfec-4966-b591-f236f17830c1-kube-api-access-bp54s\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:23.895926 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:23.895842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:24.217473 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:24.217441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:24.294858 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:24.294816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:24.297304 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:24.297272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:24.338379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:24.338351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:24.490691 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:24.490569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:24.777313 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:24.777287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"]
Sep 08 15:30:24.779214 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:30:24.779191    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40dbc077_cfec_4966_b591_f236f17830c1.slice/crio-ee8eabe2af680f96d56ba0ac54df17da2d191cce0a77f65b864be99f4caf8ae1 WatchSource:0}: Error finding container ee8eabe2af680f96d56ba0ac54df17da2d191cce0a77f65b864be99f4caf8ae1: Status 404 returned error can't find the container with id ee8eabe2af680f96d56ba0ac54df17da2d191cce0a77f65b864be99f4caf8ae1
Sep 08 15:30:25.468606 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:25.468555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb" event={"ID":"40dbc077-cfec-4966-b591-f236f17830c1","Type":"ContainerStarted","Data":"ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec"}
Sep 08 15:30:25.468782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:25.468627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb" event={"ID":"40dbc077-cfec-4966-b591-f236f17830c1","Type":"ContainerStarted","Data":"ee8eabe2af680f96d56ba0ac54df17da2d191cce0a77f65b864be99f4caf8ae1"}
Sep 08 15:30:25.468782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:25.468751    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:25.489324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:25.489226    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb" podStartSLOduration=2.040191628 podStartE2EDuration="2.489209561s" totalImagesPullingTime="449.017933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:25.487192285 +0000 UTC m=+1046.146353412" watchObservedRunningTime="2026-09-08 15:30:25.489209561 +0000 UTC m=+1046.148370687"
Sep 08 15:30:27.177490 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:27.177457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:29.791817 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:29.791781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:30.075134 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.075033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:30.345377 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.345302    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"]
Sep 08 15:30:30.348742 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.348695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.351199 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.351176    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-565cd7-openshift-default-dockercfg-4brvb\""
Sep 08 15:30:30.371117 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.371034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"]
Sep 08 15:30:30.390214 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.390161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-socket\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-certs\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-credential-socket\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-data\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-podinfo\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5f7e67-30dd-44af-884f-712d5a5c701e-istiod-ca-cert\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7m88\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-kube-api-access-k7m88\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-envoy\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.471605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.469608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-token\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.570510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.570462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-token\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.570915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.570887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-socket\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.571039 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.570984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-certs\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.571109 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.571070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-credential-socket\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.571168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.571107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-data\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.571168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.571133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-podinfo\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.571168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.571163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5f7e67-30dd-44af-884f-712d5a5c701e-istiod-ca-cert\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.571339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.571225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7m88\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-kube-api-access-k7m88\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.571339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.571280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-envoy\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.573411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.572504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5f7e67-30dd-44af-884f-712d5a5c701e-istiod-ca-cert\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.573411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.572735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-certs\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.573411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.572813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-data\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.573411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.572864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-socket\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.573411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.573352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-credential-socket\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.575419 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.575394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-envoy\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.579114 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.579091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-podinfo\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.581147 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.581081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:30.584400 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.584350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-token\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.585123 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.585080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7m88\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-kube-api-access-k7m88\") pod \"e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") " pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.670606 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.670233    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:30.978627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.973381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"]
Sep 08 15:30:30.990615 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:30:30.986308    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5f7e67_30dd_44af_884f_712d5a5c701e.slice/crio-85b7ea12b385317c76cabfcd384a4a79ef6966865a81dcd97cd79f65e9806b24 WatchSource:0}: Error finding container 85b7ea12b385317c76cabfcd384a4a79ef6966865a81dcd97cd79f65e9806b24: Status 404 returned error can't find the container with id 85b7ea12b385317c76cabfcd384a4a79ef6966865a81dcd97cd79f65e9806b24
Sep 08 15:30:30.991203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.991163    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:30.991319 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.991253    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:30.991319 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:30.991293    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:31.492774 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:31.492742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:30:31.502798 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:31.502763    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" event={"ID":"1d5f7e67-30dd-44af-884f-712d5a5c701e","Type":"ContainerStarted","Data":"d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38"}
Sep 08 15:30:31.502948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:31.502827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" event={"ID":"1d5f7e67-30dd-44af-884f-712d5a5c701e","Type":"ContainerStarted","Data":"85b7ea12b385317c76cabfcd384a4a79ef6966865a81dcd97cd79f65e9806b24"}
Sep 08 15:30:31.528136 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:31.528072    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podStartSLOduration=1.5280527369999999 podStartE2EDuration="1.528052737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:31.52484777 +0000 UTC m=+1052.184008897" watchObservedRunningTime="2026-09-08 15:30:31.528052737 +0000 UTC m=+1052.187213864"
Sep 08 15:30:31.671365 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:31.671279    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:32.687255 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:32.687207    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:33.446145 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:33.446109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:33.513397 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:33.513369    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:33.514460 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:33.514436    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:33.544300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:33.544269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:34.742684 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.742648    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"]
Sep 08 15:30:34.747162 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.747141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.750615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.750571    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-565cd7-serving-cert\""
Sep 08 15:30:34.792741 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.792706    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"]
Sep 08 15:30:34.792907 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.792870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:34.830396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.830358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxfk\" (UniqueName: \"kubernetes.io/projected/3cac84fa-5bd0-4ad6-bd40-1038009e5118-kube-api-access-xxxfk\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.830611 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.830420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac84fa-5bd0-4ad6-bd40-1038009e5118-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.830611 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.830444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.830611 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.830484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.889480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.889439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:34.931839 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.931801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxfk\" (UniqueName: \"kubernetes.io/projected/3cac84fa-5bd0-4ad6-bd40-1038009e5118-kube-api-access-xxxfk\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.932008 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.931862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac84fa-5bd0-4ad6-bd40-1038009e5118-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.932008 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.931889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.932008 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.931940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.932623 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.932569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac84fa-5bd0-4ad6-bd40-1038009e5118-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.934375 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.934353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.934513 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.934417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.940743 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.940725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxfk\" (UniqueName: \"kubernetes.io/projected/3cac84fa-5bd0-4ad6-bd40-1038009e5118-kube-api-access-xxxfk\") pod \"maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:34.995664 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:34.995546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:35.080751 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:35.080717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:35.367182 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:35.367063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"]
Sep 08 15:30:35.451789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:35.451746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:35.525362 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:35.525326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c" event={"ID":"3cac84fa-5bd0-4ad6-bd40-1038009e5118","Type":"ContainerStarted","Data":"4c0c45e45defbbe59fbfd878f2ea01fc7d969a428662646a020344a4782f088b"}
Sep 08 15:30:35.552595 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:35.552553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:36.533471 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:36.533432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c" event={"ID":"3cac84fa-5bd0-4ad6-bd40-1038009e5118","Type":"ContainerStarted","Data":"60bba9562cc5aff8dbf89a2825ce5d66a22860d967081b2808ba19a8fa13395c"}
Sep 08 15:30:36.533983 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:36.533573    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:36.559887 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:36.559773    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c" podStartSLOduration=1.644494344 podStartE2EDuration="2.559751527s" totalImagesPullingTime="915.257183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:36.556525738 +0000 UTC m=+1057.215686867" watchObservedRunningTime="2026-09-08 15:30:36.559751527 +0000 UTC m=+1057.218912655"
Sep 08 15:30:38.489808 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:38.489757    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:30:38.490293 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:38.489844    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:30:39.553836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:39.553802    2578 generic.go:356] "Generic (PLEG): container finished" podID="319980fa-3656-45a5-b755-53d328583426" containerID="8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab" exitCode=0
Sep 08 15:30:39.554354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:39.553877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" event={"ID":"319980fa-3656-45a5-b755-53d328583426","Type":"ContainerDied","Data":"8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab"}
Sep 08 15:30:39.554458 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:39.554441    2578 scope.go:117] "RemoveContainer" containerID="8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab"
Sep 08 15:30:39.555571 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:39.555538    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:39.555679 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:39.555630    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:39.555679 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:39.555663    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:40.563106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:40.563064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" event={"ID":"319980fa-3656-45a5-b755-53d328583426","Type":"ContainerStarted","Data":"dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08"}
Sep 08 15:30:40.782376 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:40.782331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:40.782606 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:40.782475    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:30:40.782606 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:40.782523    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 15:30:41.782501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:41.782460    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:30:41.783133 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:41.783102    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 15:30:42.545947 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:42.545918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:30:42.782547 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:42.782496    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:30:42.783069 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:42.782572    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 15:30:43.781891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:43.781841    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:30:43.782117 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:43.781917    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 15:30:44.782255 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:44.782203    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:30:44.782771 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:44.782281    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 15:30:45.781688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:45.781646    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:30:45.782001 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:45.781971    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 15:30:45.926350 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:45.926312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:46.787175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:46.787142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:46.787540 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:46.787516    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:46.788215 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:46.788199    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:30:47.401692 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:47.401603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:47.699934 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:47.699891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:48.040026 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:48.039932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:48.646104 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:48.646067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:49.554742 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:49.554697    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:30:49.554947 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:49.554775    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:30:50.635736 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:50.635648    2578 generic.go:356] "Generic (PLEG): container finished" podID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerID="d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38" exitCode=0
Sep 08 15:30:50.635736 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:50.635686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" event={"ID":"1d5f7e67-30dd-44af-884f-712d5a5c701e","Type":"ContainerDied","Data":"d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38"}
Sep 08 15:30:50.636171 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:50.636093    2578 scope.go:117] "RemoveContainer" containerID="d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38"
Sep 08 15:30:50.637264 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:50.637234    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:50.637319 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:50.637308    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:50.637356 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:50.637339    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:30:51.141728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:51.141689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:51.220214 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:51.220181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:51.643299 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:51.643262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" event={"ID":"1d5f7e67-30dd-44af-884f-712d5a5c701e","Type":"ContainerStarted","Data":"78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4"}
Sep 08 15:30:51.671355 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:51.671256    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:51.671592 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:51.671549    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:30:51.671825 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:51.671795    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 15:30:52.256948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.256868    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"]
Sep 08 15:30:52.260548 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.260521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.289925 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.284469    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-d62b4e-serving-cert\""
Sep 08 15:30:52.289925 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.289004    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"]
Sep 08 15:30:52.297638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.297599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:52.327467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.327428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.327672 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.327483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.327672 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.327594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.327781 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.327738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2fw\" (UniqueName: \"kubernetes.io/projected/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-kube-api-access-2n2fw\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.397356 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.397318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:52.428760 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.428717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2fw\" (UniqueName: \"kubernetes.io/projected/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-kube-api-access-2n2fw\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.428949 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.428819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.428949 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.428856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.428949 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.428902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.429571 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.429546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.431319 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.431296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.431412 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.431377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.441894 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.441835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2fw\" (UniqueName: \"kubernetes.io/projected/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-kube-api-access-2n2fw\") pod \"maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.499979 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.499944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:52.600320 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.600213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:52.673187 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.672713    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:30:52.673187 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.672775    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 15:30:52.880022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.879572    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"]
Sep 08 15:30:52.885649 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:30:52.883570    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd42cd64_3cd1_4ac9_98dc_f6bf11671a60.slice/crio-bd6f52f0b82995faf5515c2ac8326df082d8e5241c88103615a469f473b8a24e WatchSource:0}: Error finding container bd6f52f0b82995faf5515c2ac8326df082d8e5241c88103615a469f473b8a24e: Status 404 returned error can't find the container with id bd6f52f0b82995faf5515c2ac8326df082d8e5241c88103615a469f473b8a24e
Sep 08 15:30:52.949840 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:52.949794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:53.047810 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:53.047781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:53.657264 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:53.657176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs" event={"ID":"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60","Type":"ContainerStarted","Data":"88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b"}
Sep 08 15:30:53.657450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:53.657274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs" event={"ID":"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60","Type":"ContainerStarted","Data":"bd6f52f0b82995faf5515c2ac8326df082d8e5241c88103615a469f473b8a24e"}
Sep 08 15:30:53.657450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:53.657313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:30:53.671540 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:53.671136    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:30:53.671540 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:53.671197    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 15:30:54.671639 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:54.671574    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:30:54.672147 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:54.671663    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 15:30:55.670653 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:55.670614    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:30:55.670872 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:55.670677    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 15:30:56.671421 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:56.671376    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:30:56.672058 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:56.672025    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 15:30:57.313466 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:57.313430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:30:57.674628 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:57.674532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:57.675029 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:57.674815    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:57.675482 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:57.675467    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:30:57.715336 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:57.715281    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs" podStartSLOduration=5.213991922 podStartE2EDuration="5.715262444s" totalImagesPullingTime="501.270522ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:53.680889178 +0000 UTC m=+1074.340050306" watchObservedRunningTime="2026-09-08 15:30:57.715262444 +0000 UTC m=+1078.374423571"
Sep 08 15:30:59.672937 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:30:59.672903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:31:03.535811 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:03.535778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:13.471841 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:13.471802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:14.383423 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:14.383392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:16.048556 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:16.048515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:20.568773 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:20.568736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:29.559013 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:29.558970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:30.045360 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:30.045297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:30.191916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:30.191878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:33.537688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:33.537647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:33.727724 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:33.727675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:34.750153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.750117    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"]
Sep 08 15:31:34.754437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.754414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.759422 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.759398    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-26dbe7df-serving-cert\""
Sep 08 15:31:34.766454 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.766429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"]
Sep 08 15:31:34.791549 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.791521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:34.869078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.869049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:34.887422 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.887396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9sm7\" (UniqueName: \"kubernetes.io/projected/6d556693-182c-4f9c-b429-7a36922f5983-kube-api-access-t9sm7\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.887602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.887483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-metrics-certs\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.887602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.887514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-maas-api-tls\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.887602 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.887538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d556693-182c-4f9c-b429-7a36922f5983-openshift-service-ca\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.989254 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.989218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-metrics-certs\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.989254 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.989266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-maas-api-tls\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.989496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.989288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d556693-182c-4f9c-b429-7a36922f5983-openshift-service-ca\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.989496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.989379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9sm7\" (UniqueName: \"kubernetes.io/projected/6d556693-182c-4f9c-b429-7a36922f5983-kube-api-access-t9sm7\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.990014 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.989985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d556693-182c-4f9c-b429-7a36922f5983-openshift-service-ca\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.991767 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.991734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-maas-api-tls\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.991870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.991800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-metrics-certs\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:34.998278 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:34.998256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9sm7\" (UniqueName: \"kubernetes.io/projected/6d556693-182c-4f9c-b429-7a36922f5983-kube-api-access-t9sm7\") pod \"maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:35.035056 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.034966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:35.067148 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.067114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:35.359821 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.359797    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"]
Sep 08 15:31:35.362327 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:31:35.362294    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d556693_182c_4f9c_b429_7a36922f5983.slice/crio-4bcea73e4e55640dbd5bdaebb6bc10b83ba169226d7d7c542dc832eec76a3dfd WatchSource:0}: Error finding container 4bcea73e4e55640dbd5bdaebb6bc10b83ba169226d7d7c542dc832eec76a3dfd: Status 404 returned error can't find the container with id 4bcea73e4e55640dbd5bdaebb6bc10b83ba169226d7d7c542dc832eec76a3dfd
Sep 08 15:31:35.405339 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.405312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:35.508535 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.508493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:35.910827 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.910790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw" event={"ID":"6d556693-182c-4f9c-b429-7a36922f5983","Type":"ContainerStarted","Data":"a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812"}
Sep 08 15:31:35.911293 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.910855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw" event={"ID":"6d556693-182c-4f9c-b429-7a36922f5983","Type":"ContainerStarted","Data":"4bcea73e4e55640dbd5bdaebb6bc10b83ba169226d7d7c542dc832eec76a3dfd"}
Sep 08 15:31:35.911293 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.910977    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:35.932487 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:35.932435    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw" podStartSLOduration=1.469678934 podStartE2EDuration="1.932419663s" totalImagesPullingTime="462.740729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:35.930432573 +0000 UTC m=+1116.589593711" watchObservedRunningTime="2026-09-08 15:31:35.932419663 +0000 UTC m=+1116.591580789"
Sep 08 15:31:39.586138 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:39.586105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:31:41.921566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:41.921534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:31:58.467051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:31:58.467018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:20.853835 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:32:20.853799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:25.067631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:32:25.067520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:57.496623 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:32:57.496556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:57.597442 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:32:57.597403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:04.237700 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:04.237656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:19.547244 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.547199    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"]
Sep 08 15:33:19.547755 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.547482    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw" podUID="6d556693-182c-4f9c-b429-7a36922f5983" containerName="maas-api" containerID="cri-o://a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812" gracePeriod=30
Sep 08 15:33:19.577354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.577325    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:19.817446 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.817419    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:33:19.905379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.905331    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9sm7\" (UniqueName: \"kubernetes.io/projected/6d556693-182c-4f9c-b429-7a36922f5983-kube-api-access-t9sm7\") pod \"6d556693-182c-4f9c-b429-7a36922f5983\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") "
Sep 08 15:33:19.905567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.905436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-metrics-certs\") pod \"6d556693-182c-4f9c-b429-7a36922f5983\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") "
Sep 08 15:33:19.905567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.905485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d556693-182c-4f9c-b429-7a36922f5983-openshift-service-ca\") pod \"6d556693-182c-4f9c-b429-7a36922f5983\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") "
Sep 08 15:33:19.905567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.905539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-maas-api-tls\") pod \"6d556693-182c-4f9c-b429-7a36922f5983\" (UID: \"6d556693-182c-4f9c-b429-7a36922f5983\") "
Sep 08 15:33:19.905914 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.905859    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d556693-182c-4f9c-b429-7a36922f5983-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d556693-182c-4f9c-b429-7a36922f5983" (UID: "6d556693-182c-4f9c-b429-7a36922f5983"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:33:19.906320 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.906102    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d556693-182c-4f9c-b429-7a36922f5983-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:33:19.907573 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.907545    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6d556693-182c-4f9c-b429-7a36922f5983" (UID: "6d556693-182c-4f9c-b429-7a36922f5983"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:33:19.907573 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.907573    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d556693-182c-4f9c-b429-7a36922f5983-kube-api-access-t9sm7" (OuterVolumeSpecName: "kube-api-access-t9sm7") pod "6d556693-182c-4f9c-b429-7a36922f5983" (UID: "6d556693-182c-4f9c-b429-7a36922f5983"). InnerVolumeSpecName "kube-api-access-t9sm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:19.907831 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:19.907681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d556693-182c-4f9c-b429-7a36922f5983" (UID: "6d556693-182c-4f9c-b429-7a36922f5983"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:33:20.007280 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.007241    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:33:20.007280 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.007275    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9sm7\" (UniqueName: \"kubernetes.io/projected/6d556693-182c-4f9c-b429-7a36922f5983-kube-api-access-t9sm7\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:33:20.007280 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.007285    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d556693-182c-4f9c-b429-7a36922f5983-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:33:20.494500 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.494463    2578 generic.go:356] "Generic (PLEG): container finished" podID="6d556693-182c-4f9c-b429-7a36922f5983" containerID="a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812" exitCode=0
Sep 08 15:33:20.494698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.494505    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"
Sep 08 15:33:20.494698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.494547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw" event={"ID":"6d556693-182c-4f9c-b429-7a36922f5983","Type":"ContainerDied","Data":"a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812"}
Sep 08 15:33:20.494698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.494619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw" event={"ID":"6d556693-182c-4f9c-b429-7a36922f5983","Type":"ContainerDied","Data":"4bcea73e4e55640dbd5bdaebb6bc10b83ba169226d7d7c542dc832eec76a3dfd"}
Sep 08 15:33:20.494698 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.494637    2578 scope.go:117] "RemoveContainer" containerID="a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812"
Sep 08 15:33:20.505023 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.505003    2578 scope.go:117] "RemoveContainer" containerID="a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812"
Sep 08 15:33:20.505312 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:33:20.505294    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812\": container with ID starting with a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812 not found: ID does not exist" containerID="a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812"
Sep 08 15:33:20.505359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.505321    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812"} err="failed to get container status \"a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812\": rpc error: code = NotFound desc = could not find container \"a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812\": container with ID starting with a516cfca0a15cde25f98012d490affb3d7df57bc13aab1e27eeaed7ef6863812 not found: ID does not exist"
Sep 08 15:33:20.516550 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.516523    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"]
Sep 08 15:33:20.520006 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:20.519981    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-26dbe7df-57d9cc7b54-l7dzw"]
Sep 08 15:33:21.525782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:21.525743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:21.828319 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:21.828235    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d556693-182c-4f9c-b429-7a36922f5983" path="/var/lib/kubelet/pods/6d556693-182c-4f9c-b429-7a36922f5983/volumes"
Sep 08 15:33:22.993939 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:22.993865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:28.068708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:28.068669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:47.677246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:47.677207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:48.624005 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:48.623971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:52.838558 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:52.838477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:53.400638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:53.400545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:58.994899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:33:58.994864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:03.412701 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:03.412657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:07.737383 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:07.737348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:07.801113 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:07.801074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:13.241372 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:13.241339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:13.341678 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:13.341638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:13.522924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:13.522833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:14.778984 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:14.778948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:14.879023 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:14.878957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:14.979878 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:14.979839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:15.614202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:15.614133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:15.710353 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:15.710313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:15.807273 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:15.807242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:17.069427 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:17.069390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:22.823739 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:22.823704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:22.885707 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:22.885674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:23.471716 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:23.471681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:29.484294 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:29.484260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:29.557083 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:29.557050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:29.648074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:29.648039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:29.749318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:29.749238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:31.541064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:31.541022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:31.672318 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:31.672269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:40.203310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:40.203277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:40.439471 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:40.439438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:52.376748 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:52.376704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:54.685058 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:34:54.685000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:01.357363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:01.357330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:07.061002 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.060962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:07.143244 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.143209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:07.414794 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.414704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:07.708920 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.708886    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"]
Sep 08 15:35:07.709381 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.709368    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d556693-182c-4f9c-b429-7a36922f5983" containerName="maas-api"
Sep 08 15:35:07.709426 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.709383    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d556693-182c-4f9c-b429-7a36922f5983" containerName="maas-api"
Sep 08 15:35:07.709482 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.709473    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d556693-182c-4f9c-b429-7a36922f5983" containerName="maas-api"
Sep 08 15:35:07.712783 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.712762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.715447 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.715426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-08794c-openshift-default-dockercfg-l6wvd\""
Sep 08 15:35:07.727189 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.727160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"]
Sep 08 15:35:07.741989 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.741964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:07.840079 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-certs\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840261 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-socket\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840261 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-istio-token\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840261 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-data\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31887229-399b-4388-9a1b-fdc02c50a513-istiod-ca-cert\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-credential-socket\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph8cg\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-kube-api-access-ph8cg\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840386 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-envoy\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.840530 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.840393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31887229-399b-4388-9a1b-fdc02c50a513-istio-podinfo\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.841986 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.841962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:07.941716 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.941680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-certs\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.941924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.941826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-socket\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.941993 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.941963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-istio-token\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942075 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-data\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31887229-399b-4388-9a1b-fdc02c50a513-istiod-ca-cert\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-credential-socket\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942246 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-socket\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph8cg\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-kube-api-access-ph8cg\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-certs\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-envoy\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-data\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31887229-399b-4388-9a1b-fdc02c50a513-istio-podinfo\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942613 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-credential-socket\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.942870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.942846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31887229-399b-4388-9a1b-fdc02c50a513-istiod-ca-cert\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.944611 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.944590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-envoy\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.944797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.944782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31887229-399b-4388-9a1b-fdc02c50a513-istio-podinfo\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.951140 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.951118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph8cg\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-kube-api-access-ph8cg\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:07.951317 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:07.951298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-istio-token\") pod \"e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") " pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:08.023358 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:08.023280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:08.304367 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:08.304340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"]
Sep 08 15:35:08.306287 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:35:08.306261    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31887229_399b_4388_9a1b_fdc02c50a513.slice/crio-da56b072a7fa4a4b57b78587bb4c6af60c76e6b811406943b192a53850d208a8 WatchSource:0}: Error finding container da56b072a7fa4a4b57b78587bb4c6af60c76e6b811406943b192a53850d208a8: Status 404 returned error can't find the container with id da56b072a7fa4a4b57b78587bb4c6af60c76e6b811406943b192a53850d208a8
Sep 08 15:35:08.308667 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:08.308622    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:35:08.308761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:08.308724    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:35:08.308797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:08.308768    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:35:09.078594 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:09.078543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" event={"ID":"31887229-399b-4388-9a1b-fdc02c50a513","Type":"ContainerStarted","Data":"e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06"}
Sep 08 15:35:09.078806 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:09.078619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" event={"ID":"31887229-399b-4388-9a1b-fdc02c50a513","Type":"ContainerStarted","Data":"da56b072a7fa4a4b57b78587bb4c6af60c76e6b811406943b192a53850d208a8"}
Sep 08 15:35:09.100824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:09.100764    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" podStartSLOduration=2.10074266 podStartE2EDuration="2.10074266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:09.099976526 +0000 UTC m=+1329.759137662" watchObservedRunningTime="2026-09-08 15:35:09.10074266 +0000 UTC m=+1329.759903789"
Sep 08 15:35:10.023501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:10.023462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:10.028098 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:10.028074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:10.084173 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:10.084137    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:10.085550 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:10.085530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:11.015677 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:11.015642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:11.112433 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:11.112400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:12.229228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.229191    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"]
Sep 08 15:35:12.234513 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.234457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.241035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.241008    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-08794c-serving-cert\""
Sep 08 15:35:12.244248 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.244218    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"]
Sep 08 15:35:12.265638 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.265608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:12.288094 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.288061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-maas-api-tls\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.288256 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.288101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-metrics-certs\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.288304 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.288259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08fa2d-5abb-48c1-9a88-3f2e31358296-openshift-service-ca\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.288342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.288303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpl7k\" (UniqueName: \"kubernetes.io/projected/0d08fa2d-5abb-48c1-9a88-3f2e31358296-kube-api-access-qpl7k\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.328716 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.328686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:12.389449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.389421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-metrics-certs\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.389661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.389529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08fa2d-5abb-48c1-9a88-3f2e31358296-openshift-service-ca\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.389661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.389558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl7k\" (UniqueName: \"kubernetes.io/projected/0d08fa2d-5abb-48c1-9a88-3f2e31358296-kube-api-access-qpl7k\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.389661 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.389653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-maas-api-tls\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.390290 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.390264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08fa2d-5abb-48c1-9a88-3f2e31358296-openshift-service-ca\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.391873 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.391853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-metrics-certs\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.391972 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.391955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-maas-api-tls\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.397596 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.397558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpl7k\" (UniqueName: \"kubernetes.io/projected/0d08fa2d-5abb-48c1-9a88-3f2e31358296-kube-api-access-qpl7k\") pod \"maas-api-e2e-api-a-08794c-54c4c48498-4kgxw\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.557171 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.557095    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:12.839827 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.839722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:12.840531 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.840455    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"]
Sep 08 15:35:12.847627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.847600    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:35:12.938828 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:12.938790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:13.104691 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:13.104542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw" event={"ID":"0d08fa2d-5abb-48c1-9a88-3f2e31358296","Type":"ContainerStarted","Data":"52b08800a1172fada5b681f088a490baf77b144530a987be2dac0f605c47b14a"}
Sep 08 15:35:14.111478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:14.111437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw" event={"ID":"0d08fa2d-5abb-48c1-9a88-3f2e31358296","Type":"ContainerStarted","Data":"6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10"}
Sep 08 15:35:14.111922 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:14.111539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:14.129621 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:14.129558    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw" podStartSLOduration=1.3588005220000001 podStartE2EDuration="2.129540116s" totalImagesPullingTime="770.739594ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:14.128305549 +0000 UTC m=+1334.787466680" watchObservedRunningTime="2026-09-08 15:35:14.129540116 +0000 UTC m=+1334.788701244"
Sep 08 15:35:20.122012 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:20.121979    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:35:27.961689 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:27.961603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:31.228327 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:31.228292    2578 generic.go:356] "Generic (PLEG): container finished" podID="31887229-399b-4388-9a1b-fdc02c50a513" containerID="e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06" exitCode=0
Sep 08 15:35:31.228907 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:31.228370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" event={"ID":"31887229-399b-4388-9a1b-fdc02c50a513","Type":"ContainerDied","Data":"e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06"}
Sep 08 15:35:31.229032 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:31.229013    2578 scope.go:117] "RemoveContainer" containerID="e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06"
Sep 08 15:35:31.230226 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:31.230198    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:35:31.230287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:31.230268    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:35:31.230328 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:31.230302    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:35:32.235731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:32.235695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" event={"ID":"31887229-399b-4388-9a1b-fdc02c50a513","Type":"ContainerStarted","Data":"b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf"}
Sep 08 15:35:33.023829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:33.023789    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:33.024038 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:33.023953    2578 patch_prober.go:28] interesting pod/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:35:33.024038 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:33.024007    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 15:35:34.024631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:34.024566    2578 patch_prober.go:28] interesting pod/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:35:34.025031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:34.024682    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 15:35:34.195245 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:34.195206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:35.024022 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:35.023985    2578 patch_prober.go:28] interesting pod/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:35:35.024204 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:35.024042    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 15:35:35.948790 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:35.948753    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:36.024620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:36.024567    2578 patch_prober.go:28] interesting pod/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:35:36.024788 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:36.024650    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 15:35:36.404817 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:36.404726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:36.715326 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:36.715297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:36.905202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:36.905155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:37.024530 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:37.024440    2578 patch_prober.go:28] interesting pod/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:35:37.024530 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:37.024501    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 15:35:38.028324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:38.028293    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:38.028855 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:38.028799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:38.029726 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:38.029705    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:35:39.587391 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:39.587355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:39.678130 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:39.678100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:40.811835 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:40.811794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:40.916333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:40.916299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:41.009952 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:41.009912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:41.322252 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:41.322218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:41.418232 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:41.418199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:46.920595 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:46.920549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:49.529179 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:49.529147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:50.429830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:50.429796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:58.561325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:35:58.561239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:01.755556 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:01.755518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:03.840226 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:03.840192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:04.534496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:04.534456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:07.561278 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:07.561242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:14.267936 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:14.267888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:17.581439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:17.581402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:23.191913 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.191879    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"]
Sep 08 15:36:23.192391 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.192086    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw" podUID="0d08fa2d-5abb-48c1-9a88-3f2e31358296" containerName="maas-api" containerID="cri-o://6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10" gracePeriod=30
Sep 08 15:36:23.242179 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.242129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:23.451359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.451335    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:36:23.534134 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.534103    2578 generic.go:356] "Generic (PLEG): container finished" podID="0d08fa2d-5abb-48c1-9a88-3f2e31358296" containerID="6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10" exitCode=0
Sep 08 15:36:23.534300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.534152    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"
Sep 08 15:36:23.534300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.534163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw" event={"ID":"0d08fa2d-5abb-48c1-9a88-3f2e31358296","Type":"ContainerDied","Data":"6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10"}
Sep 08 15:36:23.534300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.534207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw" event={"ID":"0d08fa2d-5abb-48c1-9a88-3f2e31358296","Type":"ContainerDied","Data":"52b08800a1172fada5b681f088a490baf77b144530a987be2dac0f605c47b14a"}
Sep 08 15:36:23.534300 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.534230    2578 scope.go:117] "RemoveContainer" containerID="6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10"
Sep 08 15:36:23.546605 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.546561    2578 scope.go:117] "RemoveContainer" containerID="6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10"
Sep 08 15:36:23.547112 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:36:23.547076    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10\": container with ID starting with 6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10 not found: ID does not exist" containerID="6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10"
Sep 08 15:36:23.547219 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.547122    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10"} err="failed to get container status \"6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10\": rpc error: code = NotFound desc = could not find container \"6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10\": container with ID starting with 6443aff6a04cc906af1c153798dbbb6bd34479b148cd4b53a7f606c5ccc67b10 not found: ID does not exist"
Sep 08 15:36:23.564217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.564193    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-maas-api-tls\") pod \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") "
Sep 08 15:36:23.564374 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.564359    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-metrics-certs\") pod \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") "
Sep 08 15:36:23.564462 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.564446    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpl7k\" (UniqueName: \"kubernetes.io/projected/0d08fa2d-5abb-48c1-9a88-3f2e31358296-kube-api-access-qpl7k\") pod \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") "
Sep 08 15:36:23.564504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.564477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08fa2d-5abb-48c1-9a88-3f2e31358296-openshift-service-ca\") pod \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\" (UID: \"0d08fa2d-5abb-48c1-9a88-3f2e31358296\") "
Sep 08 15:36:23.564874 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.564849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d08fa2d-5abb-48c1-9a88-3f2e31358296-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d08fa2d-5abb-48c1-9a88-3f2e31358296" (UID: "0d08fa2d-5abb-48c1-9a88-3f2e31358296"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:23.566411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.566381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d08fa2d-5abb-48c1-9a88-3f2e31358296" (UID: "0d08fa2d-5abb-48c1-9a88-3f2e31358296"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:36:23.566519 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.566435    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d08fa2d-5abb-48c1-9a88-3f2e31358296" (UID: "0d08fa2d-5abb-48c1-9a88-3f2e31358296"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:36:23.566519 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.566481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d08fa2d-5abb-48c1-9a88-3f2e31358296-kube-api-access-qpl7k" (OuterVolumeSpecName: "kube-api-access-qpl7k") pod "0d08fa2d-5abb-48c1-9a88-3f2e31358296" (UID: "0d08fa2d-5abb-48c1-9a88-3f2e31358296"). InnerVolumeSpecName "kube-api-access-qpl7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:23.665544 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.665513    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.665544 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.665540    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpl7k\" (UniqueName: \"kubernetes.io/projected/0d08fa2d-5abb-48c1-9a88-3f2e31358296-kube-api-access-qpl7k\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.665544 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.665550    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08fa2d-5abb-48c1-9a88-3f2e31358296-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.665812 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.665559    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d08fa2d-5abb-48c1-9a88-3f2e31358296-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.852252 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.852218    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"]
Sep 08 15:36:23.858143 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:23.858114    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08794c-54c4c48498-4kgxw"]
Sep 08 15:36:24.982111 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:24.982062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:25.040522 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:25.040492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:25.828428 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:25.828395    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d08fa2d-5abb-48c1-9a88-3f2e31358296" path="/var/lib/kubelet/pods/0d08fa2d-5abb-48c1-9a88-3f2e31358296/volumes"
Sep 08 15:36:29.727881 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:29.727848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:29.829429 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:29.829399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:30.005037 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:30.004946    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"]
Sep 08 15:36:30.005471 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:30.005439    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy" containerID="cri-o://b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf" gracePeriod=30
Sep 08 15:36:30.021452 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:30.021425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:30.473835 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:30.473796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:33.914599 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:33.914560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:35.258402 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.258378    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:36:35.387652 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.387552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-envoy\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.387836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.387718    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31887229-399b-4388-9a1b-fdc02c50a513-istio-podinfo\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.387836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.387747    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-socket\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.387836 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.387775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph8cg\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-kube-api-access-ph8cg\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.388077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.387866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-credential-socket\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.388077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.387905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-data\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.388077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.387935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-istio-token\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.388077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388017    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31887229-399b-4388-9a1b-fdc02c50a513-istiod-ca-cert\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.388077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:35.388077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-certs\") pod \"31887229-399b-4388-9a1b-fdc02c50a513\" (UID: \"31887229-399b-4388-9a1b-fdc02c50a513\") "
Sep 08 15:36:35.388405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388115    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:35.388405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-data" (OuterVolumeSpecName: "istio-data") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:35.388405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388354    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31887229-399b-4388-9a1b-fdc02c50a513-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:35.388566 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388402    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:35.388669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388561    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.388669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388616    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.388669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388634    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.388669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388649    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31887229-399b-4388-9a1b-fdc02c50a513-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.388669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.388662    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.390163 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.390135    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-kube-api-access-ph8cg" (OuterVolumeSpecName: "kube-api-access-ph8cg") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "kube-api-access-ph8cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:35.390287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.390161    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-istio-token" (OuterVolumeSpecName: "istio-token") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:35.390287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.390237    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:35.390287 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.390255    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31887229-399b-4388-9a1b-fdc02c50a513-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31887229-399b-4388-9a1b-fdc02c50a513" (UID: "31887229-399b-4388-9a1b-fdc02c50a513"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:36:35.490000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.489959    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31887229-399b-4388-9a1b-fdc02c50a513-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.490000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.489992    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph8cg\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-kube-api-access-ph8cg\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.490000 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.490007    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31887229-399b-4388-9a1b-fdc02c50a513-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.490233 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.490019    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31887229-399b-4388-9a1b-fdc02c50a513-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:36:35.603439 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.603402    2578 generic.go:356] "Generic (PLEG): container finished" podID="31887229-399b-4388-9a1b-fdc02c50a513" containerID="b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf" exitCode=0
Sep 08 15:36:35.603637 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.603449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" event={"ID":"31887229-399b-4388-9a1b-fdc02c50a513","Type":"ContainerDied","Data":"b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf"}
Sep 08 15:36:35.603637 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.603459    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"
Sep 08 15:36:35.603637 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.603503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8" event={"ID":"31887229-399b-4388-9a1b-fdc02c50a513","Type":"ContainerDied","Data":"da56b072a7fa4a4b57b78587bb4c6af60c76e6b811406943b192a53850d208a8"}
Sep 08 15:36:35.603637 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.603534    2578 scope.go:117] "RemoveContainer" containerID="b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf"
Sep 08 15:36:35.613327 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.613308    2578 scope.go:117] "RemoveContainer" containerID="e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06"
Sep 08 15:36:35.622437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.622417    2578 scope.go:117] "RemoveContainer" containerID="b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf"
Sep 08 15:36:35.622764 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:36:35.622745    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf\": container with ID starting with b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf not found: ID does not exist" containerID="b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf"
Sep 08 15:36:35.622824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.622774    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf"} err="failed to get container status \"b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf\": rpc error: code = NotFound desc = could not find container \"b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf\": container with ID starting with b200d4602007bf292aacb6475a75cded4e27789c3dd3ed984319db6810f08ecf not found: ID does not exist"
Sep 08 15:36:35.622824 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.622792    2578 scope.go:117] "RemoveContainer" containerID="e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06"
Sep 08 15:36:35.623079 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:36:35.623058    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06\": container with ID starting with e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06 not found: ID does not exist" containerID="e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06"
Sep 08 15:36:35.623123 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.623087    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06"} err="failed to get container status \"e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06\": rpc error: code = NotFound desc = could not find container \"e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06\": container with ID starting with e0189ab63d3fa1147b2527744f12c756f954966070bf34e9286b2eb624b0ac06 not found: ID does not exist"
Sep 08 15:36:35.627410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.627388    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"]
Sep 08 15:36:35.632153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.632126    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8"]
Sep 08 15:36:35.827886 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:35.827846    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31887229-399b-4388-9a1b-fdc02c50a513" path="/var/lib/kubelet/pods/31887229-399b-4388-9a1b-fdc02c50a513/volumes"
Sep 08 15:36:36.026364 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:36.026334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:36.127827 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:36.127745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:45.947962 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:45.947927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:46.018862 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:46.018825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:46.079802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:46.079770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:46.157068 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:46.157038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:46.220506 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:46.220425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:46.512168 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:46.512068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:52.343285 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:52.343194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:52.442336 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:52.442304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:52.608897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:52.608815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:53.154982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:53.154934    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:56.654730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:36:56.654696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:03.347689 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.347630    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"]
Sep 08 15:37:03.348504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.348444    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb" podUID="40dbc077-cfec-4966-b591-f236f17830c1" containerName="maas-api" containerID="cri-o://ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec" gracePeriod=30
Sep 08 15:37:03.378113 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.378084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:03.454715 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.454665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:03.558724 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.558677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:03.602956 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.602891    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:37:03.626876 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.626849    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:03.699599 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.699561    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-metrics-certs\") pod \"40dbc077-cfec-4966-b591-f236f17830c1\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") "
Sep 08 15:37:03.699797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.699686    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls\") pod \"40dbc077-cfec-4966-b591-f236f17830c1\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") "
Sep 08 15:37:03.699797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.699738    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp54s\" (UniqueName: \"kubernetes.io/projected/40dbc077-cfec-4966-b591-f236f17830c1-kube-api-access-bp54s\") pod \"40dbc077-cfec-4966-b591-f236f17830c1\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") "
Sep 08 15:37:03.699797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.699768    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40dbc077-cfec-4966-b591-f236f17830c1-openshift-service-ca\") pod \"40dbc077-cfec-4966-b591-f236f17830c1\" (UID: \"40dbc077-cfec-4966-b591-f236f17830c1\") "
Sep 08 15:37:03.700385 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.700352    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40dbc077-cfec-4966-b591-f236f17830c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40dbc077-cfec-4966-b591-f236f17830c1" (UID: "40dbc077-cfec-4966-b591-f236f17830c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:37:03.702003 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.701971    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40dbc077-cfec-4966-b591-f236f17830c1-kube-api-access-bp54s" (OuterVolumeSpecName: "kube-api-access-bp54s") pod "40dbc077-cfec-4966-b591-f236f17830c1" (UID: "40dbc077-cfec-4966-b591-f236f17830c1"). InnerVolumeSpecName "kube-api-access-bp54s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:03.702003 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.701977    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "40dbc077-cfec-4966-b591-f236f17830c1" (UID: "40dbc077-cfec-4966-b591-f236f17830c1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:37:03.702223 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.702196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40dbc077-cfec-4966-b591-f236f17830c1" (UID: "40dbc077-cfec-4966-b591-f236f17830c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:37:03.756678 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.756627    2578 generic.go:356] "Generic (PLEG): container finished" podID="40dbc077-cfec-4966-b591-f236f17830c1" containerID="ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec" exitCode=0
Sep 08 15:37:03.756882 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.756692    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"
Sep 08 15:37:03.756882 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.756717    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb" event={"ID":"40dbc077-cfec-4966-b591-f236f17830c1","Type":"ContainerDied","Data":"ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec"}
Sep 08 15:37:03.756882 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.756800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb" event={"ID":"40dbc077-cfec-4966-b591-f236f17830c1","Type":"ContainerDied","Data":"ee8eabe2af680f96d56ba0ac54df17da2d191cce0a77f65b864be99f4caf8ae1"}
Sep 08 15:37:03.756882 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.756875    2578 scope.go:117] "RemoveContainer" containerID="ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec"
Sep 08 15:37:03.768464 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.768442    2578 scope.go:117] "RemoveContainer" containerID="ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec"
Sep 08 15:37:03.768842 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:37:03.768822    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec\": container with ID starting with ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec not found: ID does not exist" containerID="ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec"
Sep 08 15:37:03.768903 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.768851    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec"} err="failed to get container status \"ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec\": rpc error: code = NotFound desc = could not find container \"ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec\": container with ID starting with ec16b4cf967d01609b36a5bcc09bcdff908cc8a71a0c2aa70706298184198cec not found: ID does not exist"
Sep 08 15:37:03.782779 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.782750    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"]
Sep 08 15:37:03.785226 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.785186    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-020a18-65cb96d7f6-chvxb"]
Sep 08 15:37:03.801775 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.801751    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:03.801892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.801792    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40dbc077-cfec-4966-b591-f236f17830c1-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:03.801892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.801801    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp54s\" (UniqueName: \"kubernetes.io/projected/40dbc077-cfec-4966-b591-f236f17830c1-kube-api-access-bp54s\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:03.801892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.801810    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40dbc077-cfec-4966-b591-f236f17830c1-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:03.828218 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.828151    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40dbc077-cfec-4966-b591-f236f17830c1" path="/var/lib/kubelet/pods/40dbc077-cfec-4966-b591-f236f17830c1/volumes"
Sep 08 15:37:03.940363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:03.940276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:09.812406 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:09.812369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:09.912078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:09.912045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:10.047545 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:10.047480    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"]
Sep 08 15:37:10.047792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:10.047762    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy" containerID="cri-o://dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08" gracePeriod=30
Sep 08 15:37:10.063291 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:10.063206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:10.557564 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:10.557527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:15.305869 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.305844    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:37:15.325053 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.324988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-socket\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.325053 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325019    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-data\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.325258 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-istio-token\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.325258 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325093    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-certs\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.325258 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325133    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kpzd\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-kube-api-access-5kpzd\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.325258 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-envoy\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.325797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325258    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319980fa-3656-45a5-b755-53d328583426-istiod-ca-cert\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.325797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325258    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:15.325797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325534    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-data" (OuterVolumeSpecName: "istio-data") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:15.325797 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325711    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319980fa-3656-45a5-b755-53d328583426-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:37:15.326440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319980fa-3656-45a5-b755-53d328583426-istio-podinfo\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.326440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.325930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-credential-socket\") pod \"319980fa-3656-45a5-b755-53d328583426\" (UID: \"319980fa-3656-45a5-b755-53d328583426\") "
Sep 08 15:37:15.326440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.326391    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.326440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.326397    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:15.326440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.326412    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.326796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.326446    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319980fa-3656-45a5-b755-53d328583426-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.326796 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.326740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:15.330204 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.327867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:15.330204 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.329254    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-istio-token" (OuterVolumeSpecName: "istio-token") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:15.330204 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.329780    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/319980fa-3656-45a5-b755-53d328583426-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:37:15.331162 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.331134    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-kube-api-access-5kpzd" (OuterVolumeSpecName: "kube-api-access-5kpzd") pod "319980fa-3656-45a5-b755-53d328583426" (UID: "319980fa-3656-45a5-b755-53d328583426"). InnerVolumeSpecName "kube-api-access-5kpzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:15.427858 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.427824    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319980fa-3656-45a5-b755-53d328583426-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.427858 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.427853    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.427858 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.427862    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.427858 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.427870    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.428141 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.427878    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kpzd\" (UniqueName: \"kubernetes.io/projected/319980fa-3656-45a5-b755-53d328583426-kube-api-access-5kpzd\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.428141 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.427886    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319980fa-3656-45a5-b755-53d328583426-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:15.827403 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.827370    2578 generic.go:356] "Generic (PLEG): container finished" podID="319980fa-3656-45a5-b755-53d328583426" containerID="dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08" exitCode=0
Sep 08 15:37:15.827612 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.827490    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"
Sep 08 15:37:15.829033 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.829012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" event={"ID":"319980fa-3656-45a5-b755-53d328583426","Type":"ContainerDied","Data":"dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08"}
Sep 08 15:37:15.829104 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.829061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx" event={"ID":"319980fa-3656-45a5-b755-53d328583426","Type":"ContainerDied","Data":"40e5fc5fce5d00caa6f0829296c19bb23f56cf492f3da901f47aaf77979a29cd"}
Sep 08 15:37:15.829104 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.829088    2578 scope.go:117] "RemoveContainer" containerID="dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08"
Sep 08 15:37:15.838537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.838518    2578 scope.go:117] "RemoveContainer" containerID="8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab"
Sep 08 15:37:15.847007 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.846986    2578 scope.go:117] "RemoveContainer" containerID="dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08"
Sep 08 15:37:15.847266 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:37:15.847249    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08\": container with ID starting with dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08 not found: ID does not exist" containerID="dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08"
Sep 08 15:37:15.847316 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.847271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08"} err="failed to get container status \"dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08\": rpc error: code = NotFound desc = could not find container \"dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08\": container with ID starting with dd907d4f3dafd9a1f432cca82b1ac78fca4a503a57e92e01b64d7d2df9de2b08 not found: ID does not exist"
Sep 08 15:37:15.847316 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.847285    2578 scope.go:117] "RemoveContainer" containerID="8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab"
Sep 08 15:37:15.847497 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:37:15.847484    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab\": container with ID starting with 8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab not found: ID does not exist" containerID="8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab"
Sep 08 15:37:15.847542 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.847499    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab"} err="failed to get container status \"8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab\": rpc error: code = NotFound desc = could not find container \"8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab\": container with ID starting with 8f768e932c313f9cfeae00024409efe36458d87519a8732e0ec96029d22443ab not found: ID does not exist"
Sep 08 15:37:15.852717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.852694    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"]
Sep 08 15:37:15.858234 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:15.858214    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx"]
Sep 08 15:37:17.833710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:17.833671    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="319980fa-3656-45a5-b755-53d328583426" path="/var/lib/kubelet/pods/319980fa-3656-45a5-b755-53d328583426/volumes"
Sep 08 15:37:21.013627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.013570    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"]
Sep 08 15:37:21.014121 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.013853    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs" podUID="fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" containerName="maas-api" containerID="cri-o://88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b" gracePeriod=30
Sep 08 15:37:21.269723 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.269666    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:37:21.388945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.388779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-metrics-certs\") pod \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") "
Sep 08 15:37:21.388945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.388822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-maas-api-tls\") pod \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") "
Sep 08 15:37:21.388945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.388924    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n2fw\" (UniqueName: \"kubernetes.io/projected/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-kube-api-access-2n2fw\") pod \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") "
Sep 08 15:37:21.389274 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.389008    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-openshift-service-ca\") pod \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\" (UID: \"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60\") "
Sep 08 15:37:21.389428 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.389391    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" (UID: "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:37:21.391218 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.391189    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" (UID: "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:37:21.391334 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.391263    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-kube-api-access-2n2fw" (OuterVolumeSpecName: "kube-api-access-2n2fw") pod "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" (UID: "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60"). InnerVolumeSpecName "kube-api-access-2n2fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:21.391334 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.391274    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" (UID: "fd42cd64-3cd1-4ac9-98dc-f6bf11671a60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:37:21.490410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.490375    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:21.490410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.490403    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:21.490410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.490414    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n2fw\" (UniqueName: \"kubernetes.io/projected/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-kube-api-access-2n2fw\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:21.490730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.490428    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:37:21.862984 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.862948    2578 generic.go:356] "Generic (PLEG): container finished" podID="fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" containerID="88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b" exitCode=0
Sep 08 15:37:21.863178 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.862996    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"
Sep 08 15:37:21.863178 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.863036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs" event={"ID":"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60","Type":"ContainerDied","Data":"88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b"}
Sep 08 15:37:21.863178 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.863089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs" event={"ID":"fd42cd64-3cd1-4ac9-98dc-f6bf11671a60","Type":"ContainerDied","Data":"bd6f52f0b82995faf5515c2ac8326df082d8e5241c88103615a469f473b8a24e"}
Sep 08 15:37:21.863178 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.863119    2578 scope.go:117] "RemoveContainer" containerID="88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b"
Sep 08 15:37:21.874538 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.874515    2578 scope.go:117] "RemoveContainer" containerID="88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b"
Sep 08 15:37:21.875021 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:37:21.874999    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b\": container with ID starting with 88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b not found: ID does not exist" containerID="88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b"
Sep 08 15:37:21.875118 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.875029    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b"} err="failed to get container status \"88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b\": rpc error: code = NotFound desc = could not find container \"88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b\": container with ID starting with 88d0cf085fd8027a673249f1e1abe59a028321a97e493433ff18e7380cbf6e5b not found: ID does not exist"
Sep 08 15:37:21.880321 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.880298    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"]
Sep 08 15:37:21.885124 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:21.885096    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d62b4e-86dfb8c6fb-mdcvs"]
Sep 08 15:37:22.864634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:22.864567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:22.964861 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:22.964827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:23.828271 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:23.828228    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" path="/var/lib/kubelet/pods/fd42cd64-3cd1-4ac9-98dc-f6bf11671a60/volumes"
Sep 08 15:37:25.963077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:25.963035    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:27.457263 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:27.457232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:27.539263 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:27.539234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:27.715068 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:27.714974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:36.462365 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:36.462326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:37.460238 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:37.460202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:37.920389 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:37.920300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:38.269405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269370    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"]
Sep 08 15:37:38.269937 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269916    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40dbc077-cfec-4966-b591-f236f17830c1" containerName="maas-api"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269939    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40dbc077-cfec-4966-b591-f236f17830c1" containerName="maas-api"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269956    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269964    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269977    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" containerName="maas-api"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269986    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" containerName="maas-api"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.269994    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270002    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270021    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d08fa2d-5abb-48c1-9a88-3f2e31358296" containerName="maas-api"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270029    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d08fa2d-5abb-48c1-9a88-3f2e31358296" containerName="maas-api"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270044    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy"
Sep 08 15:37:38.270051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270052    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270068    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270077    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270199    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270209    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31887229-399b-4388-9a1b-fdc02c50a513" containerName="istio-proxy"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270220    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd42cd64-3cd1-4ac9-98dc-f6bf11671a60" containerName="maas-api"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270232    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270244    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40dbc077-cfec-4966-b591-f236f17830c1" containerName="maas-api"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270252    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="319980fa-3656-45a5-b755-53d328583426" containerName="istio-proxy"
Sep 08 15:37:38.270631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.270262    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d08fa2d-5abb-48c1-9a88-3f2e31358296" containerName="maas-api"
Sep 08 15:37:38.272800 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.272780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.275210 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.275188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-014f36-openshift-default-dockercfg-qhkhj\""
Sep 08 15:37:38.283643 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.283618    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"]
Sep 08 15:37:38.291329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.291308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:38.360248 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-credential-socket\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360445 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6gn\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-kube-api-access-9g6gn\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360445 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-socket\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360445 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-podinfo\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-certs\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360743 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-envoy\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360831 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360804    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-data\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-token\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.360891 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.360877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4009ad99-f966-403e-ae20-2c6e33e5de72-istiod-ca-cert\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6gn\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-kube-api-access-9g6gn\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-socket\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-podinfo\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-certs\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-envoy\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-data\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-token\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4009ad99-f966-403e-ae20-2c6e33e5de72-istiod-ca-cert\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.462955 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.462848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-credential-socket\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.463113 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.463088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-certs\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.463175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.463115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-data\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.463239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.463219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-credential-socket\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.463338 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.463317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-socket\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.463480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.463460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4009ad99-f966-403e-ae20-2c6e33e5de72-istiod-ca-cert\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.465499 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.465467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-envoy\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.465627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.465615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-podinfo\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.470468 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.470439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6gn\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-kube-api-access-9g6gn\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.470789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.470773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-token\") pod \"e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") " pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.583838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.583750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:38.862165 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.862137    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"]
Sep 08 15:37:38.864142 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:37:38.864103    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4009ad99_f966_403e_ae20_2c6e33e5de72.slice/crio-36ed349fed2d204d2951103b04c092a384e94335860e2a2e6b24212ed7ce431e WatchSource:0}: Error finding container 36ed349fed2d204d2951103b04c092a384e94335860e2a2e6b24212ed7ce431e: Status 404 returned error can't find the container with id 36ed349fed2d204d2951103b04c092a384e94335860e2a2e6b24212ed7ce431e
Sep 08 15:37:38.867035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.867002    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:37:38.867134 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.867080    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:37:38.867134 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.867114    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:37:38.886642 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.886569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:38.965916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.965874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" event={"ID":"4009ad99-f966-403e-ae20-2c6e33e5de72","Type":"ContainerStarted","Data":"29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21"}
Sep 08 15:37:38.966387 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.965951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" event={"ID":"4009ad99-f966-403e-ae20-2c6e33e5de72","Type":"ContainerStarted","Data":"36ed349fed2d204d2951103b04c092a384e94335860e2a2e6b24212ed7ce431e"}
Sep 08 15:37:38.988942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:38.988885    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podStartSLOduration=0.988865101 podStartE2EDuration="988.865101ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:38.986029339 +0000 UTC m=+1479.645190477" watchObservedRunningTime="2026-09-08 15:37:38.988865101 +0000 UTC m=+1479.648026230"
Sep 08 15:37:39.584633 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:39.584599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:39.590651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:39.590624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:39.971301 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:39.971271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:39.972196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:39.972176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:40.876784 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:40.876736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:40.981396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:40.981352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:42.050679 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.050643    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"]
Sep 08 15:37:42.053666 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.053642    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.056031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.056004    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-014f36-serving-cert\""
Sep 08 15:37:42.065342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.065275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"]
Sep 08 15:37:42.088158 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.088113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:42.188198 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.188163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:42.203548 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.203522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.203728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.203561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.203728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.203649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-metrics-certs\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.203728 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.203726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tppz\" (UniqueName: \"kubernetes.io/projected/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-kube-api-access-7tppz\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.305012 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.304917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tppz\" (UniqueName: \"kubernetes.io/projected/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-kube-api-access-7tppz\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.305012 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.304982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.305012 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.305013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.305234 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.305050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-metrics-certs\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.305234 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:37:42.305128    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-serving-cert: secret "maas-api-e2e-ipp-a-014f36-serving-cert" not found
Sep 08 15:37:42.305234 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:37:42.305207    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls podName:79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b nodeName:}" failed. No retries permitted until 2026-09-08 15:37:42.805185168 +0000 UTC m=+1483.464346288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls") pod "maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9" (UID: "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b") : secret "maas-api-e2e-ipp-a-014f36-serving-cert" not found
Sep 08 15:37:42.305667 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.305640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.307635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.307611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-metrics-certs\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.314254 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.314231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tppz\" (UniqueName: \"kubernetes.io/projected/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-kube-api-access-7tppz\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.564715 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.564621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:42.651473 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.651438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:42.811627 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.811589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.814161 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.814125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:42.967631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:42.967600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:43.243202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:43.243176    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"]
Sep 08 15:37:43.244978 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:37:43.244953    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ee3b64_46e4_4bc5_afa0_9fdc5a0f234b.slice/crio-c53f46f1887b8eb8b353887ca0ac8da640a55d3bbde90061405d4351c1caff44 WatchSource:0}: Error finding container c53f46f1887b8eb8b353887ca0ac8da640a55d3bbde90061405d4351c1caff44: Status 404 returned error can't find the container with id c53f46f1887b8eb8b353887ca0ac8da640a55d3bbde90061405d4351c1caff44
Sep 08 15:37:43.996149 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:43.996103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9" event={"ID":"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b","Type":"ContainerStarted","Data":"2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609"}
Sep 08 15:37:43.996325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:43.996189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:43.996325 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:43.996217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9" event={"ID":"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b","Type":"ContainerStarted","Data":"c53f46f1887b8eb8b353887ca0ac8da640a55d3bbde90061405d4351c1caff44"}
Sep 08 15:37:50.007839 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:50.007810    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:37:50.026848 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:50.026795    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9" podStartSLOduration=7.510665224 podStartE2EDuration="8.026779642s" totalImagesPullingTime="516.114418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:44.014636309 +0000 UTC m=+1484.673797433" watchObservedRunningTime="2026-09-08 15:37:50.026779642 +0000 UTC m=+1490.685940768"
Sep 08 15:37:55.863802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:55.863262    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:49000->10.134.0.65:15021: read: connection reset by peer" start-of-body=
Sep 08 15:37:55.863802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:55.863338    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:49000->10.134.0.65:15021: read: connection reset by peer"
Sep 08 15:37:56.069895 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:56.069818    2578 generic.go:356] "Generic (PLEG): container finished" podID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerID="29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21" exitCode=0
Sep 08 15:37:56.069895 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:56.069871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" event={"ID":"4009ad99-f966-403e-ae20-2c6e33e5de72","Type":"ContainerDied","Data":"29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21"}
Sep 08 15:37:56.070305 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:56.070290    2578 scope.go:117] "RemoveContainer" containerID="29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21"
Sep 08 15:37:56.071361 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:56.071333    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:37:56.071427 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:56.071401    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:37:56.071466 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:56.071434    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:37:57.078329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:57.078293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" event={"ID":"4009ad99-f966-403e-ae20-2c6e33e5de72","Type":"ContainerStarted","Data":"b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8"}
Sep 08 15:37:57.584217 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:57.584167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:37:57.584462 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:57.584435    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:37:57.584534 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:57.584494    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 15:37:58.584973 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:58.584867    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:37:58.584973 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:58.584955    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 15:37:59.584654 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:59.584615    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:37:59.584843 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:37:59.584688    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 15:38:00.584984 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:00.584938    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:38:00.585499 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:00.585021    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 15:38:01.584910 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:01.584870    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:38:01.585115 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:01.584926    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 15:38:02.584945 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:02.584885    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:38:02.585169 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:02.584958    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 15:38:03.588744 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:03.588711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:38:03.589228 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:03.589021    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:38:03.589782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:03.589760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:38:05.903052 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:05.903013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:06.583730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.583695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:06.865259 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.865168    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"]
Sep 08 15:38:06.874430 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.874397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.876942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.876915    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-30cc8d-openshift-default-dockercfg-2kqz2\""
Sep 08 15:38:06.879721 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.879697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"]
Sep 08 15:38:06.905427 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.905387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:06.988160 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-certs\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988367 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-data\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988367 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-envoy\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988367 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcrx7\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-kube-api-access-kcrx7\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988547 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-socket\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988547 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-podinfo\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988547 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-credential-socket\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988547 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istiod-ca-cert\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:06.988862 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:06.988563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-token\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.089980 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.089945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-certs\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.089980 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.089985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-data\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-envoy\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcrx7\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-kube-api-access-kcrx7\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-socket\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-podinfo\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-credential-socket\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istiod-ca-cert\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090231 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-token\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-certs\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-data\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-socket\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090834 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-credential-socket\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.090999 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.090974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istiod-ca-cert\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.092379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.092352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-envoy\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.092635 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.092615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-podinfo\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.100225 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.100206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-token\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.100332 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.100237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcrx7\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-kube-api-access-kcrx7\") pod \"e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") " pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.187280 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.187194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:07.328866 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.328829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:07.466665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.466638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"]
Sep 08 15:38:07.469417 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:38:07.469395    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6f267a_5d7b_4d26_bce5_810e48ae6245.slice/crio-3088faca4d01f9cbeb9f9a328aa31e559de7665ca16f0b84c3f3656fa2d62a83 WatchSource:0}: Error finding container 3088faca4d01f9cbeb9f9a328aa31e559de7665ca16f0b84c3f3656fa2d62a83: Status 404 returned error can't find the container with id 3088faca4d01f9cbeb9f9a328aa31e559de7665ca16f0b84c3f3656fa2d62a83
Sep 08 15:38:07.471802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.471771    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:38:07.471887 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.471836    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:38:07.471887 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:07.471867    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:38:08.144674 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:08.144638    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" event={"ID":"6a6f267a-5d7b-4d26-bce5-810e48ae6245","Type":"ContainerStarted","Data":"fde467afbfbfb3c4b6e557200d15cae733d37a6a6b0884eaba880118e0d82cec"}
Sep 08 15:38:08.145076 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:08.144689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" event={"ID":"6a6f267a-5d7b-4d26-bce5-810e48ae6245","Type":"ContainerStarted","Data":"3088faca4d01f9cbeb9f9a328aa31e559de7665ca16f0b84c3f3656fa2d62a83"}
Sep 08 15:38:08.172126 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:08.172078    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podStartSLOduration=2.172062203 podStartE2EDuration="2.172062203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:08.170621395 +0000 UTC m=+1508.829782524" watchObservedRunningTime="2026-09-08 15:38:08.172062203 +0000 UTC m=+1508.831223330"
Sep 08 15:38:08.187917 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:08.187893    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:08.193162 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:08.193138    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:09.149887 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:09.149853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:09.150916 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:09.150897    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:10.099567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:10.099506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:10.258977 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:10.258946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:11.284768 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:11.284729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:11.355259 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:11.355229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:11.456827 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:11.456789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:11.923304 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:11.923272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:12.023286 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:12.023246    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:28.261574 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:28.261539    2578 generic.go:356] "Generic (PLEG): container finished" podID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerID="fde467afbfbfb3c4b6e557200d15cae733d37a6a6b0884eaba880118e0d82cec" exitCode=0
Sep 08 15:38:28.261992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:28.261613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" event={"ID":"6a6f267a-5d7b-4d26-bce5-810e48ae6245","Type":"ContainerDied","Data":"fde467afbfbfb3c4b6e557200d15cae733d37a6a6b0884eaba880118e0d82cec"}
Sep 08 15:38:28.262106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:28.262087    2578 scope.go:117] "RemoveContainer" containerID="fde467afbfbfb3c4b6e557200d15cae733d37a6a6b0884eaba880118e0d82cec"
Sep 08 15:38:28.263324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:28.263292    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:38:28.263437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:28.263359    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:38:28.263437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:28.263392    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 15:38:29.272660 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:29.272624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" event={"ID":"6a6f267a-5d7b-4d26-bce5-810e48ae6245","Type":"ContainerStarted","Data":"6d04eb98535cae7056b77a2ec8306e3a8590734afc8cdb4ce9226a1afee83eef"}
Sep 08 15:38:30.187727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:30.187689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:30.188047 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:30.188020    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 08 15:38:30.188135 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:30.188109    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 08 15:38:31.187924 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:31.187884    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 08 15:38:31.188419 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:31.187951    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 08 15:38:32.188652 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:32.188615    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 08 15:38:32.189051 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:32.188674    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 08 15:38:33.188518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:33.188468    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 08 15:38:33.188750 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:33.188550    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 08 15:38:34.188305 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:34.188261    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 08 15:38:34.188494 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:34.188319    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 08 15:38:35.081216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:35.081170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:35.192218 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:35.192181    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:35.192552 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:35.192530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:35.193137 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:35.193121    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:38:39.692892 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:39.692859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:39.750009 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:39.749971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:40.169443 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:40.169413    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5w58s_e83bc787-cf0d-45f8-b5bf-acec97385865/payload-processing/0.log"
Sep 08 15:38:47.265067 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:38:47.265027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:23.347656 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:23.347607    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5w58s_e83bc787-cf0d-45f8-b5bf-acec97385865/payload-processing/0.log"
Sep 08 15:39:23.734869 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:23.734830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:24.063143 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:24.063064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:24.635803 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:24.635758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:26.824540 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:26.824490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:26.953665 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:26.953633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:27.942959 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:27.942922    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"]
Sep 08 15:39:27.945926 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:27.945903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:27.948746 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:27.948725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-6f830d-serving-cert\""
Sep 08 15:39:27.958251 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:27.958227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"]
Sep 08 15:39:27.982943 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:27.982907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:28.081273 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.081236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.081493 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.081455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/588ad109-3922-45e6-8987-a046e4038cc0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.081570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.081512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m874b\" (UniqueName: \"kubernetes.io/projected/588ad109-3922-45e6-8987-a046e4038cc0-kube-api-access-m874b\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.081709 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.081644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.108421 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.108389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:28.183110 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.183061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.183310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.183166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.183310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.183200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/588ad109-3922-45e6-8987-a046e4038cc0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.183310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.183229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m874b\" (UniqueName: \"kubernetes.io/projected/588ad109-3922-45e6-8987-a046e4038cc0-kube-api-access-m874b\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.183485 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:39:28.183307    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-serving-cert: secret "maas-api-e2e-ipp-cleanup-6f830d-serving-cert" not found
Sep 08 15:39:28.183485 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:39:28.183374    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls podName:588ad109-3922-45e6-8987-a046e4038cc0 nodeName:}" failed. No retries permitted until 2026-09-08 15:39:28.683357978 +0000 UTC m=+1589.342519082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm" (UID: "588ad109-3922-45e6-8987-a046e4038cc0") : secret "maas-api-e2e-ipp-cleanup-6f830d-serving-cert" not found
Sep 08 15:39:28.184021 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.184000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/588ad109-3922-45e6-8987-a046e4038cc0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.185663 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.185645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.195461 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.195406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m874b\" (UniqueName: \"kubernetes.io/projected/588ad109-3922-45e6-8987-a046e4038cc0-kube-api-access-m874b\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.491415 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.491370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:28.595651 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.595622    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:28.690572 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.690538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.700600 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.700179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:28.860567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:28.860475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:29.134887 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:29.134859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"]
Sep 08 15:39:29.137506 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:39:29.137475    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588ad109_3922_45e6_8987_a046e4038cc0.slice/crio-1edeaedee4cd66656382248884c4e6b867789cb02f331f5ceadc49f82284a188 WatchSource:0}: Error finding container 1edeaedee4cd66656382248884c4e6b867789cb02f331f5ceadc49f82284a188: Status 404 returned error can't find the container with id 1edeaedee4cd66656382248884c4e6b867789cb02f331f5ceadc49f82284a188
Sep 08 15:39:29.623992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:29.623961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm" event={"ID":"588ad109-3922-45e6-8987-a046e4038cc0","Type":"ContainerStarted","Data":"1edeaedee4cd66656382248884c4e6b867789cb02f331f5ceadc49f82284a188"}
Sep 08 15:39:30.630708 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:30.630677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm" event={"ID":"588ad109-3922-45e6-8987-a046e4038cc0","Type":"ContainerStarted","Data":"d4a34180fabf36b3ac47f85656a7c912455df20a7a209e0ae6a9522590b0231e"}
Sep 08 15:39:30.631154 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:30.630759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:30.648736 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:30.648683    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm" podStartSLOduration=3.173760886 podStartE2EDuration="3.648668029s" totalImagesPullingTime="474.907143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:39:30.647523653 +0000 UTC m=+1591.306684780" watchObservedRunningTime="2026-09-08 15:39:30.648668029 +0000 UTC m=+1591.307829156"
Sep 08 15:39:36.642410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:36.642378    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:51.828401 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:51.828367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:58.637918 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.637822    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"]
Sep 08 15:39:58.638485 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.638058    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm" podUID="588ad109-3922-45e6-8987-a046e4038cc0" containerName="maas-api" containerID="cri-o://d4a34180fabf36b3ac47f85656a7c912455df20a7a209e0ae6a9522590b0231e" gracePeriod=30
Sep 08 15:39:58.677097 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.677059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:58.778934 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.778902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:58.791032 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.791002    2578 generic.go:356] "Generic (PLEG): container finished" podID="588ad109-3922-45e6-8987-a046e4038cc0" containerID="d4a34180fabf36b3ac47f85656a7c912455df20a7a209e0ae6a9522590b0231e" exitCode=0
Sep 08 15:39:58.791177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.791059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm" event={"ID":"588ad109-3922-45e6-8987-a046e4038cc0","Type":"ContainerDied","Data":"d4a34180fabf36b3ac47f85656a7c912455df20a7a209e0ae6a9522590b0231e"}
Sep 08 15:39:58.877337 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.877214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:58.893641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.893560    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:58.976942 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:58.976892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:59.021336 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.021302    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m874b\" (UniqueName: \"kubernetes.io/projected/588ad109-3922-45e6-8987-a046e4038cc0-kube-api-access-m874b\") pod \"588ad109-3922-45e6-8987-a046e4038cc0\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") "
Sep 08 15:39:59.021515 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.021367    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/588ad109-3922-45e6-8987-a046e4038cc0-openshift-service-ca\") pod \"588ad109-3922-45e6-8987-a046e4038cc0\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") "
Sep 08 15:39:59.021515 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.021501    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls\") pod \"588ad109-3922-45e6-8987-a046e4038cc0\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") "
Sep 08 15:39:59.021677 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.021631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-metrics-certs\") pod \"588ad109-3922-45e6-8987-a046e4038cc0\" (UID: \"588ad109-3922-45e6-8987-a046e4038cc0\") "
Sep 08 15:39:59.021894 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.021868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/588ad109-3922-45e6-8987-a046e4038cc0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "588ad109-3922-45e6-8987-a046e4038cc0" (UID: "588ad109-3922-45e6-8987-a046e4038cc0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:39:59.022035 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.022014    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/588ad109-3922-45e6-8987-a046e4038cc0-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:39:59.023567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.023539    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "588ad109-3922-45e6-8987-a046e4038cc0" (UID: "588ad109-3922-45e6-8987-a046e4038cc0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:39:59.023567 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.023560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588ad109-3922-45e6-8987-a046e4038cc0-kube-api-access-m874b" (OuterVolumeSpecName: "kube-api-access-m874b") pod "588ad109-3922-45e6-8987-a046e4038cc0" (UID: "588ad109-3922-45e6-8987-a046e4038cc0"). InnerVolumeSpecName "kube-api-access-m874b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:59.023954 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.023929    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "588ad109-3922-45e6-8987-a046e4038cc0" (UID: "588ad109-3922-45e6-8987-a046e4038cc0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:39:59.122899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.122860    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:39:59.122899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.122893    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m874b\" (UniqueName: \"kubernetes.io/projected/588ad109-3922-45e6-8987-a046e4038cc0-kube-api-access-m874b\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:39:59.122899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.122908    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/588ad109-3922-45e6-8987-a046e4038cc0-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:39:59.280220 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.280189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:59.797947 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.797914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm" event={"ID":"588ad109-3922-45e6-8987-a046e4038cc0","Type":"ContainerDied","Data":"1edeaedee4cd66656382248884c4e6b867789cb02f331f5ceadc49f82284a188"}
Sep 08 15:39:59.798375 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.797974    2578 scope.go:117] "RemoveContainer" containerID="d4a34180fabf36b3ac47f85656a7c912455df20a7a209e0ae6a9522590b0231e"
Sep 08 15:39:59.798375 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.797922    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"
Sep 08 15:39:59.829138 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.829112    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"]
Sep 08 15:39:59.829269 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:39:59.829146    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6f830d-84d9c6cd8b-4scrm"]
Sep 08 15:40:01.828268 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:01.828228    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="588ad109-3922-45e6-8987-a046e4038cc0" path="/var/lib/kubelet/pods/588ad109-3922-45e6-8987-a046e4038cc0/volumes"
Sep 08 15:40:05.055944 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:05.055910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:05.124501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:05.124454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:05.347315 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:05.347221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:07.881683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:07.881640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:09.163175 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:09.163144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:24.630251 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.630205    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"]
Sep 08 15:40:24.631068 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.631034    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9" podUID="79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" containerName="maas-api" containerID="cri-o://2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609" gracePeriod=30
Sep 08 15:40:24.670219 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.670179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:24.769746 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.769709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:24.863151 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.863117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:24.893183 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.893125    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:40:24.918761 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.918719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:24.932645 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.932620    2578 generic.go:356] "Generic (PLEG): container finished" podID="79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" containerID="2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609" exitCode=0
Sep 08 15:40:24.932789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.932657    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"
Sep 08 15:40:24.932789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.932675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9" event={"ID":"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b","Type":"ContainerDied","Data":"2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609"}
Sep 08 15:40:24.932789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.932721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9" event={"ID":"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b","Type":"ContainerDied","Data":"c53f46f1887b8eb8b353887ca0ac8da640a55d3bbde90061405d4351c1caff44"}
Sep 08 15:40:24.932789 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.932747    2578 scope.go:117] "RemoveContainer" containerID="2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609"
Sep 08 15:40:24.942211 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.942189    2578 scope.go:117] "RemoveContainer" containerID="2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609"
Sep 08 15:40:24.942474 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:40:24.942455    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609\": container with ID starting with 2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609 not found: ID does not exist" containerID="2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609"
Sep 08 15:40:24.942541 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:24.942485    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609"} err="failed to get container status \"2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609\": rpc error: code = NotFound desc = could not find container \"2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609\": container with ID starting with 2e2513541ce8887f83d4e974c0626efccb1291cfc88ef10ebe2a286a21a1e609 not found: ID does not exist"
Sep 08 15:40:25.004966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.004931    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-openshift-service-ca\") pod \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") "
Sep 08 15:40:25.005140 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.004982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tppz\" (UniqueName: \"kubernetes.io/projected/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-kube-api-access-7tppz\") pod \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") "
Sep 08 15:40:25.005140 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.005108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls\") pod \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") "
Sep 08 15:40:25.005324 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.005149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-metrics-certs\") pod \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\" (UID: \"79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b\") "
Sep 08 15:40:25.005384 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.005346    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" (UID: "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:25.005784 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.005694    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.008090 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.008059    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" (UID: "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:40:25.008218 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.008163    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" (UID: "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:40:25.008346 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.008317    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-kube-api-access-7tppz" (OuterVolumeSpecName: "kube-api-access-7tppz") pod "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" (UID: "79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b"). InnerVolumeSpecName "kube-api-access-7tppz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:25.106799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.106767    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.106799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.106794    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.106799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.106803    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tppz\" (UniqueName: \"kubernetes.io/projected/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b-kube-api-access-7tppz\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.235171 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.235139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:25.255411 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.255377    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"]
Sep 08 15:40:25.261765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.261744    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-014f36-795cdbbc74-92hh9"]
Sep 08 15:40:25.828161 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:25.828127    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" path="/var/lib/kubelet/pods/79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b/volumes"
Sep 08 15:40:28.694359 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:28.694324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:30.307180 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:30.307142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:59.342641 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:40:59.342608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:04.839153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:04.839104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:04.894777 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:04.894703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:06.430116 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:06.430078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:07.364384 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:07.364352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:12.947880 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:12.947842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:13.048078 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:13.048043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:13.194095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:13.194062    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"]
Sep 08 15:41:13.194348 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:13.194315    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy" containerID="cri-o://b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8" gracePeriod=30
Sep 08 15:41:13.210121 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:13.210039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:13.762222 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:13.762166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:18.463997 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.463936    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:41:18.563499 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563468    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-token\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.563690 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4009ad99-f966-403e-ae20-2c6e33e5de72-istiod-ca-cert\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.563690 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563617    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-credential-socket\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.563690 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563652    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-certs\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.563846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563700    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-envoy\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.563846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563742    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-data\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.563846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-podinfo\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.563846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g6gn\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-kube-api-access-9g6gn\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.564064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-socket\") pod \"4009ad99-f966-403e-ae20-2c6e33e5de72\" (UID: \"4009ad99-f966-403e-ae20-2c6e33e5de72\") "
Sep 08 15:41:18.564064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.563969    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:18.564064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564006    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-data" (OuterVolumeSpecName: "istio-data") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:18.564064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564017    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4009ad99-f966-403e-ae20-2c6e33e5de72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:18.564289 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564096    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:18.564351 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564291    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:18.564447 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564427    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.564505 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564452    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.564505 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564466    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4009ad99-f966-403e-ae20-2c6e33e5de72-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.564505 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564481    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.564505 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.564493    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.565930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.565898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:18.566069 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.565996    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:41:18.566223 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.566196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-token" (OuterVolumeSpecName: "istio-token") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:18.566327 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.566206    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-kube-api-access-9g6gn" (OuterVolumeSpecName: "kube-api-access-9g6gn") pod "4009ad99-f966-403e-ae20-2c6e33e5de72" (UID: "4009ad99-f966-403e-ae20-2c6e33e5de72"). InnerVolumeSpecName "kube-api-access-9g6gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:18.665939 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.665900    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.665939 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.665931    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g6gn\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-kube-api-access-9g6gn\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.665939 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.665945    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:18.666188 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:18.665959    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4009ad99-f966-403e-ae20-2c6e33e5de72-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:19.243366 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.243332    2578 generic.go:356] "Generic (PLEG): container finished" podID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerID="b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8" exitCode=0
Sep 08 15:41:19.243570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.243388    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"
Sep 08 15:41:19.243570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.243414    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" event={"ID":"4009ad99-f966-403e-ae20-2c6e33e5de72","Type":"ContainerDied","Data":"b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8"}
Sep 08 15:41:19.243570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.243467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm" event={"ID":"4009ad99-f966-403e-ae20-2c6e33e5de72","Type":"ContainerDied","Data":"36ed349fed2d204d2951103b04c092a384e94335860e2a2e6b24212ed7ce431e"}
Sep 08 15:41:19.243570 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.243489    2578 scope.go:117] "RemoveContainer" containerID="b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8"
Sep 08 15:41:19.253467 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.253451    2578 scope.go:117] "RemoveContainer" containerID="29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21"
Sep 08 15:41:19.261501 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.261486    2578 scope.go:117] "RemoveContainer" containerID="b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8"
Sep 08 15:41:19.261793 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:41:19.261775    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8\": container with ID starting with b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8 not found: ID does not exist" containerID="b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8"
Sep 08 15:41:19.261860 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.261801    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8"} err="failed to get container status \"b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8\": rpc error: code = NotFound desc = could not find container \"b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8\": container with ID starting with b7b33a5f07fa621afa84c174875f5ef3108136932cdafb70a7988c429ca7d8e8 not found: ID does not exist"
Sep 08 15:41:19.261860 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.261816    2578 scope.go:117] "RemoveContainer" containerID="29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21"
Sep 08 15:41:19.262041 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:41:19.262028    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21\": container with ID starting with 29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21 not found: ID does not exist" containerID="29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21"
Sep 08 15:41:19.262079 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.262045    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21"} err="failed to get container status \"29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21\": rpc error: code = NotFound desc = could not find container \"29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21\": container with ID starting with 29cc6a51c8f2c3cbd435a2106ad732f16e6b85239752eed2f757d20112d13b21 not found: ID does not exist"
Sep 08 15:41:19.266517 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.266492    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"]
Sep 08 15:41:19.273982 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.273961    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm"]
Sep 08 15:41:19.828648 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:19.828610    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" path="/var/lib/kubelet/pods/4009ad99-f966-403e-ae20-2c6e33e5de72/volumes"
Sep 08 15:41:24.068096 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:24.068018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:24.166733 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:24.166694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:24.251542 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:24.251509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:24.306186 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:24.306153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:24.651614 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:24.651562    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:30.893838 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:30.893796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:30.967362 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:30.967326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:31.160652 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:31.160524    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"]
Sep 08 15:41:31.160852 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:31.160825    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy" containerID="cri-o://6d04eb98535cae7056b77a2ec8306e3a8590734afc8cdb4ce9226a1afee83eef" gracePeriod=30
Sep 08 15:41:31.189198 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:31.189171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:31.720774 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:31.720739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:35.194624 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:35.194574    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:41:35.195029 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:35.194652    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:41:36.335478 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.335441    2578 generic.go:356] "Generic (PLEG): container finished" podID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerID="6d04eb98535cae7056b77a2ec8306e3a8590734afc8cdb4ce9226a1afee83eef" exitCode=0
Sep 08 15:41:36.335980 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.335517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" event={"ID":"6a6f267a-5d7b-4d26-bce5-810e48ae6245","Type":"ContainerDied","Data":"6d04eb98535cae7056b77a2ec8306e3a8590734afc8cdb4ce9226a1afee83eef"}
Sep 08 15:41:36.335980 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.335608    2578 scope.go:117] "RemoveContainer" containerID="fde467afbfbfb3c4b6e557200d15cae733d37a6a6b0884eaba880118e0d82cec"
Sep 08 15:41:36.428264 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.428195    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:41:36.461294 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-data\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461294 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-token\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-socket\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461388    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcrx7\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-kube-api-access-kcrx7\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461456    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-certs\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461483    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-envoy\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461506    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-credential-socket\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istiod-ca-cert\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:36.461875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-podinfo\") pod \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\" (UID: \"6a6f267a-5d7b-4d26-bce5-810e48ae6245\") "
Sep 08 15:41:36.461875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:36.461875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.461762    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:36.462161 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.462133    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.462242 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.462153    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:36.462242 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.462165    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.462242 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.462209    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.462408 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.462264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:36.463884 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.463850    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:36.464093 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.464069    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:36.464239 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.464220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:41:36.464631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.464608    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-kube-api-access-kcrx7" (OuterVolumeSpecName: "kube-api-access-kcrx7") pod "6a6f267a-5d7b-4d26-bce5-810e48ae6245" (UID: "6a6f267a-5d7b-4d26-bce5-810e48ae6245"). InnerVolumeSpecName "kube-api-access-kcrx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:36.562717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.562678    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.562717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.562710    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f267a-5d7b-4d26-bce5-810e48ae6245-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.562717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.562719    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.562970 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.562729    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.562970 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.562737    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:36.562970 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:36.562745    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcrx7\" (UniqueName: \"kubernetes.io/projected/6a6f267a-5d7b-4d26-bce5-810e48ae6245-kube-api-access-kcrx7\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:41:37.342166 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:37.342141    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"
Sep 08 15:41:37.342664 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:37.342139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st" event={"ID":"6a6f267a-5d7b-4d26-bce5-810e48ae6245","Type":"ContainerDied","Data":"3088faca4d01f9cbeb9f9a328aa31e559de7665ca16f0b84c3f3656fa2d62a83"}
Sep 08 15:41:37.342664 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:37.342275    2578 scope.go:117] "RemoveContainer" containerID="6d04eb98535cae7056b77a2ec8306e3a8590734afc8cdb4ce9226a1afee83eef"
Sep 08 15:41:37.365727 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:37.365698    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"]
Sep 08 15:41:37.370551 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:37.370526    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st"]
Sep 08 15:41:37.827966 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:37.827927    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" path="/var/lib/kubelet/pods/6a6f267a-5d7b-4d26-bce5-810e48ae6245/volumes"
Sep 08 15:41:42.122676 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:42.122640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:42.222221 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:42.222142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:42.316145 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:42.316105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:42.376327 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:42.376245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:42.805847 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:42.805811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:48.583064 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:48.583025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:48.686278 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:48.686244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:48.841307 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:48.841223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:49.461252 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:49.461216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:59.682444 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:59.682404    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"]
Sep 08 15:41:59.682940 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:59.682636    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c" podUID="3cac84fa-5bd0-4ad6-bd40-1038009e5118" containerName="maas-api" containerID="cri-o://60bba9562cc5aff8dbf89a2825ce5d66a22860d967081b2808ba19a8fa13395c" gracePeriod=30
Sep 08 15:41:59.708561 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:59.708533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:59.809272 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:59.809214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:59.908771 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:59.908740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:59.945334 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:59.945268    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:41:59.976070 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:41:59.976040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:00.044428 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.044394    2578 scope.go:117] "RemoveContainer" containerID="60bba9562cc5aff8dbf89a2825ce5d66a22860d967081b2808ba19a8fa13395c"
Sep 08 15:42:00.097851 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.097814    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac84fa-5bd0-4ad6-bd40-1038009e5118-openshift-service-ca\") pod \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") "
Sep 08 15:42:00.098061 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.097889    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-maas-api-tls\") pod \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") "
Sep 08 15:42:00.098061 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.097957    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-metrics-certs\") pod \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") "
Sep 08 15:42:00.098061 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.097986    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxxfk\" (UniqueName: \"kubernetes.io/projected/3cac84fa-5bd0-4ad6-bd40-1038009e5118-kube-api-access-xxxfk\") pod \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\" (UID: \"3cac84fa-5bd0-4ad6-bd40-1038009e5118\") "
Sep 08 15:42:00.098261 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.098237    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cac84fa-5bd0-4ad6-bd40-1038009e5118-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3cac84fa-5bd0-4ad6-bd40-1038009e5118" (UID: "3cac84fa-5bd0-4ad6-bd40-1038009e5118"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:42:00.098406 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.098385    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac84fa-5bd0-4ad6-bd40-1038009e5118-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:00.100333 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.100299    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3cac84fa-5bd0-4ad6-bd40-1038009e5118" (UID: "3cac84fa-5bd0-4ad6-bd40-1038009e5118"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:42:00.100464 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.100448    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cac84fa-5bd0-4ad6-bd40-1038009e5118-kube-api-access-xxxfk" (OuterVolumeSpecName: "kube-api-access-xxxfk") pod "3cac84fa-5bd0-4ad6-bd40-1038009e5118" (UID: "3cac84fa-5bd0-4ad6-bd40-1038009e5118"). InnerVolumeSpecName "kube-api-access-xxxfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:00.101192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.101155    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3cac84fa-5bd0-4ad6-bd40-1038009e5118" (UID: "3cac84fa-5bd0-4ad6-bd40-1038009e5118"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:42:00.199062 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.199029    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxxfk\" (UniqueName: \"kubernetes.io/projected/3cac84fa-5bd0-4ad6-bd40-1038009e5118-kube-api-access-xxxfk\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:00.199062 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.199059    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:00.199254 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.199072    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac84fa-5bd0-4ad6-bd40-1038009e5118-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:00.330855 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.330821    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:00.466532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.466441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"
Sep 08 15:42:00.466532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.466466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c" event={"ID":"3cac84fa-5bd0-4ad6-bd40-1038009e5118","Type":"ContainerDied","Data":"60bba9562cc5aff8dbf89a2825ce5d66a22860d967081b2808ba19a8fa13395c"}
Sep 08 15:42:00.466532 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.466527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c" event={"ID":"3cac84fa-5bd0-4ad6-bd40-1038009e5118","Type":"ContainerDied","Data":"4c0c45e45defbbe59fbfd878f2ea01fc7d969a428662646a020344a4782f088b"}
Sep 08 15:42:00.501210 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.501172    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"]
Sep 08 15:42:00.507829 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:00.507796    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-565cd7-5cd495b854-f7k4c"]
Sep 08 15:42:01.828592 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:01.828553    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cac84fa-5bd0-4ad6-bd40-1038009e5118" path="/var/lib/kubelet/pods/3cac84fa-5bd0-4ad6-bd40-1038009e5118/volumes"
Sep 08 15:42:06.216530 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:06.216479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:06.319221 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:06.319162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:06.478088 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:06.477994    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"]
Sep 08 15:42:06.478634 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:06.478599    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy" containerID="cri-o://78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4" gracePeriod=30
Sep 08 15:42:06.506810 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:06.506763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:09.781026 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:09.780989    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-8z9mg"]
Sep 08 15:42:09.781568 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:09.781236    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55dd7bb999-8z9mg" podUID="2a02f0d4-c47c-406b-b363-051839207940" containerName="manager" containerID="cri-o://8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5" gracePeriod=30
Sep 08 15:42:10.027450 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.027425    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:42:10.200354 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.200326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs\") pod \"2a02f0d4-c47c-406b-b363-051839207940\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") "
Sep 08 15:42:10.200537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.200370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert\") pod \"2a02f0d4-c47c-406b-b363-051839207940\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") "
Sep 08 15:42:10.200537 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.200517    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h55m\" (UniqueName: \"kubernetes.io/projected/2a02f0d4-c47c-406b-b363-051839207940-kube-api-access-4h55m\") pod \"2a02f0d4-c47c-406b-b363-051839207940\" (UID: \"2a02f0d4-c47c-406b-b363-051839207940\") "
Sep 08 15:42:10.202538 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.202509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2a02f0d4-c47c-406b-b363-051839207940" (UID: "2a02f0d4-c47c-406b-b363-051839207940"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:42:10.202684 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.202533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2a02f0d4-c47c-406b-b363-051839207940" (UID: "2a02f0d4-c47c-406b-b363-051839207940"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:42:10.202684 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.202512    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a02f0d4-c47c-406b-b363-051839207940-kube-api-access-4h55m" (OuterVolumeSpecName: "kube-api-access-4h55m") pod "2a02f0d4-c47c-406b-b363-051839207940" (UID: "2a02f0d4-c47c-406b-b363-051839207940"). InnerVolumeSpecName "kube-api-access-4h55m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:10.301440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.301406    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h55m\" (UniqueName: \"kubernetes.io/projected/2a02f0d4-c47c-406b-b363-051839207940-kube-api-access-4h55m\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:10.301440 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.301437    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:10.301683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.301451    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a02f0d4-c47c-406b-b363-051839207940-webhook-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:10.521235 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.521152    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a02f0d4-c47c-406b-b363-051839207940" containerID="8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5" exitCode=0
Sep 08 15:42:10.521235 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.521203    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-8z9mg"
Sep 08 15:42:10.521415 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.521244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-8z9mg" event={"ID":"2a02f0d4-c47c-406b-b363-051839207940","Type":"ContainerDied","Data":"8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5"}
Sep 08 15:42:10.521415 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.521304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-8z9mg" event={"ID":"2a02f0d4-c47c-406b-b363-051839207940","Type":"ContainerDied","Data":"024bb58c9ca0dd619477ad8f625dda9f3b6e754a380a16d6d5562a991fb17741"}
Sep 08 15:42:10.521415 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.521333    2578 scope.go:117] "RemoveContainer" containerID="8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5"
Sep 08 15:42:10.531441 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.531417    2578 scope.go:117] "RemoveContainer" containerID="8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5"
Sep 08 15:42:10.531715 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:42:10.531695    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5\": container with ID starting with 8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5 not found: ID does not exist" containerID="8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5"
Sep 08 15:42:10.531782 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.531724    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5"} err="failed to get container status \"8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5\": rpc error: code = NotFound desc = could not find container \"8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5\": container with ID starting with 8831ee521bab7527044049655c76dafc26167216f15f3fe726c022ce6436bcd5 not found: ID does not exist"
Sep 08 15:42:10.543846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.543823    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-8z9mg"]
Sep 08 15:42:10.547207 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:10.547186    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-8z9mg"]
Sep 08 15:42:11.732996 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.732969    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:42:11.827689 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.827609    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a02f0d4-c47c-406b-b363-051839207940" path="/var/lib/kubelet/pods/2a02f0d4-c47c-406b-b363-051839207940/volumes"
Sep 08 15:42:11.918760 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.918727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7m88\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-kube-api-access-k7m88\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.918976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.918821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-podinfo\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.918976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.918891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-data\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.918976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.918913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-token\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.918976 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.918964    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-envoy\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.919202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.918996    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-socket\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.919202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919031    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-certs\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.919202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5f7e67-30dd-44af-884f-712d5a5c701e-istiod-ca-cert\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.919202 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919128    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-credential-socket\") pod \"1d5f7e67-30dd-44af-884f-712d5a5c701e\" (UID: \"1d5f7e67-30dd-44af-884f-712d5a5c701e\") "
Sep 08 15:42:11.919394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919249    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:42:11.919394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919265    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:42:11.919394 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:42:11.919615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919562    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d5f7e67-30dd-44af-884f-712d5a5c701e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:42:11.919717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919616    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-data\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:11.919717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919641    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:11.919717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919657    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-workload-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:11.919717 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.919691    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:42:11.921443 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.921414    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:11.921558 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.921528    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-kube-api-access-k7m88" (OuterVolumeSpecName: "kube-api-access-k7m88") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "kube-api-access-k7m88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:11.921675 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.921649    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:42:11.921745 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:11.921649    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d5f7e67-30dd-44af-884f-712d5a5c701e" (UID: "1d5f7e67-30dd-44af-884f-712d5a5c701e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:42:12.020518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.020484    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7m88\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-kube-api-access-k7m88\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:12.020518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.020512    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-podinfo\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:12.020518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.020522    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-token\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:12.020518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.020530    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-istio-envoy\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:12.020805 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.020539    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5f7e67-30dd-44af-884f-712d5a5c701e-istiod-ca-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:12.020805 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.020547    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5f7e67-30dd-44af-884f-712d5a5c701e-credential-socket\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:42:12.534031 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.533998    2578 generic.go:356] "Generic (PLEG): container finished" podID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerID="78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4" exitCode=0
Sep 08 15:42:12.534220 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.534050    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"
Sep 08 15:42:12.534220 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.534080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" event={"ID":"1d5f7e67-30dd-44af-884f-712d5a5c701e","Type":"ContainerDied","Data":"78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4"}
Sep 08 15:42:12.534220 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.534133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv" event={"ID":"1d5f7e67-30dd-44af-884f-712d5a5c701e","Type":"ContainerDied","Data":"85b7ea12b385317c76cabfcd384a4a79ef6966865a81dcd97cd79f65e9806b24"}
Sep 08 15:42:12.534220 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.534155    2578 scope.go:117] "RemoveContainer" containerID="78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4"
Sep 08 15:42:12.543830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.543812    2578 scope.go:117] "RemoveContainer" containerID="d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38"
Sep 08 15:42:12.558930 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.558902    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"]
Sep 08 15:42:12.559274 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.559244    2578 scope.go:117] "RemoveContainer" containerID="78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4"
Sep 08 15:42:12.559655 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:42:12.559626    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4\": container with ID starting with 78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4 not found: ID does not exist" containerID="78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4"
Sep 08 15:42:12.559769 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.559684    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4"} err="failed to get container status \"78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4\": rpc error: code = NotFound desc = could not find container \"78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4\": container with ID starting with 78fc571ce60f689bd31ffcc11fa7d91fac78c2ff185291fc3b87d7d47281dcd4 not found: ID does not exist"
Sep 08 15:42:12.559769 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.559710    2578 scope.go:117] "RemoveContainer" containerID="d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38"
Sep 08 15:42:12.560124 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:42:12.560094    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38\": container with ID starting with d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38 not found: ID does not exist" containerID="d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38"
Sep 08 15:42:12.560274 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.560248    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38"} err="failed to get container status \"d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38\": rpc error: code = NotFound desc = could not find container \"d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38\": container with ID starting with d211c69faab59937b38779f86d6a63a4f600bb1d96a4547b60dceaa418897b38 not found: ID does not exist"
Sep 08 15:42:12.562293 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:12.562277    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv"]
Sep 08 15:42:13.827670 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:13.827638    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" path="/var/lib/kubelet/pods/1d5f7e67-30dd-44af-884f-712d5a5c701e/volumes"
Sep 08 15:42:47.067379 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:47.067340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:52.354979 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:42:52.354879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:10.566988 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:10.566953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:11.354110 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354066    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55dd7bb999-bzxwl"]
Sep 08 15:43:11.354631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354610    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cac84fa-5bd0-4ad6-bd40-1038009e5118" containerName="maas-api"
Sep 08 15:43:11.354631 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354633    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cac84fa-5bd0-4ad6-bd40-1038009e5118" containerName="maas-api"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354645    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354654    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354669    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354678    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354693    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354701    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354716    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" containerName="maas-api"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354724    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" containerName="maas-api"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354736    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="588ad109-3922-45e6-8987-a046e4038cc0" containerName="maas-api"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354744    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="588ad109-3922-45e6-8987-a046e4038cc0" containerName="maas-api"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354763    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354772    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354793    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a02f0d4-c47c-406b-b363-051839207940" containerName="manager"
Sep 08 15:43:11.354799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354801    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a02f0d4-c47c-406b-b363-051839207940" containerName="manager"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354896    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="588ad109-3922-45e6-8987-a046e4038cc0" containerName="maas-api"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354909    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a02f0d4-c47c-406b-b363-051839207940" containerName="manager"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354918    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="79ee3b64-46e4-4bc5-afa0-9fdc5a0f234b" containerName="maas-api"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354929    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354955    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354968    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cac84fa-5bd0-4ad6-bd40-1038009e5118" containerName="maas-api"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354978    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy"
Sep 08 15:43:11.355504 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.354988    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy"
Sep 08 15:43:11.358317 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.358294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.362317 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.362294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:43:11.362317 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.362310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:43:11.362488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.362335    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9xvpg\""
Sep 08 15:43:11.362488 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.362387    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:43:11.366686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.366664    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-bzxwl"]
Sep 08 15:43:11.519003 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.518964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-webhook-cert\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.519177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.519026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-metrics-certs\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.519177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.519073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqpt\" (UniqueName: \"kubernetes.io/projected/92bf85bd-7f37-4e13-ae1d-407e5ad60690-kube-api-access-8jqpt\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.620572 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.620479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-webhook-cert\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.620572 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.620535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-metrics-certs\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.621010 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.620615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqpt\" (UniqueName: \"kubernetes.io/projected/92bf85bd-7f37-4e13-ae1d-407e5ad60690-kube-api-access-8jqpt\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.622999 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.622977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-metrics-certs\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.623119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.623018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-webhook-cert\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.628922 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.628898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqpt\" (UniqueName: \"kubernetes.io/projected/92bf85bd-7f37-4e13-ae1d-407e5ad60690-kube-api-access-8jqpt\") pod \"maas-controller-55dd7bb999-bzxwl\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") " pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.669718 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.669684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:11.946613 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.946570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-bzxwl"]
Sep 08 15:43:11.948891 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:43:11.948856    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92bf85bd_7f37_4e13_ae1d_407e5ad60690.slice/crio-2c6eb7761cd483a1241223d759199be8619376e47534ff6428bf1351f35aacdd WatchSource:0}: Error finding container 2c6eb7761cd483a1241223d759199be8619376e47534ff6428bf1351f35aacdd: Status 404 returned error can't find the container with id 2c6eb7761cd483a1241223d759199be8619376e47534ff6428bf1351f35aacdd
Sep 08 15:43:11.950688 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:11.950665    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:43:12.855794 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:12.855751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-bzxwl" event={"ID":"92bf85bd-7f37-4e13-ae1d-407e5ad60690","Type":"ContainerStarted","Data":"2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3"}
Sep 08 15:43:12.856203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:12.855825    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:12.856203 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:12.855850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-bzxwl" event={"ID":"92bf85bd-7f37-4e13-ae1d-407e5ad60690","Type":"ContainerStarted","Data":"2c6eb7761cd483a1241223d759199be8619376e47534ff6428bf1351f35aacdd"}
Sep 08 15:43:12.877067 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:12.877012    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55dd7bb999-bzxwl" podStartSLOduration=1.108451498 podStartE2EDuration="1.876996101s" totalImagesPullingTime="768.544603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:43:12.874169963 +0000 UTC m=+1813.533331101" watchObservedRunningTime="2026-09-08 15:43:12.876996101 +0000 UTC m=+1813.536157227"
Sep 08 15:43:23.863437 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:23.863406    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:29.540100 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:29.540061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:31.065480 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.065442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:31.117334 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.117292    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-bzxwl"]
Sep 08 15:43:31.117632 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.117600    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55dd7bb999-bzxwl" podUID="92bf85bd-7f37-4e13-ae1d-407e5ad60690" containerName="manager" containerID="cri-o://2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3" gracePeriod=30
Sep 08 15:43:31.365385 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.365355    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:31.423571 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.423537    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jqpt\" (UniqueName: \"kubernetes.io/projected/92bf85bd-7f37-4e13-ae1d-407e5ad60690-kube-api-access-8jqpt\") pod \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") "
Sep 08 15:43:31.423800 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.423622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-webhook-cert\") pod \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") "
Sep 08 15:43:31.423800 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.423731    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-metrics-certs\") pod \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\" (UID: \"92bf85bd-7f37-4e13-ae1d-407e5ad60690\") "
Sep 08 15:43:31.426227 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.426188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92bf85bd-7f37-4e13-ae1d-407e5ad60690-kube-api-access-8jqpt" (OuterVolumeSpecName: "kube-api-access-8jqpt") pod "92bf85bd-7f37-4e13-ae1d-407e5ad60690" (UID: "92bf85bd-7f37-4e13-ae1d-407e5ad60690"). InnerVolumeSpecName "kube-api-access-8jqpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:43:31.426503 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.426481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "92bf85bd-7f37-4e13-ae1d-407e5ad60690" (UID: "92bf85bd-7f37-4e13-ae1d-407e5ad60690"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:43:31.426615 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.426559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "92bf85bd-7f37-4e13-ae1d-407e5ad60690" (UID: "92bf85bd-7f37-4e13-ae1d-407e5ad60690"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:43:31.525303 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.525271    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jqpt\" (UniqueName: \"kubernetes.io/projected/92bf85bd-7f37-4e13-ae1d-407e5ad60690-kube-api-access-8jqpt\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:43:31.525303 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.525302    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-webhook-cert\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:43:31.525518 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.525312    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bf85bd-7f37-4e13-ae1d-407e5ad60690-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:43:31.959731 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.959701    2578 generic.go:356] "Generic (PLEG): container finished" podID="92bf85bd-7f37-4e13-ae1d-407e5ad60690" containerID="2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3" exitCode=0
Sep 08 15:43:31.959897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.959745    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-bzxwl"
Sep 08 15:43:31.959897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.959795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-bzxwl" event={"ID":"92bf85bd-7f37-4e13-ae1d-407e5ad60690","Type":"ContainerDied","Data":"2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3"}
Sep 08 15:43:31.959897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.959845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-bzxwl" event={"ID":"92bf85bd-7f37-4e13-ae1d-407e5ad60690","Type":"ContainerDied","Data":"2c6eb7761cd483a1241223d759199be8619376e47534ff6428bf1351f35aacdd"}
Sep 08 15:43:31.959897 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.959867    2578 scope.go:117] "RemoveContainer" containerID="2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3"
Sep 08 15:43:31.968611 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.968594    2578 scope.go:117] "RemoveContainer" containerID="2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3"
Sep 08 15:43:31.968946 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:43:31.968928    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3\": container with ID starting with 2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3 not found: ID does not exist" containerID="2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3"
Sep 08 15:43:31.969016 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.968958    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3"} err="failed to get container status \"2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3\": rpc error: code = NotFound desc = could not find container \"2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3\": container with ID starting with 2fa6bf8d11cae0e79af124b712792422b504418d867883441969d97455034fe3 not found: ID does not exist"
Sep 08 15:43:31.979549 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.979520    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-bzxwl"]
Sep 08 15:43:31.988216 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:31.988195    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-bzxwl"]
Sep 08 15:43:32.708565 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.708529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:32.785984 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.785938    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55dd7bb999-l4q27"]
Sep 08 15:43:32.786404 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786390    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy"
Sep 08 15:43:32.786449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786406    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy"
Sep 08 15:43:32.786449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786417    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy"
Sep 08 15:43:32.786449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786422    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5f7e67-30dd-44af-884f-712d5a5c701e" containerName="istio-proxy"
Sep 08 15:43:32.786449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786432    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92bf85bd-7f37-4e13-ae1d-407e5ad60690" containerName="manager"
Sep 08 15:43:32.786449 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786438    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="92bf85bd-7f37-4e13-ae1d-407e5ad60690" containerName="manager"
Sep 08 15:43:32.786645 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786498    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="92bf85bd-7f37-4e13-ae1d-407e5ad60690" containerName="manager"
Sep 08 15:43:32.786645 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786505    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4009ad99-f966-403e-ae20-2c6e33e5de72" containerName="istio-proxy"
Sep 08 15:43:32.786645 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.786517    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6f267a-5d7b-4d26-bce5-810e48ae6245" containerName="istio-proxy"
Sep 08 15:43:32.789613 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.789571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.793723 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.793689    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:43:32.793870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.793691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:43:32.793870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.793707    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9xvpg\""
Sep 08 15:43:32.793870 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.793817    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:43:32.804514 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.804474    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-l4q27"]
Sep 08 15:43:32.839215 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.839189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x566n\" (UniqueName: \"kubernetes.io/projected/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-kube-api-access-x566n\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.839377 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.839234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-metrics-certs\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.839377 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.839261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-webhook-cert\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.940765 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.940724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-webhook-cert\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.941030 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.941007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x566n\" (UniqueName: \"kubernetes.io/projected/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-kube-api-access-x566n\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.941110 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.941091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-metrics-certs\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.943350 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.943326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-metrics-certs\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.943465 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.943364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-webhook-cert\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:32.955099 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:32.955074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x566n\" (UniqueName: \"kubernetes.io/projected/3aeefe70-10d5-4699-918a-9bb6b9df1d4f-kube-api-access-x566n\") pod \"maas-controller-55dd7bb999-l4q27\" (UID: \"3aeefe70-10d5-4699-918a-9bb6b9df1d4f\") " pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:33.100375 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:33.100276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:33.379181 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:33.379154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dd7bb999-l4q27"]
Sep 08 15:43:33.381371 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:43:33.381336    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aeefe70_10d5_4699_918a_9bb6b9df1d4f.slice/crio-105ba276adafe2e9c8baeaff7c1e1853fcfe35729b17b02288f2bf0c6ec96a91 WatchSource:0}: Error finding container 105ba276adafe2e9c8baeaff7c1e1853fcfe35729b17b02288f2bf0c6ec96a91: Status 404 returned error can't find the container with id 105ba276adafe2e9c8baeaff7c1e1853fcfe35729b17b02288f2bf0c6ec96a91
Sep 08 15:43:33.828414 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:33.828378    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92bf85bd-7f37-4e13-ae1d-407e5ad60690" path="/var/lib/kubelet/pods/92bf85bd-7f37-4e13-ae1d-407e5ad60690/volumes"
Sep 08 15:43:33.974119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:33.974076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-l4q27" event={"ID":"3aeefe70-10d5-4699-918a-9bb6b9df1d4f","Type":"ContainerStarted","Data":"105ba276adafe2e9c8baeaff7c1e1853fcfe35729b17b02288f2bf0c6ec96a91"}
Sep 08 15:43:34.981362 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:34.981327    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dd7bb999-l4q27" event={"ID":"3aeefe70-10d5-4699-918a-9bb6b9df1d4f","Type":"ContainerStarted","Data":"dfa0a6e806b9affde3beb4a32ebae68b371f4296a0b26f1e49f446d63dbcf937"}
Sep 08 15:43:34.981822 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:34.981466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:43:35.002540 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:35.002490    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55dd7bb999-l4q27" podStartSLOduration=2.261966132 podStartE2EDuration="3.002472703s" totalImagesPullingTime="740.506571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:43:35.000145909 +0000 UTC m=+1835.659307059" watchObservedRunningTime="2026-09-08 15:43:35.002472703 +0000 UTC m=+1835.661633836"
Sep 08 15:43:45.988218 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:43:45.988186    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55dd7bb999-l4q27"
Sep 08 15:46:24.701780 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:46:24.701750    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:32.626681 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:46:32.626640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:45.273730 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:46:45.273690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:46.463830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:46:46.463797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:55.388573 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:46:55.388520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:05.376948 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.376908    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"]
Sep 08 15:47:05.381119 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.381093    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.394343 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.394314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"]
Sep 08 15:47:05.436329 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.436286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e36dd7-fa36-4896-801f-f489ee575e12-metrics-certs\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.436510 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.436439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e36dd7-fa36-4896-801f-f489ee575e12-openshift-service-ca\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.436576 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.436507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t2m6\" (UniqueName: \"kubernetes.io/projected/a2e36dd7-fa36-4896-801f-f489ee575e12-kube-api-access-7t2m6\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.436576 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.436568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2e36dd7-fa36-4896-801f-f489ee575e12-maas-api-tls\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.537801 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.537766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e36dd7-fa36-4896-801f-f489ee575e12-metrics-certs\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.537991 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.537886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e36dd7-fa36-4896-801f-f489ee575e12-openshift-service-ca\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.537991 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.537920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t2m6\" (UniqueName: \"kubernetes.io/projected/a2e36dd7-fa36-4896-801f-f489ee575e12-kube-api-access-7t2m6\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.537991 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.537961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2e36dd7-fa36-4896-801f-f489ee575e12-maas-api-tls\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.538598 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.538551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e36dd7-fa36-4896-801f-f489ee575e12-openshift-service-ca\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.540482 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.540449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2e36dd7-fa36-4896-801f-f489ee575e12-maas-api-tls\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.540620 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.540500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e36dd7-fa36-4896-801f-f489ee575e12-metrics-certs\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.545848 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.545826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t2m6\" (UniqueName: \"kubernetes.io/projected/a2e36dd7-fa36-4896-801f-f489ee575e12-kube-api-access-7t2m6\") pod \"maas-api-59f6799c9b-hgz4n\" (UID: \"a2e36dd7-fa36-4896-801f-f489ee575e12\") " pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.695208 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.695111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:05.967196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:05.967163    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"]
Sep 08 15:47:05.969296 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:47:05.969264    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e36dd7_fa36_4896_801f_f489ee575e12.slice/crio-964cf2b71016609e01b21933dcdb8a2bceb7a12c8bb82374376cc59731b73f2a WatchSource:0}: Error finding container 964cf2b71016609e01b21933dcdb8a2bceb7a12c8bb82374376cc59731b73f2a: Status 404 returned error can't find the container with id 964cf2b71016609e01b21933dcdb8a2bceb7a12c8bb82374376cc59731b73f2a
Sep 08 15:47:06.073456 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:06.073419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n" event={"ID":"a2e36dd7-fa36-4896-801f-f489ee575e12","Type":"ContainerStarted","Data":"964cf2b71016609e01b21933dcdb8a2bceb7a12c8bb82374376cc59731b73f2a"}
Sep 08 15:47:07.081820 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:07.081777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n" event={"ID":"a2e36dd7-fa36-4896-801f-f489ee575e12","Type":"ContainerStarted","Data":"f5b350a3d66bf054c86ea137794f7d199c917efc13b05bae6530d36e4a88720d"}
Sep 08 15:47:07.082365 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:07.081881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:07.101597 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:07.101526    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n" podStartSLOduration=1.485453411 podStartE2EDuration="2.101508993s" totalImagesPullingTime="616.055582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:47:07.101161713 +0000 UTC m=+2047.760322865" watchObservedRunningTime="2026-09-08 15:47:07.101508993 +0000 UTC m=+2047.760670119"
Sep 08 15:47:13.091669 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:13.091636    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6799c9b-hgz4n"
Sep 08 15:47:13.141940 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:13.141907    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"]
Sep 08 15:47:13.142147 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:13.142119    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc" podUID="aa63b385-4211-4aba-901c-da72a8de7343" containerName="maas-api" containerID="cri-o://b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac" gracePeriod=30
Sep 08 15:47:14.398536 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.398504    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:47:14.532767 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.532676    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa63b385-4211-4aba-901c-da72a8de7343-openshift-service-ca\") pod \"aa63b385-4211-4aba-901c-da72a8de7343\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") "
Sep 08 15:47:14.532767 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.532721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-metrics-certs\") pod \"aa63b385-4211-4aba-901c-da72a8de7343\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") "
Sep 08 15:47:14.532957 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.532787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k25hv\" (UniqueName: \"kubernetes.io/projected/aa63b385-4211-4aba-901c-da72a8de7343-kube-api-access-k25hv\") pod \"aa63b385-4211-4aba-901c-da72a8de7343\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") "
Sep 08 15:47:14.532957 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.532817    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls\") pod \"aa63b385-4211-4aba-901c-da72a8de7343\" (UID: \"aa63b385-4211-4aba-901c-da72a8de7343\") "
Sep 08 15:47:14.533120 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.533088    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa63b385-4211-4aba-901c-da72a8de7343-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa63b385-4211-4aba-901c-da72a8de7343" (UID: "aa63b385-4211-4aba-901c-da72a8de7343"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:47:14.534899 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.534870    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "aa63b385-4211-4aba-901c-da72a8de7343" (UID: "aa63b385-4211-4aba-901c-da72a8de7343"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:47:14.535033 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.534962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa63b385-4211-4aba-901c-da72a8de7343-kube-api-access-k25hv" (OuterVolumeSpecName: "kube-api-access-k25hv") pod "aa63b385-4211-4aba-901c-da72a8de7343" (UID: "aa63b385-4211-4aba-901c-da72a8de7343"). InnerVolumeSpecName "kube-api-access-k25hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:47:14.535033 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.534995    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa63b385-4211-4aba-901c-da72a8de7343" (UID: "aa63b385-4211-4aba-901c-da72a8de7343"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:47:14.634363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.634326    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k25hv\" (UniqueName: \"kubernetes.io/projected/aa63b385-4211-4aba-901c-da72a8de7343-kube-api-access-k25hv\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:47:14.634363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.634357    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-maas-api-tls\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:47:14.634363 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.634367    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa63b385-4211-4aba-901c-da72a8de7343-openshift-service-ca\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:47:14.634625 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:14.634378    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa63b385-4211-4aba-901c-da72a8de7343-metrics-certs\") on node \"ip-10-0-129-54.ec2.internal\" DevicePath \"\""
Sep 08 15:47:15.123998 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.123962    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa63b385-4211-4aba-901c-da72a8de7343" containerID="b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac" exitCode=0
Sep 08 15:47:15.124185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.124005    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"
Sep 08 15:47:15.124185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.124055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc" event={"ID":"aa63b385-4211-4aba-901c-da72a8de7343","Type":"ContainerDied","Data":"b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac"}
Sep 08 15:47:15.124185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.124107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc" event={"ID":"aa63b385-4211-4aba-901c-da72a8de7343","Type":"ContainerDied","Data":"9a881459c9fac24822fc2325b0420b511b57cdac4983558c5c872d3f1c5bb68f"}
Sep 08 15:47:15.124185 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.124131    2578 scope.go:117] "RemoveContainer" containerID="b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac"
Sep 08 15:47:15.134095 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.134077    2578 scope.go:117] "RemoveContainer" containerID="b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac"
Sep 08 15:47:15.134360 ip-10-0-129-54 kubenswrapper[2578]: E0908 15:47:15.134343    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac\": container with ID starting with b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac not found: ID does not exist" containerID="b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac"
Sep 08 15:47:15.134403 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.134369    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac"} err="failed to get container status \"b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac\": rpc error: code = NotFound desc = could not find container \"b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac\": container with ID starting with b75b141add3fe1be505768cdb3b7cb0a23d07791bfc939dba5bb6e5bf3a381ac not found: ID does not exist"
Sep 08 15:47:15.145683 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.145660    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"]
Sep 08 15:47:15.149673 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.149652    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b8df4f6-dgmkc"]
Sep 08 15:47:15.828405 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:15.828371    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa63b385-4211-4aba-901c-da72a8de7343" path="/var/lib/kubelet/pods/aa63b385-4211-4aba-901c-da72a8de7343/volumes"
Sep 08 15:47:43.436804 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:43.436720    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h7c66_7459a629-a3cb-405e-9714-de32ecc35e6c/manager/0.log"
Sep 08 15:47:43.556164 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:43.556133    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dt25d_c1bb4d86-9bfe-4878-8d6e-2caa24911179/manager/0.log"
Sep 08 15:47:43.668477 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:43.668451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55dd7bb999-l4q27_3aeefe70-10d5-4699-918a-9bb6b9df1d4f/manager/0.log"
Sep 08 15:47:43.775618 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:43.775571    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k6wlp_e0fb3cbe-f0d2-4a2a-804c-c02202baa614/server/0.log"
Sep 08 15:47:44.135010 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:44.134927    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-q42jc_70527504-0fe4-4a88-a1f4-2c006cba6f67/copy-manifests/0.log"
Sep 08 15:47:44.147686 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:44.147662    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-q42jc_70527504-0fe4-4a88-a1f4-2c006cba6f67/manager/0.log"
Sep 08 15:47:44.586265 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:44.586233    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59f6799c9b-hgz4n_a2e36dd7-fa36-4896-801f-f489ee575e12/maas-api/0.log"
Sep 08 15:47:45.023434 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:45.023400    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dpr5b_844d0811-1d0d-41b2-a87c-f1a19f5a0d48/postgres/0.log"
Sep 08 15:47:46.855500 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:46.855470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr_6d7ed442-43a6-461d-baf8-7f35dfe3e120/istio-proxy/0.log"
Sep 08 15:47:47.322591 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:47.322546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-gr8lt_b5052582-58a3-474a-903a-c670e32346f9/istio-proxy/1.log"
Sep 08 15:47:47.558396 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:47.558363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5w58s_e83bc787-cf0d-45f8-b5bf-acec97385865/payload-processing/0.log"
Sep 08 15:47:48.011067 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:48.011036    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-72qcc_3f49d979-5964-4584-90f2-a4784fa0ae51/main/0.log"
Sep 08 15:47:48.125992 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:48.125959    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gjlv7_7362e32b-6124-4f6d-ad0b-0672cee261d5/main/0.log"
Sep 08 15:47:48.572832 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:48.572804    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4mr4m_7c39537f-51e2-4f5b-9fbe-f5a6dc59226c/main/0.log"
Sep 08 15:47:54.323754 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:54.323718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:54.393471 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:54.393438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:57.194442 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:57.194406    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2qjpj_7a5fa953-84c7-4b92-b1e0-b78a8d2ef623/global-pull-secret-syncer/0.log"
Sep 08 15:47:57.315357 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:57.315329    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7628m_65118f5a-b030-45d0-a814-64f48c43ecd3/konnectivity-agent/0.log"
Sep 08 15:47:57.421207 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:47:57.421174    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-54.ec2.internal_8d0358a143f5ee61a4eab8951a3101e2/haproxy/0.log"
Sep 08 15:48:04.163799 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.163774    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a491b47-c0c4-45fa-828d-180476103cff/alertmanager/0.log"
Sep 08 15:48:04.201915 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.201889    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a491b47-c0c4-45fa-828d-180476103cff/config-reloader/0.log"
Sep 08 15:48:04.225177 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.225150    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a491b47-c0c4-45fa-828d-180476103cff/kube-rbac-proxy-web/0.log"
Sep 08 15:48:04.246328 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.246303    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a491b47-c0c4-45fa-828d-180476103cff/kube-rbac-proxy/0.log"
Sep 08 15:48:04.281275 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.281247    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a491b47-c0c4-45fa-828d-180476103cff/kube-rbac-proxy-metric/0.log"
Sep 08 15:48:04.303775 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.303748    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a491b47-c0c4-45fa-828d-180476103cff/prom-label-proxy/0.log"
Sep 08 15:48:04.331014 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.330989    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a491b47-c0c4-45fa-828d-180476103cff/init-config-reloader/0.log"
Sep 08 15:48:04.401227 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.401152    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2t65l_f0e67c53-d908-4654-a4dc-7a88b3128a2f/kube-state-metrics/0.log"
Sep 08 15:48:04.420106 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.420080    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2t65l_f0e67c53-d908-4654-a4dc-7a88b3128a2f/kube-rbac-proxy-main/0.log"
Sep 08 15:48:04.440538 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.440506    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2t65l_f0e67c53-d908-4654-a4dc-7a88b3128a2f/kube-rbac-proxy-self/0.log"
Sep 08 15:48:04.466085 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.466056    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76f59bc69c-rd9hn_5f7e2b7a-f818-47ee-b43e-f3bf1c6bef65/metrics-server/0.log"
Sep 08 15:48:04.500193 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.500168    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-nm8jq_b27716fc-0402-4679-ac33-1c9e8bc9b507/monitoring-plugin/0.log"
Sep 08 15:48:04.674344 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.674246    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rkj7s_6b2f5c00-c523-46a3-a27e-969931c52c0a/node-exporter/0.log"
Sep 08 15:48:04.698192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.698171    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rkj7s_6b2f5c00-c523-46a3-a27e-969931c52c0a/kube-rbac-proxy/0.log"
Sep 08 15:48:04.719059 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.719031    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rkj7s_6b2f5c00-c523-46a3-a27e-969931c52c0a/init-textfile/0.log"
Sep 08 15:48:04.744435 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.744409    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-4bhtt_824e477f-3f4a-4984-9feb-8afc47e5124d/kube-rbac-proxy-main/0.log"
Sep 08 15:48:04.766137 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.766116    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-4bhtt_824e477f-3f4a-4984-9feb-8afc47e5124d/kube-rbac-proxy-self/0.log"
Sep 08 15:48:04.788048 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.788028    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-4bhtt_824e477f-3f4a-4984-9feb-8afc47e5124d/openshift-state-metrics/0.log"
Sep 08 15:48:04.835826 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.835801    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3adabfcf-4d8c-4501-9411-fa4d29367742/prometheus/0.log"
Sep 08 15:48:04.862889 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.862861    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3adabfcf-4d8c-4501-9411-fa4d29367742/config-reloader/0.log"
Sep 08 15:48:04.886710 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.886687    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3adabfcf-4d8c-4501-9411-fa4d29367742/thanos-sidecar/0.log"
Sep 08 15:48:04.909971 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.909949    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3adabfcf-4d8c-4501-9411-fa4d29367742/kube-rbac-proxy-web/0.log"
Sep 08 15:48:04.933328 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.933269    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3adabfcf-4d8c-4501-9411-fa4d29367742/kube-rbac-proxy/0.log"
Sep 08 15:48:04.956944 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.956918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3adabfcf-4d8c-4501-9411-fa4d29367742/kube-rbac-proxy-thanos/0.log"
Sep 08 15:48:04.980156 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:04.980134    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3adabfcf-4d8c-4501-9411-fa4d29367742/init-config-reloader/0.log"
Sep 08 15:48:05.008130 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.008102    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wjzbk_1b27035c-4597-4cef-9326-35bc3e3bf201/prometheus-operator/0.log"
Sep 08 15:48:05.027528 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.027504    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wjzbk_1b27035c-4597-4cef-9326-35bc3e3bf201/kube-rbac-proxy/0.log"
Sep 08 15:48:05.080426 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.080400    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775c88466f-w9xqc_7ca62860-7275-4e1a-b339-3d6b3c7bea44/telemeter-client/0.log"
Sep 08 15:48:05.104469 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.104449    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775c88466f-w9xqc_7ca62860-7275-4e1a-b339-3d6b3c7bea44/reload/0.log"
Sep 08 15:48:05.126593 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.126561    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775c88466f-w9xqc_7ca62860-7275-4e1a-b339-3d6b3c7bea44/kube-rbac-proxy/0.log"
Sep 08 15:48:05.158415 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.158393    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6975cd5467-v8zg2_8691c20a-3cf1-4bde-a77a-3ba9f53afbd7/thanos-query/0.log"
Sep 08 15:48:05.179802 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.179780    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6975cd5467-v8zg2_8691c20a-3cf1-4bde-a77a-3ba9f53afbd7/kube-rbac-proxy-web/0.log"
Sep 08 15:48:05.204846 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.204827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6975cd5467-v8zg2_8691c20a-3cf1-4bde-a77a-3ba9f53afbd7/kube-rbac-proxy/0.log"
Sep 08 15:48:05.225499 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.225468    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6975cd5467-v8zg2_8691c20a-3cf1-4bde-a77a-3ba9f53afbd7/prom-label-proxy/0.log"
Sep 08 15:48:05.246018 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.245992    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6975cd5467-v8zg2_8691c20a-3cf1-4bde-a77a-3ba9f53afbd7/kube-rbac-proxy-rules/0.log"
Sep 08 15:48:05.266314 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:05.266290    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6975cd5467-v8zg2_8691c20a-3cf1-4bde-a77a-3ba9f53afbd7/kube-rbac-proxy-metrics/0.log"
Sep 08 15:48:07.147546 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.147504    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"]
Sep 08 15:48:07.148178 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.148156    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa63b385-4211-4aba-901c-da72a8de7343" containerName="maas-api"
Sep 08 15:48:07.148274 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.148180    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa63b385-4211-4aba-901c-da72a8de7343" containerName="maas-api"
Sep 08 15:48:07.148331 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.148276    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa63b385-4211-4aba-901c-da72a8de7343" containerName="maas-api"
Sep 08 15:48:07.151525 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.151501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.154196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.154168    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m72hg\"/\"kube-root-ca.crt\""
Sep 08 15:48:07.154342 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.154173    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m72hg\"/\"openshift-service-ca.crt\""
Sep 08 15:48:07.155097 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.155079    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m72hg\"/\"default-dockercfg-hqgkw\""
Sep 08 15:48:07.160452 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.160429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"]
Sep 08 15:48:07.164047 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.164025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-sys\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.164150 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.164111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-lib-modules\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.164150 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.164136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-proc\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.164252 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.164170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-podres\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.164252 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.164232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqkpm\" (UniqueName: \"kubernetes.io/projected/bdf4daab-1892-4db8-be27-6159a36d3f22-kube-api-access-dqkpm\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.264830 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.264788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqkpm\" (UniqueName: \"kubernetes.io/projected/bdf4daab-1892-4db8-be27-6159a36d3f22-kube-api-access-dqkpm\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265017 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.264852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-sys\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265017 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.264944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-lib-modules\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265017 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.264978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-proc\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265174 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.265032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-podres\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265174 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.265058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-proc\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265174 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.265077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-lib-modules\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265174 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.264979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-sys\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.265310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.265192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdf4daab-1892-4db8-be27-6159a36d3f22-podres\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.273152 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.273121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqkpm\" (UniqueName: \"kubernetes.io/projected/bdf4daab-1892-4db8-be27-6159a36d3f22-kube-api-access-dqkpm\") pod \"perf-node-gather-daemonset-xcblk\" (UID: \"bdf4daab-1892-4db8-be27-6159a36d3f22\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.462196 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.462166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:07.721692 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.721619    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c9967445-rbzbz_6ae80fee-24f5-44b9-9e7a-900e7afc725b/console/0.log"
Sep 08 15:48:07.731192 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:07.731169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"]
Sep 08 15:48:07.733309 ip-10-0-129-54 kubenswrapper[2578]: W0908 15:48:07.733283    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbdf4daab_1892_4db8_be27_6159a36d3f22.slice/crio-9e7dcff8a0e96f8e4e7b4a0e12c71a9d4b6971511aca3f6ceff685cfe2666f6a WatchSource:0}: Error finding container 9e7dcff8a0e96f8e4e7b4a0e12c71a9d4b6971511aca3f6ceff685cfe2666f6a: Status 404 returned error can't find the container with id 9e7dcff8a0e96f8e4e7b4a0e12c71a9d4b6971511aca3f6ceff685cfe2666f6a
Sep 08 15:48:08.403055 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:08.403012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk" event={"ID":"bdf4daab-1892-4db8-be27-6159a36d3f22","Type":"ContainerStarted","Data":"a259334a2f474ac657ac5d065dcf0feef9094041cb5da25476bde4b795889ce5"}
Sep 08 15:48:08.403459 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:08.403066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk" event={"ID":"bdf4daab-1892-4db8-be27-6159a36d3f22","Type":"ContainerStarted","Data":"9e7dcff8a0e96f8e4e7b4a0e12c71a9d4b6971511aca3f6ceff685cfe2666f6a"}
Sep 08 15:48:08.403459 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:08.403089    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:08.421495 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:08.421446    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk" podStartSLOduration=1.421428873 podStartE2EDuration="1.421428873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:08.420820318 +0000 UTC m=+2109.079981444" watchObservedRunningTime="2026-09-08 15:48:08.421428873 +0000 UTC m=+2109.080590000"
Sep 08 15:48:09.608791 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:09.608759    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwcvm_a7907de3-9695-41df-85fc-b4de8d5d0e23/dns/0.log"
Sep 08 15:48:09.628804 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:09.628777    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwcvm_a7907de3-9695-41df-85fc-b4de8d5d0e23/kube-rbac-proxy/0.log"
Sep 08 15:48:09.717875 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:09.717846    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pqx66_e4335589-749e-4577-9e80-bf1f026e392b/dns-node-resolver/0.log"
Sep 08 15:48:10.333030 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:10.332995    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nmt7d_d7fb0085-184d-4787-abc4-87d4dcdcc09c/node-ca/0.log"
Sep 08 15:48:11.261672 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:11.261645    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr_6d7ed442-43a6-461d-baf8-7f35dfe3e120/istio-proxy/0.log"
Sep 08 15:48:11.908017 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:11.907981    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-gr8lt_b5052582-58a3-474a-903a-c670e32346f9/istio-proxy/0.log"
Sep 08 15:48:11.917496 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:11.917467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-gr8lt_b5052582-58a3-474a-903a-c670e32346f9/istio-proxy/1.log"
Sep 08 15:48:11.995691 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:11.995663    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5w58s_e83bc787-cf0d-45f8-b5bf-acec97385865/payload-processing/0.log"
Sep 08 15:48:12.934310 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:12.934281    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rhxn6_394ce1c2-7a5c-48c2-9da6-5d238b34d4cf/serve-healthcheck-canary/0.log"
Sep 08 15:48:13.436775 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:13.436747    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkt4t_73d2f7cf-c76e-40cc-859a-2ab76a8352af/kube-rbac-proxy/0.log"
Sep 08 15:48:13.457184 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:13.457157    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkt4t_73d2f7cf-c76e-40cc-859a-2ab76a8352af/exporter/0.log"
Sep 08 15:48:13.477385 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:13.477363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkt4t_73d2f7cf-c76e-40cc-859a-2ab76a8352af/extractor/0.log"
Sep 08 15:48:14.418792 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:14.418762    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-xcblk"
Sep 08 15:48:15.797849 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:15.797823    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h7c66_7459a629-a3cb-405e-9714-de32ecc35e6c/manager/0.log"
Sep 08 15:48:16.035546 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:16.035469    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dt25d_c1bb4d86-9bfe-4878-8d6e-2caa24911179/manager/0.log"
Sep 08 15:48:16.082722 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:16.082697    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55dd7bb999-l4q27_3aeefe70-10d5-4699-918a-9bb6b9df1d4f/manager/0.log"
Sep 08 15:48:16.102591 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:16.102556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k6wlp_e0fb3cbe-f0d2-4a2a-804c-c02202baa614/server/0.log"
Sep 08 15:48:16.356764 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:16.356682    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-q42jc_70527504-0fe4-4a88-a1f4-2c006cba6f67/manager/0.log"
Sep 08 15:48:16.374077 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:16.374050    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-q42jc_70527504-0fe4-4a88-a1f4-2c006cba6f67/copy-manifests/0.log"
Sep 08 15:48:17.735475 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:17.735447    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c78744898-d8r86_f97947c0-e98f-48bd-9d96-7bf1ecf43c1c/manager/0.log"
Sep 08 15:48:17.737760 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:17.737733    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr_6d7ed442-43a6-461d-baf8-7f35dfe3e120/istio-proxy/0.log"
Sep 08 15:48:17.788132 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:17.788102    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vt87z_0f2b896c-a082-470f-92bb-644484219ba8/openshift-lws-operator/0.log"
Sep 08 15:48:18.333960 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:18.333930    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-gr8lt_b5052582-58a3-474a-903a-c670e32346f9/istio-proxy/0.log"
Sep 08 15:48:18.344114 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:18.344093    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-gr8lt_b5052582-58a3-474a-903a-c670e32346f9/istio-proxy/1.log"
Sep 08 15:48:18.410033 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:18.410001    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5w58s_e83bc787-cf0d-45f8-b5bf-acec97385865/payload-processing/0.log"
Sep 08 15:48:19.811410 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:19.811376    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr_6d7ed442-43a6-461d-baf8-7f35dfe3e120/istio-proxy/0.log"
Sep 08 15:48:20.431918 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:20.431884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-gr8lt_b5052582-58a3-474a-903a-c670e32346f9/istio-proxy/0.log"
Sep 08 15:48:20.446074 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:20.446035    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-gr8lt_b5052582-58a3-474a-903a-c670e32346f9/istio-proxy/1.log"
Sep 08 15:48:20.512947 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:20.512903    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5w58s_e83bc787-cf0d-45f8-b5bf-acec97385865/payload-processing/0.log"
Sep 08 15:48:24.240153 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:24.240124    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzb9z_a6e8db2d-f735-490d-a1e8-0c0d096f3590/kube-multus-additional-cni-plugins/0.log"
Sep 08 15:48:24.263208 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:24.263180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzb9z_a6e8db2d-f735-490d-a1e8-0c0d096f3590/egress-router-binary-copy/0.log"
Sep 08 15:48:24.283702 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:24.283677    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzb9z_a6e8db2d-f735-490d-a1e8-0c0d096f3590/cni-plugins/0.log"
Sep 08 15:48:24.303563 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:24.303543    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzb9z_a6e8db2d-f735-490d-a1e8-0c0d096f3590/bond-cni-plugin/0.log"
Sep 08 15:48:24.324390 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:24.324371    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzb9z_a6e8db2d-f735-490d-a1e8-0c0d096f3590/routeoverride-cni/0.log"
Sep 08 15:48:24.344828 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:24.344799    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzb9z_a6e8db2d-f735-490d-a1e8-0c0d096f3590/whereabouts-cni-bincopy/0.log"
Sep 08 15:48:24.366016 ip-10-0-129-54 kubenswrapper[2578]: I0908 15:48:24.365993    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzb9z_a6e8db2d-f735-490d-a1e8-0c0d096f3590/whereabouts-cni/0.log"